1
|
Castellana R, Fanni SC, Roncella C, Romei C, Natrella M, Neri E. Radiomics and deep learning models for CT pre-operative lymph node staging in pancreatic ductal adenocarcinoma: A systematic review and meta-analysis. Eur J Radiol 2024; 176:111510. [PMID: 38781919 DOI: 10.1016/j.ejrad.2024.111510] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Revised: 04/23/2024] [Accepted: 05/13/2024] [Indexed: 05/25/2024]
Abstract
PURPOSE To evaluate the diagnostic accuracy of computed tomography (CT)-based radiomic algorithms and deep learning models to preoperatively identify lymph node metastasis (LNM) in patients with pancreatic ductal adenocarcinoma (PDAC). METHODS PubMed, CENTRAL, Scopus, Web of Science and IEEE databases were searched to identify relevant studies published up until February 11, 2024. Two reviewers screened all papers independently for eligibility. Studies reporting the accuracy of CT-based radiomics or deep learning models for detecting LNM in PDAC, using histopathology as the reference standard, were included. Quality was assessed using the Quality Assessment of Diagnostic Accuracy Studies 2, the Radiomics Quality Score (RQS) and the the METhodological RadiomICs Score (METRICS). Overall sensitivity (SE), specificity (SP), diagnostic odds ratio (DOR), and the area under the curve (AUC) were calculated. RESULTS Four radiomics studies comprising 213 patients and four deep learning studies with 272 patients were included. The average RQS total score was 12.00 ± 3.89, corresponding to an RQS percentage of 33.33 ± 10.80, while the average METRICS score was 63.60 ± 10.88. A significant and strong positive correlation was found between RQS and METRICS (p = 0.016; r = 0.810). The pooled SE, SP, DOR, and AUC of all the studies were 0.83 (95 %CI = 0.77-0.88), 0.76 (95 %CI = 0.62-0.86), 15.70 (95 %CI = 8.12-27.50) and 0.85 (95 %CI = 0.77-0.88). Meta-regression analysis results indicated that neither the study type (radiomics vs deep learning) nor the dataset size of the studies had a significant effect on the DOR (p = 0.09 and p = 0.26, respectively). CONCLUSION Based on our meta-analysis findings, preoperative CT-based radiomics algorithms and deep learning models demonstrate favorable performance in predicting LNM in patients with PDAC, with a strong correlation between RQS and METRICS of the included studies.
Collapse
Affiliation(s)
- Roberto Castellana
- Diagnostic and Interventional Radiology, "Parini" Regional Hospital, Azienda USL della Valle d'Aosta, Viale Ginevra 3 11100, Aosta, Italy.
| | - Salvatore Claudio Fanni
- Department of Translational Research, Academic Radiology, University of Pisa, Via Paradisa 2, 56124 Pisa, Italy
| | - Claudia Roncella
- Radiology Unit, Apuane Hospital, Azienda USL Toscana Nord Ovest, Via Mattei 21, 54100, Massa, Italy
| | - Chiara Romei
- Department of Diagnostic Imaging, Diagnostic Radiology 2, Pisa University Hospital, Via Paradisa 2, 56124, Pisa, Italy
| | - Massimiliano Natrella
- Diagnostic and Interventional Radiology, "Parini" Regional Hospital, Azienda USL della Valle d'Aosta, Viale Ginevra 3 11100, Aosta, Italy
| | - Emanuele Neri
- Department of Translational Research, Academic Radiology, University of Pisa, Via Paradisa 2, 56124 Pisa, Italy
| |
Collapse
|
2
|
Ye X, Zhang X, Lin Z, Liang T, Liu G, Zhao P. Ultrasound-based radiomics nomogram for predicting axillary lymph node metastasis in invasive breast cancer. Am J Transl Res 2024; 16:2398-2410. [PMID: 39006270 PMCID: PMC11236629 DOI: 10.62347/kepz9726] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2024] [Accepted: 05/18/2024] [Indexed: 07/16/2024]
Abstract
OBJECTIVE To develop a nomogram for predicting axillary lymph node metastasis (ALNM) in patients with invasive breast cancer. METHODS We included 307 patients with clinicopathologically confirmed invasive breast cancer. The cohort was divided into a training group (n=215) and a validation group (n=92). Ultrasound images were used to extract radiomics features. The least absolute shrinkage and selection operator (LASSO) algorithm helped select pertinent features, from which Radiomics Scores (Radscores) were calculated using the LASSO regression equation. We developed three logistic regression models based on Radscores and 2D image features, and assessed the models' performance in the validation group. A nomogram was created from the best-performing model. RESULTS In the training set, the area under the curve (AUC) for the Radscore model, 2D feature model, and combined model were 0.76, 0.85, and 0.88, respectively. In the validation set, the AUCs were 0.71, 0.78, and 0.83, respectively. The combined model demonstrated good calibration and promising clinical utility. CONCLUSION Our ultrasound-based radiomics nomogram can accurately and non-invasively predict ALNM in breast cancer, suggesting potential clinical applications to optimize surgical and medical strategies.
Collapse
Affiliation(s)
- Xiaolu Ye
- Guangzhou University of Traditional Chinese Medicine First Affiliated HospitalGuangzhou 510405, Guangdong, China
| | - Xiaoxue Zhang
- Guangzhou University of Chinese MedicineGuangzhou 510006, Guangdong, China
| | - Zhuangteng Lin
- Guangzhou University of Traditional Chinese Medicine First Affiliated HospitalGuangzhou 510405, Guangdong, China
| | - Ting Liang
- Guangzhou University of Traditional Chinese Medicine First Affiliated HospitalGuangzhou 510405, Guangdong, China
| | - Ge Liu
- Guangzhou University of Traditional Chinese Medicine First Affiliated HospitalGuangzhou 510405, Guangdong, China
| | - Ping Zhao
- Guangzhou University of Traditional Chinese Medicine First Affiliated HospitalGuangzhou 510405, Guangdong, China
| |
Collapse
|
3
|
Ma D, Zhou T, Chen J, Chen J. Radiomics diagnostic performance for predicting lymph node metastasis in esophageal cancer: a systematic review and meta-analysis. BMC Med Imaging 2024; 24:144. [PMID: 38867143 PMCID: PMC11170881 DOI: 10.1186/s12880-024-01278-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2024] [Accepted: 04/22/2024] [Indexed: 06/14/2024] Open
Abstract
BACKGROUND Esophageal cancer, a global health concern, impacts predominantly men, particularly in Eastern Asia. Lymph node metastasis (LNM) significantly influences prognosis, and current imaging methods exhibit limitations in accurate detection. The integration of radiomics, an artificial intelligence (AI) driven approach in medical imaging, offers a transformative potential. This meta-analysis evaluates existing evidence on the accuracy of radiomics models for predicting LNM in esophageal cancer. METHODS We conducted a systematic review following PRISMA 2020 guidelines, searching Embase, PubMed, and Web of Science for English-language studies up to November 16, 2023. Inclusion criteria focused on preoperatively diagnosed esophageal cancer patients with radiomics predicting LNM before treatment. Exclusion criteria were applied, including non-English studies and those lacking sufficient data or separate validation cohorts. Data extraction encompassed study characteristics and radiomics technical details. Quality assessment employed modified Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) and Radiomics Quality Score (RQS) tools. Statistical analysis involved random-effects models for pooled sensitivity, specificity, diagnostic odds ratio (DOR), and area under the curve (AUC). Heterogeneity and publication bias were assessed using Deek's test and funnel plots. Analysis was performed using Stata version 17.0 and meta-DiSc. RESULTS Out of 426 initially identified citations, nine studies met inclusion criteria, encompassing 719 patients. These retrospective studies utilized CT, PET, and MRI imaging modalities, predominantly conducted in China. Two studies employed deep learning-based radiomics. Quality assessment revealed acceptable QUADAS-2 scores. RQS scores ranged from 9 to 14, averaging 12.78. The diagnostic meta-analysis yielded a pooled sensitivity, specificity, and AUC of 0.72, 0.76, and 0.74, respectively, representing fair diagnostic performance. Meta-regression identified the use of combined models as a significant contributor to heterogeneity (p-value = 0.05). Other factors, such as sample size (> 75) and least absolute shrinkage and selection operator (LASSO) usage for feature extraction, showed potential influence but lacked statistical significance (0.05 < p-value < 0.10). Publication bias was not statistically significant. CONCLUSION Radiomics shows potential for predicting LNM in esophageal cancer, with a moderate diagnostic performance. Standardized approaches, ongoing research, and prospective validation studies are crucial for realizing its clinical applicability.
Collapse
Affiliation(s)
- Dong Ma
- The Fifth Affiliated Hospital, Southern Medical University, Guangzhou, Guangdong, 510900, China
| | - Teli Zhou
- The Fifth Affiliated Hospital, Southern Medical University, Guangzhou, Guangdong, 510900, China
- Yibicom Health Management, Guangzhou, Guangdong, 510700, China
| | - Jing Chen
- The Fifth Affiliated Hospital, Southern Medical University, Guangzhou, Guangdong, 510900, China
| | - Jun Chen
- The Fifth Affiliated Hospital, Southern Medical University, Guangzhou, Guangdong, 510900, China.
| |
Collapse
|
4
|
Yaghoobpoor S, Fathi M, Ghorani H, Valizadeh P, Jannatdoust P, Tavasol A, Zarei M, Arian A. Machine learning approaches in the prediction of positive axillary lymph nodes post neoadjuvant chemotherapy using MRI, CT, or ultrasound: A systematic review. Eur J Radiol Open 2024; 12:100561. [PMID: 38699592 PMCID: PMC11063585 DOI: 10.1016/j.ejro.2024.100561] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2024] [Revised: 03/29/2024] [Accepted: 04/09/2024] [Indexed: 05/05/2024] Open
Abstract
Background and objective Neoadjuvant chemotherapy is a standard treatment approach for locally advanced breast cancer. Conventional imaging modalities, such as magnetic resonance imaging (MRI), computed tomography (CT), and ultrasound, have been used for axillary lymph node evaluation which is crucial for treatment planning and prognostication. This systematic review aims to comprehensively examine the current research on applying machine learning algorithms for predicting positive axillary lymph nodes following neoadjuvant chemotherapy utilizing imaging modalities, including MRI, CT, and ultrasound. Methods A systematic search was conducted across databases, including PubMed, Scopus, and Web of Science, to identify relevant studies published up to December 2023. Articles employing machine learning algorithms to predict positive axillary lymph nodes using MRI, CT, or ultrasound data after neoadjuvant chemotherapy were included. The review follows the preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines, encompassing data extraction and quality assessment. Results Seven studies were included, comprising 1502 patients. Four studies used MRI, two used CT, and one applied ultrasound. Two studies developed deep-learning models, while five used classic machine-learning models mainly based on multiple regression. Across the studies, the models showed high predictive accuracy, with the best-performing models combining radiomics and clinical data. Conclusion This systematic review demonstrated the potential of utilizing advanced data analysis techniques, such as deep learning radiomics, in improving the prediction of positive axillary lymph nodes in breast cancer patients following neoadjuvant chemotherapy.
Collapse
Affiliation(s)
- Shirin Yaghoobpoor
- Advanced Diagnostic and Interventional Radiology Research Center (ADIR), Tehran University of Medical Sciences, Tehran, Islamic Republic of Iran
- Student Research Committee, Faculty of Medicine, Shahid Beheshti University of Medical Sciences, Tehran, Islamic Republic of Iran
| | - Mobina Fathi
- Advanced Diagnostic and Interventional Radiology Research Center (ADIR), Tehran University of Medical Sciences, Tehran, Islamic Republic of Iran
- Student Research Committee, Faculty of Medicine, Shahid Beheshti University of Medical Sciences, Tehran, Islamic Republic of Iran
| | - Hamed Ghorani
- Advanced Diagnostic and Interventional Radiology Research Center (ADIR), Tehran University of Medical Sciences, Tehran, Islamic Republic of Iran
- Department of Radiology, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Parya Valizadeh
- Advanced Diagnostic and Interventional Radiology Research Center (ADIR), Tehran University of Medical Sciences, Tehran, Islamic Republic of Iran
- School of Medicine, Tehran University of Medical Sciences, Tehran, Islamic Republic of Iran
| | - Payam Jannatdoust
- Advanced Diagnostic and Interventional Radiology Research Center (ADIR), Tehran University of Medical Sciences, Tehran, Islamic Republic of Iran
- School of Medicine, Tehran University of Medical Sciences, Tehran, Islamic Republic of Iran
| | - Arian Tavasol
- Advanced Diagnostic and Interventional Radiology Research Center (ADIR), Tehran University of Medical Sciences, Tehran, Islamic Republic of Iran
- Student Research Committee, Faculty of Medicine, Shahid Beheshti University of Medical Sciences, Tehran, Islamic Republic of Iran
| | - Melika Zarei
- Advanced Diagnostic and Interventional Radiology Research Center (ADIR), Tehran University of Medical Sciences, Tehran, Islamic Republic of Iran
- Department of Radiology and Nuclear Medicine, Paramedical School, Kermanshah University of Medical Sciences, Kermanshah, Islamic Republic of Iran
| | - Arvin Arian
- Advanced Diagnostic and Interventional Radiology Research Center (ADIR), Tehran University of Medical Sciences, Tehran, Islamic Republic of Iran
- Cancer Research Institute, Imam Khomeini Hospital, Tehran University of Medical Sciences, Tehran, Islamic Republic of Iran
| |
Collapse
|
5
|
Zhu Y, Ma Y, Zhai Z, Liu A, Wang Y, Zhang Y, Li H, Zhao M, Han P, Yin L, He N, Wu Y, Sechopoulos I, Ye Z, Caballo M. Radiomics in cone-beam breast CT for the prediction of axillary lymph node metastasis in breast cancer: a multi-center multi-device study. Eur Radiol 2024; 34:2576-2589. [PMID: 37782338 DOI: 10.1007/s00330-023-10256-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2022] [Revised: 07/09/2023] [Accepted: 07/30/2023] [Indexed: 10/03/2023]
Abstract
OBJECTIVES To develop a radiomics model in contrast-enhanced cone-beam breast CT (CE-CBBCT) for preoperative prediction of axillary lymph node (ALN) status and metastatic burden of breast cancer. METHODS Two hundred and seventy-four patients who underwent CE-CBBCT examination with two scanners between 2012 and 2021 from two institutions were enrolled. The primary tumor was annotated in each patient image, from which 1781 radiomics features were extracted with PyRadiomics. After feature selection, support vector machine models were developed to predict ALN status and metastatic burden. To avoid overfitting on a specific patient subset, 100 randomly stratified splits were made to assign the patients to either training/fine-tuning or test set. Area under the receiver operating characteristic curve (AUC) of these radiomics models was compared to those obtained when training the models only with clinical features and combined clinical-radiomics descriptors. Ground truth was established by histopathology. RESULTS One hundred and eighteen patients had ALN metastasis (N + (≥ 1)). Of these, 74 had low burden (N + (1~2)) and 44 high burden (N + (≥ 3)). The remaining 156 patients had none (N0). AUC values across the 100 test repeats in predicting ALN status (N0/N + (≥ 1)) were 0.75 ± 0.05 (0.67~0.93, radiomics model), 0.68 ± 0.07 (0.53~0.85, clinical model), and 0.74 ± 0.05 (0.67~0.88, combined model). For metastatic burden prediction (N + (1~2)/N + (≥ 3)), AUC values were 0.65 ± 0.10 (0.50~0.88, radiomics model), 0.55 ± 0.10 (0.40~0.80, clinical model), and 0.64 ± 0.09 (0.50~0.90, combined model), with all the ranges spanning 0.5. In both cases, the radiomics model was significantly better than the clinical model (both p < 0.01) and comparable with the combined model (p = 0.56 and 0.64). CONCLUSIONS Radiomics features of primary tumors could have potential in predicting ALN metastasis in CE-CBBCT imaging. CLINICAL RELEVANCE STATEMENT The findings support potential clinical use of radiomics for predicting axillary lymph node metastasis in breast cancer patients and addressing the limited axilla coverage of cone-beam breast CT. KEY POINTS • Contrast-enhanced cone-beam breast CT-based radiomics could have potential to predict N0 vs. N + (≥ 1) and, to a limited extent, N + (1~2) vs. N + (≥ 3) from primary tumor, and this could help address the limited axilla coverage, pending future verifications on larger cohorts. • The average AUC of radiomics and combined models was significantly higher than that of clinical models but showed no significant difference between themselves. • Radiomics features descriptive of tumor texture were found informative on axillary lymph node status, highlighting a higher heterogeneity for tumor with positive axillary lymph node.
Collapse
Affiliation(s)
- Yueqiang Zhu
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
- Department of Medical Imaging, Radboud University Medical Center, PO Box 9101, Nijmegen, 6500 HB, The Netherlands
| | - Yue Ma
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
| | - Zhenzhen Zhai
- Department of Radiology, The Fifth Affiliated Hospital of Sun Yat-Sen University, Mei-Hua-Dong Road, Xiangzhou District, Zhuhai, 519000, China
| | - Aidi Liu
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
| | - Yafei Wang
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
| | - Yuwei Zhang
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
| | - Haijie Li
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
| | - Mengran Zhao
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
| | - Peng Han
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
| | - Lu Yin
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
| | - Ni He
- Department of Medical Imaging and Image-guided Therapy, Sun Yat-Sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Dong-Feng-Dong Road, Yuexiu District, Guangzhou, 510060, China
| | - Yaopan Wu
- Department of Medical Imaging and Image-guided Therapy, Sun Yat-Sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Dong-Feng-Dong Road, Yuexiu District, Guangzhou, 510060, China
| | - Ioannis Sechopoulos
- Department of Medical Imaging, Radboud University Medical Center, PO Box 9101, Nijmegen, 6500 HB, The Netherlands
- Dutch Expert Center for Screening (LRCB), PO Box 6873, Nijmegen, 6503 GJ, The Netherlands
- Technical Medicine Centre, University of Twente, PO Box 217, Enschede, 7500 AE, The Netherlands
| | - Zhaoxiang Ye
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China.
| | - Marco Caballo
- Department of Medical Imaging, Radboud University Medical Center, PO Box 9101, Nijmegen, 6500 HB, The Netherlands
| |
Collapse
|
6
|
Tabnak P, HajiEsmailPoor Z, Baradaran B, Pashazadeh F, Aghebati Maleki L. MRI-Based Radiomics Methods for Predicting Ki-67 Expression in Breast Cancer: A Systematic Review and Meta-analysis. Acad Radiol 2024; 31:763-787. [PMID: 37925343 DOI: 10.1016/j.acra.2023.10.010] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Revised: 10/01/2023] [Accepted: 10/04/2023] [Indexed: 11/06/2023]
Abstract
RATIONALE AND OBJECTIVES The purpose of this systematic review and meta-analysis was to assess the quality and diagnostic accuracy of MRI-based radiomics for predicting Ki-67 expression in breast cancer. MATERIALS AND METHODS A systematic literature search was performed to find relevant studies published in different databases, including PubMed, Web of Science, and Embase up until March 10, 2023. All papers were independently evaluated for eligibility by two reviewers. Studies that matched research questions and provided sufficient data for quantitative synthesis were included in the systematic review and meta-analysis, respectively. The quality of the articles was assessed using Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) and Radiomics Quality Score (RQS) tools. The predictive value of MRI-based radiomics for Ki-67 antigen in patients with breast cancer was assessed using pooled sensitivity (SEN), specificity, and area under the curve (AUC). Meta-regression was performed to explore the cause of heterogeneity. Different covariates were used for subgroup analysis. RESULTS 31 studies were included in the systematic review; among them, 21 reported sufficient data for meta-analysis. 20 training cohorts and five validation cohorts were pooled separately. The pooled sensitivity, specificity, and AUC of MRI-based radiomics for predicting Ki-67 expression in training cohorts were 0.80 [95% CI, 0.73-0.86], 0.82 [95% CI, 0.78-0.86], and 0.88 [95%CI, 0.85-0.91], respectively. The corresponding values for validation cohorts were 0.81 [95% CI, 0.72-0.87], 0.73 [95% CI, 0.62-0.82], and 0.84 [95%CI, 0.80-0.87], respectively. Based on QUADAS-2, some risks of bias were detected for reference standard and flow and timing domains. However, the quality of the included article was acceptable. The mean RQS score of the included articles was close to 6, corresponding to 16.6% of the maximum possible score. Significant heterogeneity was observed in pooled sensitivity and specificity of training cohorts (I2 > 75%). We found that using deep learning radiomic methods, magnetic field strength (3 T vs. 1.5 T), scanner manufacturer, region of interest structure (2D vs. 3D), route of tissue sampling, Ki-67 cut-off, logistic regression for model construction, and LASSO for feature reduction as well as PyRadiomics software for feature extraction had a great impact on heterogeneity according to our joint model analysis. Diagnostic performance in studies that used deep learning-based radiomics and multiple MRI sequences (e.g., DWI+DCE) was slightly higher. In addition, radiomic features derived from DWI sequences performed better than contrast-enhanced sequences in terms of specificity and sensitivity. No publication bias was found based on Deeks' funnel plot. Sensitivity analysis showed that eliminating every study one by one does not impact overall results. CONCLUSION This meta-analysis showed that MRI-based radiomics has a good diagnostic accuracy in differentiating breast cancer patients with high Ki-67 expression from low-expressing groups. However, the sensitivity and specificity of these methods still do not surpass 90%, restricting them from being used as a supplement to current pathological assessments (e.g., biopsy or surgery) to predict Ki-67 expression accurately.
Collapse
Affiliation(s)
- Peyman Tabnak
- Faculty of Medicine, Tabriz University of Medical Sciences, Tabriz, Iran (P.T., Z.H.); Immunology Research Center, Tabriz University of Medical Sciences, Tabriz, Iran (P.T., Z.H., B.B., L.A.M.); Department of Immunology, Faculty of Medicine, Tabriz University of Medical Sciences, Tabriz, Iran (P.T., Z.H., B.B., L.A.M.)
| | - Zanyar HajiEsmailPoor
- Faculty of Medicine, Tabriz University of Medical Sciences, Tabriz, Iran (P.T., Z.H.); Immunology Research Center, Tabriz University of Medical Sciences, Tabriz, Iran (P.T., Z.H., B.B., L.A.M.); Department of Immunology, Faculty of Medicine, Tabriz University of Medical Sciences, Tabriz, Iran (P.T., Z.H., B.B., L.A.M.)
| | - Behzad Baradaran
- Immunology Research Center, Tabriz University of Medical Sciences, Tabriz, Iran (P.T., Z.H., B.B., L.A.M.); Department of Immunology, Faculty of Medicine, Tabriz University of Medical Sciences, Tabriz, Iran (P.T., Z.H., B.B., L.A.M.)
| | - Fariba Pashazadeh
- Research Center for Evidence-Based Medicine, Iranian Evidence-Based Medicine (EBM) Centre: A Joanna Briggs Institute (JBI) Centre of Excellence, Faculty of Medicine, Tabriz University of Medical Sciences, Tabriz, Iran (F.P.)
| | - Leili Aghebati Maleki
- Immunology Research Center, Tabriz University of Medical Sciences, Tabriz, Iran (P.T., Z.H., B.B., L.A.M.); Department of Immunology, Faculty of Medicine, Tabriz University of Medical Sciences, Tabriz, Iran (P.T., Z.H., B.B., L.A.M.).
| |
Collapse
|
7
|
Marmé F, Krieghoff-Henning E, Gerber B, Schmitt M, Zahm DM, Bauerschlag D, Forstbauer H, Hildebrandt G, Ataseven B, Brodkorb T, Denkert C, Stachs A, Krug D, Heil J, Golatta M, Kühn T, Nekljudova V, Gaiser T, Schönmehl R, Brochhausen C, Loibl S, Reimer T, Brinker TJ. Deep learning to predict breast cancer sentinel lymph node status on INSEMA histological images. Eur J Cancer 2023; 195:113390. [PMID: 37890350 DOI: 10.1016/j.ejca.2023.113390] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Revised: 10/07/2023] [Accepted: 10/11/2023] [Indexed: 10/29/2023]
Abstract
BACKGROUND Sentinel lymph node (SLN) status is a clinically important prognostic biomarker in breast cancer and is used to guide therapy, especially for hormone receptor-positive, HER2-negative cases. However, invasive lymph node staging is increasingly omitted before therapy, and studies such as the randomised Intergroup Sentinel Mamma (INSEMA) trial address the potential for further de-escalation of axillary surgery. Therefore, it would be helpful to accurately predict the pretherapeutic sentinel status using medical images. METHODS Using a ResNet 50 architecture pretrained on ImageNet and a previously successful strategy, we trained deep learning (DL)-based image analysis algorithms to predict sentinel status on hematoxylin/eosin-stained images of predominantly luminal, primary breast tumours from the INSEMA trial and three additional, independent cohorts (The Cancer Genome Atlas (TCGA) and cohorts from the University hospitals of Mannheim and Regensburg), and compared their performance with that of a logistic regression using clinical data only. Performance on an INSEMA hold-out set was investigated in a blinded manner. RESULTS None of the generated image analysis algorithms yielded significantly better than random areas under the receiver operating characteristic curves on the test sets, including the hold-out test set from INSEMA. In contrast, the logistic regression fitted on the Mannheim cohort retained a better than random performance on INSEMA and Regensburg. Including the image analysis model output in the logistic regression did not improve performance further on INSEMA. CONCLUSIONS Employing DL-based image analysis on histological slides, we could not predict SLN status for unseen cases in the INSEMA trial and other predominantly luminal cohorts.
Collapse
Affiliation(s)
- Frederik Marmé
- Department of Obstetrics and Gynaecology, Medical Faculty Mannheim of the University of Heidelberg, Heidelberg, Germany
| | - Eva Krieghoff-Henning
- Digital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Bernd Gerber
- Department of Obstetrics and Gynecology, University Hospital of Rostock, Rostock, Germany
| | - Max Schmitt
- Digital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | | | - Dirk Bauerschlag
- Department of Gynecology and Obstetrics, University Medical Center Schleswig-Holstein (UKSH), Campus Kiel, Kiel, Germany
| | | | - Guido Hildebrandt
- Department of Radiotherapy, University Medicine Rostock, Rostock, Germany
| | - Beyhan Ataseven
- Department of Gynecology, Gynecologic Oncology and Obstetrics, Klinikum Lippe, Bielefeld University, Medical School and University Medical Center East Westphalia-Lippe, Bielefeld, Germany
| | - Tobias Brodkorb
- Department of Obstetrics and Gynaecology, Medical Faculty Mannheim of the University of Heidelberg, Heidelberg, Germany
| | - Carsten Denkert
- Institute of Pathology, University Clinic Marburg, Marburg, Germany
| | - Angrit Stachs
- Department of Obstetrics and Gynecology, University Hospital of Rostock, Rostock, Germany
| | - David Krug
- Klinik für Strahlentherapie, Universitätsklinikum Schleswig-Holstein, Kiel, Germany
| | - Jörg Heil
- Brustzentrum Heidelberg - Klinik St. Elisabeth, Heidelberg, Germany; Department of Obstetrics and Gynecology, Uniklinikum Heidelberg, Heidelberg, Germany
| | - Michael Golatta
- Brustzentrum Heidelberg - Klinik St. Elisabeth, Heidelberg, Germany; Department of Obstetrics and Gynecology, Uniklinikum Heidelberg, Heidelberg, Germany
| | - Thorsten Kühn
- Department of Gynaecology and Obstetrics, Klinikum Esslingen, Neckar, Germany
| | | | - Timo Gaiser
- Institute of Pathology, Medical Faculty Mannheim of the University of Heidelberg, Heidelberg, Germany
| | - Rebecca Schönmehl
- Institute of Pathology, Medical Faculty Mannheim of the University of Heidelberg, Heidelberg, Germany
| | - Christoph Brochhausen
- Institute of Pathology, Medical Faculty Mannheim of the University of Heidelberg, Heidelberg, Germany; Institute of Pathology, University Regensburg, Regensburg, Germany
| | - Sibylle Loibl
- German Breast Group, GBG Forschungs GmbH, Neu-Isenburg, Germany
| | - Toralf Reimer
- Department of Obstetrics and Gynecology, University Hospital of Rostock, Rostock, Germany
| | - Titus J Brinker
- Digital Biomarkers for Oncology Group, German Cancer Research Center (DKFZ), Heidelberg, Germany.
| |
Collapse
|
8
|
Zhu Y, Ma Y, Zhang Y, Liu A, Wang Y, Zhao M, Li H, He N, Wu Y, Ye Z. Radiomics nomogram for predicting axillary lymph node metastasis-a potential method to address the limitation of axilla coverage in cone-beam breast CT: a bi-center retrospective study. LA RADIOLOGIA MEDICA 2023; 128:1472-1482. [PMID: 37857980 DOI: 10.1007/s11547-023-01731-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/28/2023] [Accepted: 09/21/2023] [Indexed: 10/21/2023]
Abstract
PURPOSE Cone-beam breast CT (CBBCT) has an inherent limitation that the axilla cannot be imaged in its entirety. We aimed to develop and validate a nomogram based on clinical factors and contrast-enhanced (CE) CBBCT radiomics features to predict axillary lymph node (ALN) metastasis and complement limited axilla coverage. MATERIAL AND METHODS This retrospective study included 312 patients with breast cancer from two hospitals who underwent CE-CBBCT examination in a clinical trial (NCT01792999) during 2012-2020. Patients from TCIH comprised training set (n = 176) and validation set (n = 43), and patients from SYSUCC comprised external test set (n = 93). 3D ROIs were delineated manually and radiomics features were extracted by 3D Slicer software. RadScore was calculated and radiomics model was constructed after feature selection. Clinical model was built on independent predictors. Nomogram was developed with independent clinical predictors and RadScore. Diagnostic performance was compared among three models by ROC curve, and decision curve analysis (DCA) was used to evaluate the clinical utility of nomogram. RESULTS A total of 139 patients were ALN positive and 173 patients were negative. Twelve radiomics features remained after feature selection. Location and focality were selected as independent predictors for ALN status. The AUC of nomogram in external test set was higher than that of clinical model (0.80 vs. 0.66, p = 0.012). DCA demonstrated that the nomogram had higher overall net benefit than that of clinical model. CONCLUSION The nomogram combined CE-CBBCT-based radiomics features and clinical factors could have potential in distinguishing ALN positive from negative and addressing the limitation of axilla coverage in CBBCT.
Collapse
Affiliation(s)
- Yueqiang Zhu
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
- Department of Medical Imaging, Radboud University Medical Center, PO Box 9101, Nijmegen, 6500 HB, The Netherlands
| | - Yue Ma
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
| | - Yuwei Zhang
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
| | - Aidi Liu
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
| | - Yafei Wang
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
| | - Mengran Zhao
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
| | - Haijie Li
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
| | - Ni He
- Department of Medical Imaging and Image-guided Therapy, Sun Yat-Sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Dong-Feng-Dong Road, Yuexiu District, Guangzhou, 510060, China
| | - Yaopan Wu
- Department of Medical Imaging and Image-guided Therapy, Sun Yat-Sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Dong-Feng-Dong Road, Yuexiu District, Guangzhou, 510060, China
| | - Zhaoxiang Ye
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China.
| |
Collapse
|
9
|
Xu M, Yang H, Yang Q, Teng P, Hao H, Liu C, Yu S, Liu G. Radiomics nomogram based on digital breast tomosynthesis: preoperative evaluation of axillary lymph node metastasis in breast carcinoma. J Cancer Res Clin Oncol 2023:10.1007/s00432-023-04859-z. [PMID: 37208454 DOI: 10.1007/s00432-023-04859-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2023] [Accepted: 05/13/2023] [Indexed: 05/21/2023]
Abstract
PURPOSE This study aimed to establish a radiomics nomogram model based on digital breast tomosynthesis (DBT) images, to predict the status of axillary lymph nodes (ALN) in patients with breast carcinoma. METHODS The data of 120 patients with confirmed breast carcinoma, including 49 cases with axillary lymph node metastasis (ALNM), were retrospectively analyzed in this study. The dataset was randomly divided into a training group consisting of 84 patients (37 with ALNM) and a validation group comprising 36 patients (12 with ALNM). Clinical information was collected for all cases, and radiomics features were extracted from DBT images. Feature selection was performed to develop the Radscore model. Univariate and multivariate logistic regression analysis were employed to identify independent risk factors for constructing both the clinical model and nomogram model. To evaluate the performance of these models, receiver operating characteristic (ROC) curve analysis, calibration curve, decision curve analysis (DCA), net reclassification improvement (NRI), and integrated discriminatory improvement (IDI) were conducted. RESULTS The clinical model identified tumor margin and DBT_reported_LNM as independent risk factors, while the Radscore model was constructed using 9 selected radiomics features. Incorporating tumor margin, DBT_reported_LNM, and Radscore, the radiomics nomogram model exhibited superior performance with AUC values of 0.933 and 0.920 in both datasets, respectively. The NRI and IDI showed a significant improvement, suggesting that the Radscore may serve as a useful biomarker for predicting ALN status. CONCLUSION The radiomics nomogram based on DBT demonstrated effective preoperative prediction performance for ALNM in patients with breast cancer.
Collapse
Affiliation(s)
- Maolin Xu
- Department of Radiology, China-Japan Union Hospital of Jilin University, Xiantai Street, Changchun, 130033, China
| | - Huimin Yang
- Department of Radiology, China-Japan Union Hospital of Jilin University, Xiantai Street, Changchun, 130033, China
| | - Qi Yang
- Department of Radiology, The First Hospital of Jilin University, No.71 Xinmin Street, Changchun, 130012, China.
| | - Peihong Teng
- Department of Radiology, China-Japan Union Hospital of Jilin University, Xiantai Street, Changchun, 130033, China
| | - Haifeng Hao
- Department of Radiology, China-Japan Union Hospital of Jilin University, Xiantai Street, Changchun, 130033, China
| | - Chang Liu
- Department of Radiology, China-Japan Union Hospital of Jilin University, Xiantai Street, Changchun, 130033, China
| | - Shaonan Yu
- Department of Radiology, China-Japan Union Hospital of Jilin University, Xiantai Street, Changchun, 130033, China.
| | - Guifeng Liu
- Department of Radiology, China-Japan Union Hospital of Jilin University, Xiantai Street, Changchun, 130033, China.
| |
Collapse
|