Axillary lymph node metastasis prediction by contrast-enhanced computed tomography images for breast cancer patients based on deep learning

Preoperative prediction of nodal status using clinical data and artificial intelligence derived mammogram features enabling abstention of sentinel lymph node biopsy in breast cancer

Introduction

Patients with clinically node-negative breast cancer have a negative sentinel lymph node status (pN0) in approximately 75% of cases and the necessity of routine surgical nodal staging by sentinel lymph node biopsy (SLNB) has been questioned. Previous prediction models for pN0 have included postoperative variables, thus defeating their purpose to spare patients non-beneficial axillary surgery. We aimed to develop a preoperative prediction model for pN0 and to evaluate the contribution of mammographic breast density and mammogram features derived by artificial intelligence for de-escalation of SLNB.

Materials and methods

This retrospective cohort study included 755 women with primary breast cancer. Mammograms were analyzed by commercially available artificial intelligence and automated systems. The additional predictive value of features was evaluated using logistic regression models including preoperative clinical variables and radiological tumor size. The final model was internally validated using bootstrap and externally validated in a separate cohort. A nomogram for prediction of pN0 was developed. The correlation between pathological tumor size and the preoperative radiological tumor size was calculated.

Results

Radiological tumor size was the strongest predictor of pN0 and included in a preoperative prediction model displaying an area under the curve of 0.68 (95% confidence interval: 0.63-0.72) in internal validation and 0.64 (95% confidence interval: 0.59-0.69) in external validation. Although the addition of mammographic features did not improve discrimination, the prediction model provided a 21% SLNB reduction rate when a false negative rate of 10% was accepted, reflecting the accepted false negative rate of SLNB.

Conclusion

This study shows that the preoperatively available radiological tumor size might replace pathological tumor size as a key predictor in a preoperative prediction model for pN0. While the overall performance was not improved by mammographic features, one in five patients could be omitted from axillary surgery by applying the preoperative prediction model for nodal status. The nomogram visualizing the model could support preoperative patient-centered decision-making on the management of the axilla.

Deep Learning Prediction of Axillary Lymph Node Metastasis in Breast Cancer Patients Using Clinical Implication-Applied Preprocessed CT Images

Background: Accurate detection of axillary lymph node (ALN) metastases in breast cancer is crucial for clinical staging and treatment planning. This study aims to develop a deep learning model using clinical implication-applied preprocessed computed tomography (CT) images to enhance the prediction of ALN metastasis in breast cancer patients. Methods: A total of 1128 axial CT images of ALN (538 malignant and 590 benign lymph nodes) were collected from 523 breast cancer patients who underwent preoperative CT scans between January 2012 and July 2022 at Hallym University Medical Center. To develop an optimal deep learning model for distinguishing metastatic ALN from benign ALN, a CT image preprocessing protocol with clinical implications and two different cropping methods (fixed size crop [FSC] method and adjustable square crop [ASC] method) were employed. The images were analyzed using three different convolutional neural network (CNN) architectures (ResNet, DenseNet, and EfficientNet). Ensemble methods involving and combining the selection of the two best-performing CNN architectures from each cropping method were applied to generate the final result. Results: For the two different cropping methods, DenseNet consistently outperformed ResNet and EfficientNet. The area under the receiver operating characteristic curve (AUROC) for DenseNet, using the FSC and ASC methods, was 0.934 and 0.939, respectively. The ensemble model, which combines the performance of the DenseNet121 architecture for both cropping methods, delivered outstanding results with an AUROC of 0.968, an accuracy of 0.938, a sensitivity of 0.980, and a specificity of 0.903. Furthermore, distinct trends observed in gradient-weighted class activation mapping images with the two cropping methods suggest that our deep learning model not only evaluates the lymph node itself, but also distinguishes subtler changes in lymph node margin and adjacent soft tissue, which often elude human interpretation. Conclusions: This research demonstrates the promising performance of a deep learning model in accurately detecting malignant ALNs in breast cancer patients using CT images. The integration of clinical considerations into image processing and the utilization of ensemble methods further improved diagnostic precision.

Deep Learning Radiomics Nomogram Based on Multiphase Computed Tomography for Predicting Axillary Lymph Node Metastasis in Breast Cancer

PURPOSE

This study aims to develop and validate a deep learning radiomics nomogram (DLRN) for prediction of axillary lymph node metastasis (ALNM) in breast cancer patients.

MATERIALS AND METHODS

We retrospectively enrolled 196 patients with non-specific invasive breast cancer confirmed by pathology, radiomics and deep learning features were extracted from unenhanced and biphasic (arterial and venous phase) contrast-enhanced CT, and the non-linear support vector machine was used to construct the radiomics signature and the deep learning signature, respectively. Next, a DLRN was developed with independent predictors and evaluated the performance of models in terms of discrimination and clinical utility.

RESULTS

Multivariate logistic regression analysis showed that the radiomics signature, deep learning signature, and clinical n stage were independent predictors. The DLRN accurately predicted ALNM and yielded an area under the receiver operator characteristic curve of 0.893 (95% confidence interval, 0.814-0.972) in the validation set, with good calibration. Decision curve analysis confirmed that the DLRN had higher clinical utility than other predictors.

CONCLUSIONS

The DLRN had good predictive value for ALNM in breast cancer patients and provide valuable information for individual treatment.

State-of-the-Art of Breast Cancer Diagnosis in Medical Images via Convolutional Neural Networks (CNNs)

Early detection of breast cancer is crucial for a better prognosis. Various studies have been conducted where tumor lesions are detected and localized on images. This is a narrative review where the studies reviewed are related to five different image modalities: histopathological, mammogram, magnetic resonance imaging (MRI), ultrasound, and computed tomography (CT) images, making it different from other review studies where fewer image modalities are reviewed. The goal is to have the necessary information, such as pre-processing techniques and CNN-based diagnosis techniques for the five modalities, readily available in one place for future studies. Each modality has pros and cons, such as mammograms might give a high false positive rate for radiographically dense breasts, while ultrasounds with low soft tissue contrast result in early-stage false detection, and MRI provides a three-dimensional volumetric image, but it is expensive and cannot be used as a routine test. Various studies were manually reviewed using particular inclusion and exclusion criteria; as a result, 91 recent studies that classify and detect tumor lesions on breast cancer images from 2017 to 2022 related to the five image modalities were included. For histopathological images, the maximum accuracy achieved was around 99 % , and the maximum sensitivity achieved was 97.29 % by using DenseNet, ResNet34, and ResNet50 architecture. For mammogram images, the maximum accuracy achieved was 96.52 % using a customized CNN architecture. For MRI, the maximum accuracy achieved was 98.33 % using customized CNN architecture. For ultrasound, the maximum accuracy achieved was around 99 % by using DarkNet-53, ResNet-50, G-CNN, and VGG. For CT, the maximum sensitivity achieved was 96 % by using Xception architecture. Histopathological and ultrasound images achieved higher accuracy of around 99 % by using ResNet34, ResNet50, DarkNet-53, G-CNN, and VGG compared to other modalities for either of the following reasons: use of pre-trained architectures with pre-processing techniques, use of modified architectures with pre-processing techniques, use of two-stage CNN, and higher number of studies available for Artificial Intelligence (AI)/machine learning (ML) researchers to reference. One of the gaps we found is that only a single image modality is used for CNN-based diagnosis; in the future, a multiple image modality approach can be used to design a CNN architecture with higher accuracy.

Application of CT and MRI images based on an artificial intelligence algorithm for predicting lymph node metastasis in breast cancer patients: a meta-analysis

BACKGROUND

This study aimed to comprehensively evaluate the accuracy and effect of computed tomography (CT) and magnetic resonance imaging (MRI) based on artificial intelligence (AI) algorithms for predicting lymph node metastasis in breast cancer patients.

METHODS

We systematically searched the PubMed, Embase and Cochrane Library databases for literature from inception to June 2023 using keywords that included 'artificial intelligence', 'CT,' 'MRI', 'breast cancer' and 'lymph nodes'. Studies that met the inclusion criteria were screened and their data were extracted for analysis. The main outcome measures included sensitivity, specificity, positive likelihood ratio, negative likelihood ratio and area under the curve (AUC).

RESULTS

A total of 16 studies were included in the final meta-analysis, covering 4,764 breast cancer patients. Among them, 11 studies used the manual algorithm MRI to calculate breast cancer risk, which had a sensitivity of 0.85 (95% confidence interval [CI] 0.79-0.90; p < 0.001; I2 = 75.3%), specificity of 0.81 (95% CI 0.66-0.83; p < 0.001; I2 = 0%), a positive likelihood ratio of 4.6 (95% CI 4.0-4.8), a negative likelihood ratio of 0.18 (95% CI 0.13-0.26) and a diagnostic odds ratio of 25 (95% CI 17-38). Five studies used manual algorithm CT to calculate breast cancer risk, which had a sensitivity of 0.88 (95% CI 0.79-0.94; p < 0.001; I2 = 87.0%), specificity of 0.80 (95% CI 0.69-0.88; p < 0.001; I2 = 91.8%), a positive likelihood ratio of 4.4 (95% CI 2.7-7.0), a negative likelihood ratio of 0.15 (95% CI 0.08-0.27) and a diagnostic odds ratio of 30 (95% CI 12-72). For MRI and CT, the AUC after study pooling was 0.85 (95% CI 0.82-0.88) and 0.91 (95% CI 0.88-0.93), respectively.

CONCLUSION

Computed tomography and MRI images based on an AI algorithm have good diagnostic accuracy in predicting lymph node metastasis in breast cancer patients and have the potential for clinical application.

The Role of AI in Breast Cancer Lymph Node Classification: A Comprehensive Review

Breast cancer is a significant health issue affecting women worldwide, and accurately detecting lymph node metastasis is critical in determining treatment and prognosis. While traditional diagnostic methods have limitations and complications, artificial intelligence (AI) techniques such as machine learning (ML) and deep learning (DL) offer promising solutions for improving and supplementing diagnostic procedures. Current research has explored state-of-the-art DL models for breast cancer lymph node classification from radiological images, achieving high performances (AUC: 0.71-0.99). AI models trained on clinicopathological features also show promise in predicting metastasis status (AUC: 0.74-0.77), whereas multimodal (radiomics + clinicopathological features) models combine the best from both approaches and also achieve good results (AUC: 0.82-0.94). Once properly validated, such models could greatly improve cancer care, especially in areas with limited medical resources. This comprehensive review aims to compile knowledge about state-of-the-art AI models used for breast cancer lymph node metastasis detection, discusses proper validation techniques and potential pitfalls and limitations, and presents future directions and best practices to achieve high usability in real-world clinical settings.

Machine Learning in Metastatic Cancer Research: Potentials, Possibilities, and Prospects

Cancer has received extensive recognition for its high mortality rate, with metastatic cancer being the top cause of cancer-related deaths. Metastatic cancer involves the spread of the primary tumor to other body organs. As much as the early detection of cancer is essential, the timely detection of metastasis, the identification of biomarkers, and treatment choice are valuable for improving the quality of life for metastatic cancer patients. This study reviews the existing studies on classical machine learning (ML) and deep learning (DL) in metastatic cancer research. Since the majority of metastatic cancer research data are collected in the formats of PET/CT and MRI image data, deep learning techniques are heavily involved. However, its black-box nature and expensive computational cost are notable concerns. Furthermore, existing models could be overestimated for their generality due to the non-diverse population in clinical trial datasets. Therefore, research gaps are itemized; follow-up studies should be carried out on metastatic cancer using machine learning and deep learning tools with data in a symmetric manner.

Application of artificial intelligence in predicting lymph node metastasis in breast cancer

Breast cancer is a leading cause of death for women globally. A characteristic of breast cancer includes its ability to metastasize to distant regions of the body, and the disease achieves this through first spreading to the axillary lymph nodes. Traditional diagnosis of axillary lymph node metastasis includes an invasive technique that leads to potential clinical complications for breast cancer patients. The rise of artificial intelligence in the medical imaging field has led to the creation of innovative deep learning models that can predict the metastatic status of axillary lymph nodes noninvasively, which would result in no unnecessary biopsies and dissections for patients. In this review, we discuss the success of various deep learning artificial intelligence models across multiple imaging modalities in their performance of predicting axillary lymph node metastasis.

Efficient Axillary Lymph Node Detection Via Two-stage Spatial-information-fusion-based CNN

BACKGROUND AND OBJECTIVE

Preoperative imaging diagnosis of axillary lymph node (ALN) metastasis is particularly important for breast cancer patients. This paper focuses on developing non-invasive and automatic schemes for accurate localization and classification (metastasis prediction) of ALN via contrast-enhanced computed tomography (CECT) image and deep learning models.

METHODS

Based on a two-stage strategy, a novel detection neural network is proposed, where the convolutional block attention module is utilized to extract spacial information and the bottleneck feature fusion module is designed for feature fusion in different scales.

RESULTS

Owing to the two embedded modules, the proposed convolutional neural network (CNN) model outperforms Faster R-CNN, YOLOv3, and EfficientDet in the sense that the achieved mAP is 0.454, higher than 0.247, 0.335, and 0.329, respectively. In particular, considering the function of classification only, the proposed model reaches the best performance on most indices (accuracy of 0.968, positive predictive value of 0.972, negative predictive value of 0.966, specificity of 0.983), compared with the methods that have been frequently adopted to predict ALN. In addition, the proposed CNN model has the function of locating ALN, which is lacking in existing models.

CONCLUSIONS

In this paper, a supervised deep learning method is proposed to detect ALN in CECT images. The positive effect of new added modules are verified, and the benefits of spatial information in ALN detection are confirmed. Further, the two subtasks called localization and classification are evaluated separately, where the proposed model achieves the best performance on most indices. The source code mentioned in this article will be released later.

Artificial Intelligence and COVID-19 Using Chest CT Scan and Chest X-ray Images: Machine Learning and Deep Learning Approaches for Diagnosis and Treatment

OBJECTIVE

To report an overview and update on Artificial Intelligence (AI) and COVID-19 using chest Computed Tomography (CT) scan and chest X-ray images (CXR). Machine Learning and Deep Learning Approaches for Diagnosis and Treatment were identified.

METHODS

Several electronic datasets were analyzed. The search covered the years from January 2019 to June 2021. The inclusion criteria were studied evaluating the use of AI methods in COVID-19 disease reporting performance results in terms of accuracy or precision or area under Receiver Operating Characteristic (ROC) curve (AUC).

RESULTS

Twenty-two studies met the inclusion criteria: 13 papers were based on AI in CXR and 10 based on AI in CT. The summarized mean value of the accuracy and precision of CXR in COVID-19 disease were 93.7% ± 10.0% of standard deviation (range 68.4-99.9%) and 95.7% ± 7.1% of standard deviation (range 83.0-100.0%), respectively. The summarized mean value of the accuracy and specificity of CT in COVID-19 disease were 89.1% ± 7.3% of standard deviation (range 78.0-99.9%) and 94.5 ± 6.4% of standard deviation (range 86.0-100.0%), respectively. No statistically significant difference in summarized accuracy mean value between CXR and CT was observed using the Chi square test (p value > 0.05).

CONCLUSIONS

Summarized accuracy of the selected papers is high but there was an important variability; however, less in CT studies compared to CXR studies. Nonetheless, AI approaches could be used in the identification of disease clusters, monitoring of cases, prediction of the future outbreaks, mortality risk, COVID-19 diagnosis, and disease management.