Computer-aided diagnosis of masses in breast computed tomography imaging: deep learning model with combined handcrafted and convolutional radiomic features

Machine learning and new insights for breast cancer diagnosis

Breast cancer (BC) is the most prominent form of cancer among females all over the world. The current methods of BC detection include X-ray mammography, ultrasound, computed tomography, magnetic resonance imaging, positron emission tomography and breast thermographic techniques. More recently, machine learning (ML) tools have been increasingly employed in diagnostic medicine for its high efficiency in detection and intervention. The subsequent imaging features and mathematical analyses can then be used to generate ML models, which stratify, differentiate and detect benign and malignant breast lesions. Given its marked advantages, radiomics is a frequently used tool in recent research and clinics. Artificial neural networks and deep learning (DL) are novel forms of ML that evaluate data using computer simulation of the human brain. DL directly processes unstructured information, such as images, sounds and language, and performs precise clinical image stratification, medical record analyses and tumour diagnosis. Herein, this review thoroughly summarizes prior investigations on the application of medical images for the detection and intervention of BC using radiomics, namely DL and ML. The aim was to provide guidance to scientists regarding the use of artificial intelligence and ML in research and the clinic.

Radiomics in cone-beam breast CT for the prediction of axillary lymph node metastasis in breast cancer: a multi-center multi-device study

OBJECTIVES

To develop a radiomics model in contrast-enhanced cone-beam breast CT (CE-CBBCT) for preoperative prediction of axillary lymph node (ALN) status and metastatic burden of breast cancer.

METHODS

Two hundred and seventy-four patients who underwent CE-CBBCT examination with two scanners between 2012 and 2021 from two institutions were enrolled. The primary tumor was annotated in each patient image, from which 1781 radiomics features were extracted with PyRadiomics. After feature selection, support vector machine models were developed to predict ALN status and metastatic burden. To avoid overfitting on a specific patient subset, 100 randomly stratified splits were made to assign the patients to either training/fine-tuning or test set. Area under the receiver operating characteristic curve (AUC) of these radiomics models was compared to those obtained when training the models only with clinical features and combined clinical-radiomics descriptors. Ground truth was established by histopathology.

RESULTS

One hundred and eighteen patients had ALN metastasis (N + (≥ 1)). Of these, 74 had low burden (N + (1~2)) and 44 high burden (N + (≥ 3)). The remaining 156 patients had none (N0). AUC values across the 100 test repeats in predicting ALN status (N0/N + (≥ 1)) were 0.75 ± 0.05 (0.67~0.93, radiomics model), 0.68 ± 0.07 (0.53~0.85, clinical model), and 0.74 ± 0.05 (0.67~0.88, combined model). For metastatic burden prediction (N + (1~2)/N + (≥ 3)), AUC values were 0.65 ± 0.10 (0.50~0.88, radiomics model), 0.55 ± 0.10 (0.40~0.80, clinical model), and 0.64 ± 0.09 (0.50~0.90, combined model), with all the ranges spanning 0.5. In both cases, the radiomics model was significantly better than the clinical model (both p < 0.01) and comparable with the combined model (p = 0.56 and 0.64).

CONCLUSIONS

Radiomics features of primary tumors could have potential in predicting ALN metastasis in CE-CBBCT imaging.

CLINICAL RELEVANCE STATEMENT

The findings support potential clinical use of radiomics for predicting axillary lymph node metastasis in breast cancer patients and addressing the limited axilla coverage of cone-beam breast CT.

KEY POINTS

• Contrast-enhanced cone-beam breast CT-based radiomics could have potential to predict N0 vs. N + (≥ 1) and, to a limited extent, N + (1~2) vs. N + (≥ 3) from primary tumor, and this could help address the limited axilla coverage, pending future verifications on larger cohorts. • The average AUC of radiomics and combined models was significantly higher than that of clinical models but showed no significant difference between themselves. • Radiomics features descriptive of tumor texture were found informative on axillary lymph node status, highlighting a higher heterogeneity for tumor with positive axillary lymph node.

Radiomics nomogram for predicting axillary lymph node metastasis-a potential method to address the limitation of axilla coverage in cone-beam breast CT: a bi-center retrospective study

PURPOSE

Cone-beam breast CT (CBBCT) has an inherent limitation that the axilla cannot be imaged in its entirety. We aimed to develop and validate a nomogram based on clinical factors and contrast-enhanced (CE) CBBCT radiomics features to predict axillary lymph node (ALN) metastasis and complement limited axilla coverage.

MATERIAL AND METHODS

This retrospective study included 312 patients with breast cancer from two hospitals who underwent CE-CBBCT examination in a clinical trial (NCT01792999) during 2012-2020. Patients from TCIH comprised training set (n = 176) and validation set (n = 43), and patients from SYSUCC comprised external test set (n = 93). 3D ROIs were delineated manually and radiomics features were extracted by 3D Slicer software. RadScore was calculated and radiomics model was constructed after feature selection. Clinical model was built on independent predictors. Nomogram was developed with independent clinical predictors and RadScore. Diagnostic performance was compared among three models by ROC curve, and decision curve analysis (DCA) was used to evaluate the clinical utility of nomogram.

RESULTS

A total of 139 patients were ALN positive and 173 patients were negative. Twelve radiomics features remained after feature selection. Location and focality were selected as independent predictors for ALN status. The AUC of nomogram in external test set was higher than that of clinical model (0.80 vs. 0.66, p = 0.012). DCA demonstrated that the nomogram had higher overall net benefit than that of clinical model.

CONCLUSION

The nomogram combined CE-CBBCT-based radiomics features and clinical factors could have potential in distinguishing ALN positive from negative and addressing the limitation of axilla coverage in CBBCT.

Spatially localized sparse approximations of deep features for breast mass characterization

We propose a deep feature-based sparse approximation classification technique for classification of breast masses into benign and malignant categories in film screen mammographs. This is a significant application as breast cancer is a leading cause of death in the modern world and improvements in diagnosis may help to decrease rates of mortality for large populations. While deep learning techniques have produced remarkable results in the field of computer-aided diagnosis of breast cancer, there are several aspects of this field that remain under-studied. In this work, we investigate the applicability of deep-feature-generated dictionaries to sparse approximation-based classification. To this end we construct dictionaries from deep features and compute sparse approximations of Regions Of Interest (ROIs) of breast masses for classification. Furthermore, we propose block and patch decomposition methods to construct overcomplete dictionaries suitable for sparse coding. The effectiveness of our deep feature spatially localized ensemble sparse analysis (DF-SLESA) technique is evaluated on a merged dataset of mass ROIs from the CBIS-DDSM and MIAS datasets. Experimental results indicate that dictionaries of deep features yield more discriminative sparse approximations of mass characteristics than dictionaries of imaging patterns and dictionaries learned by unsupervised machine learning techniques such as K-SVD. Of note is that the proposed block and patch decomposition strategies may help to simplify the sparse coding problem and to find tractable solutions. The proposed technique achieves competitive performances with state-of-the-art techniques for benign/malignant breast mass classification, using 10-fold cross-validation in merged datasets of film screen mammograms.

Deep learning for x-ray scatter correction in dedicated breast CT

BACKGROUND

Accurate correction of x-ray scatter in dedicated breast computed tomography (bCT) imaging may result in improved visual interpretation and is crucial to achieve quantitative accuracy during image reconstruction and analysis.

PURPOSE

To develop a deep learning (DL) model to correct for x-ray scatter in bCT projection images.

METHODS

A total of 115 patient scans acquired with a bCT clinical system were segmented into the major breast tissue types (skin, adipose, and fibroglandular tissue). The resulting breast phantoms were divided into training (n = 110) and internal validation cohort (n = 5). Training phantoms were augmented by a factor of four by random translation of the breast in the image field of view. Using a previously validated Monte Carlo (MC) simulation algorithm, 12 primary and scatter bCT projection images with a 30-degree step were generated from each phantom. For each projection, the thickness map and breast location in the field of view were also calculated. A U-Net based DL model was developed to estimate the scatter signal based on the total input simulated image and trained single-projection-wise, with the thickness map and breast location provided as additional inputs. The model was internally validated using MC-simulated projections and tested using an external data set of 10 phantoms derived from images acquired with a different bCT system. For this purpose, the mean relative difference (MRD) and mean absolute error (MAE) were calculated. To test for accuracy in reconstructed images, a full bCT acquisition was mimicked with MC-simulations and then assessed by calculating the MAE and the structural similarity (SSIM). Subsequently, scatter was estimated and subtracted from the bCT scans of three patients to obtain the scatter-corrected image. The scatter-corrected projections were reconstructed and compared with the uncorrected reconstructions by evaluating the correction of the cupping artifact, increase in image contrast, and contrast-to-noise ratio (CNR).

RESULTS

The mean MRD and MAE across all cases (min, max) for the internal validation set were 0.04% (-1.1%, 1.3%) and 2.94% (2.7%, 3.2%), while for the external test set they were -0.64% (-1.6%, 0.2%) and 2.84% (2.3%, 3.5%), respectively. For MC-simulated reconstruction slices, the computed SSIM was 0.99 and the MAE was 0.11% (range: 0%, 0.35%) with a single outlier slice of 2.06%. For the three patient bCT reconstructed images, the correction increased the contrast by a mean of 25% (range: 20%, 30%), and reduced the cupping artifact. The mean CNR increased by 0.32 after scatter correction, which was not found to be significant (95% confidence interval: [-0.01, 0.65], p = 0.059). The time required to correct the scatter in a single bCT projection was 0.2 s on an NVIDIA GeForce GTX 1080 GPU.

CONCLUSION

The developed DL model could accurately estimate scatter in bCT projection images and could enhance contrast and correct for cupping artifact in reconstructed patient images without significantly affecting the CNR. The time required for correction would allow its use in daily clinical practice, and the reported accuracy will potentially allow quantitative reconstructions.

Applying artificial intelligence technology to assist with breast cancer diagnosis and prognosis prediction

Breast cancer remains the most diagnosed cancer in women. Advances in medical imaging modalities and technologies have greatly aided in the early detection of breast cancer and the decline of patient mortality rates. However, reading and interpreting breast images remains difficult due to the high heterogeneity of breast tumors and fibro-glandular tissue, which results in lower cancer detection sensitivity and specificity and large inter-reader variability. In order to help overcome these clinical challenges, researchers have made great efforts to develop computer-aided detection and/or diagnosis (CAD) schemes of breast images to provide radiologists with decision-making support tools. Recent rapid advances in high throughput data analysis methods and artificial intelligence (AI) technologies, particularly radiomics and deep learning techniques, have led to an exponential increase in the development of new AI-based models of breast images that cover a broad range of application topics. In this review paper, we focus on reviewing recent advances in better understanding the association between radiomics features and tumor microenvironment and the progress in developing new AI-based quantitative image feature analysis models in three realms of breast cancer: predicting breast cancer risk, the likelihood of tumor malignancy, and tumor response to treatment. The outlook and three major challenges of applying new AI-based models of breast images to clinical practice are also discussed. Through this review we conclude that although developing new AI-based models of breast images has achieved significant progress and promising results, several obstacles to applying these new AI-based models to clinical practice remain. Therefore, more research effort is needed in future studies.