Automated localization of breast cancer in DCE-MRI

Kinetic Heterogeneity Improves the Specificity of Dynamic Enhanced MRI in Differentiating Benign and Malignant Breast Tumours

RATIONALE AND OBJECTIVES

To investigate whether kinetic heterogeneity in dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) improves the specificity of breast cancer (BC) diagnosis.

MATERIALS AND METHODS

The DCE-MRI data of patients with benign breast tumours and BC from June 2020 to July 2022 were retrospectively evaluated. MATLAB and SPM were used to determine six major kinetic parameters: peak, enhancement volume, heterogeneity, as well as persistent, plateau, and washout proportions. Continuous variables were compared using the Student's t-test or Mann-Whitney U tests, and categorical variables were compared using the chi-square or Fisher's exact tests. Receiver operating characteristic curves were plotted. The intraclass correlation coefficient (ICC) was used to evaluate agreement between the two observers. Multivariate logistic regression analysis was conducted to calculate the odds ratios (ORs) with 95% confidence intervals (CIs) for the association between benign and malignant breast tumours.

RESULTS

In total, 147 patients (mean age, 47 years old) were included in the study, 76 of whom had BC. Data analysis by the two observers showed good consistency in the peak, enhancement volume, persistent proportion, plateau proportion, washout proportion, and heterogeneity, with ICCs of 0.865, 0.988, 0.906, 0.940, 0.740, and 0.867, respectively (p < 0.001). In the DCE kinetic analysis, differences in all the six kinetic parameters were statistically significant (p < 0.05). The area under the curve for heterogeneity was 0.92 (95% CI:0.88,0.97), and the sensitivity and specificity were 0.895 and 0.845, respectively. Multivariate logistic regression analysis showed that heterogeneity was an independent predictor of BC compared to benign breast tumours (OR=2.020; 95% CI:1.316, 3.100; p = 0.001).

CONCLUSION

The kinetic heterogeneity of DCE-MRI can effectively distinguish between benign and malignant breast tumours and improve the specificity of BC diagnosis.

DEBCM: Deep Learning-Based Enhanced Breast Invasive Ductal Carcinoma Classification Model in IoMT Healthcare Systems

Accurate breast cancer (BC) diagnosis is a difficult task that is critical for the proper treatment of BC in IoMT (Internet of Medical Things) healthcare systems. This paper proposes a convolutional neural network (CNN)-based diagnosis method for detecting early-stage breast cancer. In developing the proposed method, we incorporated the CNN model for the invasive ductal carcinoma (IDC) classification using breast histology image data. We have incorporated transfer learning (TL) and data augmentation (DA) mechanisms to improve the CNN model's predictive outcomes. For the fine-tuning process, the CNN model was trained with breast histology image data. Furthermore, the held-out cross-validation method for best model selection and hyper-parameter tuning was incorporated. In addition, various performance evaluation metrics for model performance assessment were computed. The experimental results confirmed that the proposed model outperformed the baseline models across all evaluation metrics, achieving 99.04% accuracy. We recommend the proposed method for early recognition of BC in IoMT healthcare systems due to its high performance.

Localization of contrast-enhanced breast lesions in ultrafast screening MRI using deep convolutional neural networks

OBJECTIVES

To develop a deep learning-based method for contrast-enhanced breast lesion detection in ultrafast screening MRI.

MATERIALS AND METHODS

A total of 837 breast MRI exams of 488 consecutive patients were included. Lesion's location was independently annotated in the maximum intensity projection (MIP) image of the last time-resolved angiography with stochastic trajectories (TWIST) sequence for each individual breast, resulting in 265 lesions (190 benign, 75 malignant) in 163 breasts (133 women). YOLOv5 models were fine-tuned using training sets containing the same number of MIP images with and without lesions. A long short-term memory (LSTM) network was employed to help reduce false positive predictions. The integrated system was then evaluated on test sets containing enriched uninvolved breasts during cross-validation to mimic the performance in a screening scenario.

RESULTS

In five-fold cross-validation, the YOLOv5x model showed a sensitivity of 0.95, 0.97, 0.98, and 0.99, with 0.125, 0.25, 0.5, and 1 false positive per breast, respectively. The LSTM network reduced 15.5% of the false positive prediction from the YOLO model, and the positive predictive value was increased from 0.22 to 0.25.

CONCLUSIONS

A fine-tuned YOLOv5x model can detect breast lesions on ultrafast MRI with high sensitivity in a screening population, and the output of the model could be further refined by an LSTM network to reduce the amount of false positive predictions.

CLINICAL RELEVANCE STATEMENT

The proposed integrated system would make the ultrafast MRI screening process more effective by assisting radiologists in prioritizing suspicious examinations and supporting the diagnostic workup.

KEY POINTS

• Deep convolutional neural networks could be utilized to automatically pinpoint breast lesions in screening MRI with high sensitivity. • False positive predictions significantly increased when the detection models were tested on highly unbalanced test sets with more normal scans. • Dynamic enhancement patterns of breast lesions during contrast inflow learned by the long short-term memory networks helped to reduce false positive predictions.

Noninvasive identification of HER2-low-positive status by MRI-based deep learning radiomics predicts the disease-free survival of patients with breast cancer

OBJECTIVE

This study aimed to establish a MRI-based deep learning radiomics (DLR) signature to predict the human epidermal growth factor receptor 2 (HER2)-low-positive status and further verified the difference in prognosis by the DLR model.

METHODS

A total of 481 patients with breast cancer who underwent preoperative MRI were retrospectively recruited from two institutions. Traditional radiomics features and deep semantic segmentation feature-based radiomics (DSFR) features were extracted from segmented tumors to construct models separately. Then, the DLR model was constructed to assess the HER2 status by averaging the output probabilities of the two models. Finally, a Kaplan‒Meier survival analysis was conducted to explore the disease-free survival (DFS) in patients with HER2-low-positive status. The multivariate Cox proportional hazard model was constructed to further determine the factors associated with DFS.

RESULTS

First, the DLR model distinguished between HER2-negative and HER2-overexpressing patients with AUCs of 0.868 and 0.763 in the training and validation cohorts, respectively. Furthermore, the DLR model distinguished between HER2-low-positive and HER2-zero patients with AUCs of 0.855 and 0.750, respectively. Cox regression analysis showed that the prediction score obtained using the DLR model (HR, 0.175; p = 0.024) and lesion size (HR, 1.043; p = 0.009) were significant, independent predictors of DFS.

CONCLUSIONS

We successfully constructed a DLR model based on MRI to noninvasively evaluate the HER2 status and further revealed prospects for predicting the DFS of patients with HER2-low-positive status.

CLINICAL RELEVANCE STATEMENT

The MRI-based DLR model could noninvasively identify HER2-low-positive status, which is considered a novel prognostic predictor and therapeutic target.

KEY POINTS

• The DLR model effectively distinguished the HER2 status of breast cancer patients, especially the HER2-low-positive status. • The DLR model was better than the traditional radiomics model or DSFR model in distinguishing HER2 expression. • The prediction score obtained using the model and lesion size were significant independent predictors of DFS.

Discrimination of benign and malignant breast lesions on dynamic contrast-enhanced magnetic resonance imaging using deep learning

PURPOSE

To evaluate the capability of deep transfer learning (DTL) and fine-tuning methods in differentiating malignant from benign lesions in breast dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI).

METHODS

The diagnostic efficiencies of the VGG19, ResNet50, and DenseNet201 models were tested under the same dataset. The model with the highest performance was selected and modified utilizing three fine-tuning strategies (S1-3). Fifty additional lesions were selected to form the validation set to verify the generalization abilities of these models. The accuracy (Ac) of the different models in the training and test sets, as well as the precision (Pr), recall rate (Rc), F1 score (), and area under the receiver operating characteristic curve (AUC), were primary performance indicators. Finally, the kappa test was used to compare the degree of agreement between the DTL models and pathological diagnosis in differentiating malignant from benign breast lesions.

RESULTS

The Pr, Rc, f1, and AUC of VGG19 (86.0%, 0.81, 0.81, and 0.81, respectively) were higher than those of DenseNet201 (70.0%, 0.61, 0.63, and 0.61, respectively) and ResNet50 (61.0%, 0.59, 0.59, and 0.59). After fine-tuning, the Pr, Rc, f1, and AUC of S1 (87.0%, 0.86, 0.86, and 0.86, respectively) were higher than those of VGG19. Notably, the degree of agreement between S1 and pathological diagnosis in differentiating malignant from benign breast lesions was 0.720 (κ = 0.720), which was higher than that of DenseNet201 (κ = 0.440), VGG19 (κ = 0.640), and ResNet50 (κ = 0.280).

CONCLUSION

The VGG19 model is an effective method for identifying benign and malignant breast lesions on DCE-MRI, and its performance can be further improved via fine-tuning. Overall, our findings insinuate that this technique holds potential clinical application value.

BreastDM: A DCE-MRI dataset for breast tumor image segmentation and classification

Dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) has shown high sensitivity to diagnose breast cancer. However, few computer-aided algorithms focus on employing DCE-MR images for breast cancer diagnosis due to the lack of publicly available DCE-MRI datasets. To address this issue, our work releases a new DCE-MRI dataset called BreastDM for breast tumor segmentation and classification. In particular, a dataset of 232 patients selected with DCE-MR images for benign and malignant cases is established. Each case consists of three types of sequences: pre-contrast, post-contrast, and subtraction sequences. To show the difficulty of breast DCE-MRI tumor image segmentation and classification tasks, benchmarks are achieved by state-of-the-art image segmentation and classification algorithms, including conventional hand-crafted based methods and recently-emerged deep learning-based methods. More importantly, a local-global cross attention fusion network (LG-CAFN) is proposed to further improve the performance of breast tumor images classification. Specifically, LG-CAFN achieved the highest accuracy (88.20%, 83.93%) and AUC value (0.9154,0.8826) in both groups of experiments. Extensive experiments are conducted to present strong baselines based on various typical image segmentation and classification algorithms. Experiment results also demonstrate the superiority of the proposed LG-CAFN to other breast tumor images classification methods. The related dataset and evaluation codes are publicly available at smallboy-code/Breast-cancer-dataset.

Weakly supervised breast lesion detection in DCE-MRI using self-transfer learning

BACKGROUND

Breast cancer is a typically diagnosed and life-threatening cancer in women. Thus, dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) is increasingly used for breast lesion detection and diagnosis because of the high resolution of soft tissues. Moreover, supervised detection methods have been implemented for breast lesion detection. However, these methods require substantial time and specialized staff to develop the labeled training samples.

PURPOSE

To investigate the potential of weakly supervised deep learning models for breast lesion detection.

METHODS

A total of 1003 breast DCE-MRI studies were collected, including 603 abnormal cases with 770 breast lesions and 400 normal subjects. The proposed model was trained using breast DCE-MRI considering only the image-level labels (normal and abnormal) and optimized for classification and detection sub-tasks simultaneously. Ablation experiments were performed to evaluate different convolutional neural network (CNN) backbones (VGG19 and ResNet50) as shared convolutional layers, as well as to evaluate the effect of the preprocessing methods.

RESULTS

Our weakly supervised model performed better with VGG19 than with ResNet50 (p < 0.05). The average precision (AP) of the classification sub-task was 91.7% for abnormal cases and 88.0% for normal samples. The area under the receiver operating characteristic (ROC) curve (AUC) was 0.939 (95% confidence interval [CI]: 0.920-0.941). The weakly supervised detection task AP was 85.7%, and the correct location (CorLoc) was 90.2%. A sensitivity of 84.0% at two-false positives per image was assessed based on free-response ROC (FROC) curve.

CONCLUSIONS

The results confirm that a weakly supervised CNN based on self-transfer learning is an effective and promising auxiliary tool for detecting breast lesions.

Validation of Combined Deep Learning Triaging and Computer-Aided Diagnosis in 2901 Breast MRI Examinations From the Second Screening Round of the Dense Tissue and Early Breast Neoplasm Screening Trial

OBJECTIVES

Computer-aided triaging (CAT) and computer-aided diagnosis (CAD) of screening breast magnetic resonance imaging have shown potential to reduce the workload of radiologists in the context of dismissing normal breast scans and dismissing benign disease in women with extremely dense breasts. The aim of this study was to validate the potential of integrating CAT and CAD to reduce workload and workup on benign lesions in the second screening round of the DENSE trial, without missing cancer.

METHODS

We included 2901 breast magnetic resonance imaging scans, obtained from 8 hospitals in the Netherlands. Computer-aided triaging and CAD were previously developed on data from the first screening round. Computer-aided triaging dismissed examinations without lesions. Magnetic resonance imaging examinations triaged to radiological reading were counted and subsequently processed by CAD. The number of benign lesions correctly classified by CAD was recorded. The false-positive fraction of the CAD was compared with that of unassisted radiological reading in the second screening round. Receiver operating characteristics (ROC) analysis was performed and the generalizability of CAT and CAD was assessed by comparing results from first and second screening rounds.

RESULTS

Computer-aided triaging dismissed 950 of 2901 (32.7%) examinations with 49 lesions in total; none were malignant. Subsequent CAD classified 132 of 285 (46.3%) lesions as benign without misclassifying any malignant lesion. Together, CAT and CAD yielded significantly fewer false-positive lesions, 53 of 109 (48.6%) and 89 of 109 (78.9%), respectively ( P = 0.001), than radiological reading alone. Computer-aided triaging had a smaller area under the ROC curve in the second screening round compared with the first, 0.83 versus 0.76 ( P = 0.001), but this did not affect the negative predictive value at the 100% sensitivity operating threshold. Computer-aided diagnosis was not associated with significant differences in area under the ROC curve (0.857 vs 0.753, P = 0.08). At the operating thresholds, the specificities of CAT (39.7% vs 41.0%, P = 0.70) and CAD (41.0% vs 38.2%, P = 0.62) were successfully reproduced in the second round.

CONCLUSION

The combined application of CAT and CAD showed potential to reduce workload of radiologists and to reduce number of biopsies on benign lesions. Computer-aided triaging (CAT) correctly dismissed 950 of 2901 (32.7%) examinations with 49 lesions in total; none were malignant. Subsequent computer-aided diagnosis (CAD) classified 132 of 285 (46.3%) lesions as benign without misclassifying any malignant lesion. Together, CAT and CAD yielded significantly fewer false-positive lesions, 53 of 109 (48.6%) and 89 of 109 (78.9%), respectively ( P = 0.001), than radiological reading alone.

Classification of Breast Lesions on DCE-MRI Data Using a Fine-Tuned MobileNet

It is crucial to diagnose breast cancer early and accurately to optimize treatment. Presently, most deep learning models used for breast cancer detection cannot be used on mobile phones or low-power devices. This study intended to evaluate the capabilities of MobileNetV1 and MobileNetV2 and their fine-tuned models to differentiate malignant lesions from benign lesions in breast dynamic contrast-enhanced magnetic resonance images (DCE-MRI).

nnUNet-based Multi-modality Breast MRI Segmentation and Tissue-Delineating Phantom for Robotic Tumor Surgery Planning

Segmentation of the thoracic region and breast tissues is crucial for analyzing and diagnosing the presence of breast masses. This paper introduces a medical image segmentation architecture that aggregates two neural networks based on the state-of-the-art nnU-Net. Additionally, this study proposes a polyvinyl alcohol cryogel (PVA-C) breast phantom, based on its automated segmentation approach, to enable planning and navigation experiments for robotic breast surgery. The dataset consists of multimodality breast MRI of T2W and STIR images obtained from 10 patients. A statistical analysis of segmentation tasks emphasizes the Dice Similarity Coefficient (DSC), segmentation accuracy, sensitivity, and specificity. We first use a single class labeling to segment the breast region and then exploit it as an input for three-class labeling to segment fatty, fibroglandular (FGT), and tumorous tissues. The first network has a 0.95 DCS, while the second network has a 0.95, 0.83, and 0.41 for fat, FGT, and tumor classes, respectively. Clinical Relevance-This research is relevant to the breast surgery community as it establishes a deep learning-based (DL) algorithmic and phantomic foundation for surgical planning and navigation that will exploit preoperative multimodal MRI and intraoperative ultrasound to achieve highly cosmetic breast surgery. In addition, the planning and navigation will guide a robot that can cut, resect, bag, and grasp a tissue mass that encapsulates breast tumors and positive tissue margins. This image-guided robotic approach promises to potentiate the accuracy of breast surgeons and improve patient outcomes.

An MRI-Based Radiomics Model for Predicting the Benignity and Malignancy of BI-RADS 4 Breast Lesions

Objectives

The probability of Breast Imaging Reporting and Data Systems (BI-RADS) 4 lesions being malignant is 2%–95%, which shows the difficulty to make a diagnosis. Radiomics models based on magnetic resonance imaging (MRI) can replace clinicopathological diagnosis with high performance. In the present study, we developed and tested a radiomics model based on MRI images that can predict the malignancy of BI-RADS 4 breast lesions.

Methods

We retrospective enrolled a total of 216 BI-RADS 4 patients MRI and clinical information. We extracted 3,474 radiomics features from dynamic contrast-enhanced (DCE), T₂-weighted images (T₂WI), and diffusion-weighted imaging (DWI) MRI images. Least absolute shrinkage and selection operator (LASSO) and logistic regression were used to select features and build radiomics models based on different sequence combinations. We built eight radiomics models which were based on DCE, DWI, T₂WI, DCE+DWI, DCE+T₂WI, DWI+T₂WI, and DCE+DWI+T₂WI and a clinical predictive model built based on the visual assessment of radiologists. A nomogram was constructed with the best radiomics signature combined with patient characteristics. The calibration curves for the radiomics signature and nomogram were conducted, combined with the Hosmer-Lemeshow test.

Results

Pearson’s correlation was used to eliminate 3,329 irrelevant features, and then LASSO and logistic regression were used to screen the remaining feature coefficients for each model we built. Finally, 12 related features were obtained in the model which had the best performance. These 12 features were used to build a radiomics model in combination with the actual clinical diagnosis of benign or malignant lesion labels we have obtained. The best model built by 12 features from the 3 sequences has an AUC value of 0.939 (95% CI, 0.884-0.994) and an accuracy of 0.931 in the testing cohort. The sensitivity, specificity, precision and Matthews correlation coefficient (MCC) of testing cohort are 0.932, 0.923, 0.982, and 0.791, respectively. The nomogram has also been verified to have calibration curves with good overlap.

Conclusions

Radiomics is beneficial in the malignancy prediction of BI-RADS 4 breast lesions. The radiomics predictive model built by the combination of DCE, DWI, and T₂WI sequences has great application potential.

StackBC: Deep learning and transfer learning techniques based stacking approach for accurate Invasive Ductal Carcinoma classification using histology images

Artificial intelligence (AI) based computer-aided diagnostic (CAD) systems can effectively diagnose critical disease. AI-based detection of breast cancer (BC) through images data is more efficient and accurate than professional radiologists. However, the existing AI-based BC diagnosis methods have complexity in low prediction accuracy and high computation time. Due to these reasons, medical professionals are not employing the current proposed techniques in E-Healthcare to effectively diagnose the BC. To diagnose the breast cancer effectively need to incorporate advanced AI techniques based methods in diagnosis process. In this work, we proposed a deep learning based diagnosis method (StackBC) to detect breast cancer in the early stage for effective treatment and recovery. In particular, we have incorporated deep learning models including Convolutional neural network (CNN), Long short term memory (LSTM), and Gated recurrent unit (GRU) for the classification of Invasive Ductal Carcinoma (IDC). Additionally, data augmentation and transfer learning techniques have been incorporated for data set balancing and for effective training the model. To further improve the predictive performance of model we used stacking technique. Among the three base classifiers (CNN, LSTM, GRU) the predictive performance of GRU are better as compared to individual model. The GRU is selected as a meta classifier to distinguish between Non-IDC and IDC breast images. The method Hold-Out has been incorporated and the data set is split into 90% and 10% for training and testing of the model, respectively. Model evaluation metrics have been computed for model performance evaluation. To analyze the efficacy of the model, we have used breast histology images data set. Our experimental results demonstrated that the proposed StackBC method achieved improved performance by gaining 99.02% accuracy and 100% area under the receiver operating characteristics curve (AUC-ROC) compared to state-of-the-art methods. Due to the high performance of the proposed method, we recommend it for early recognition of breast cancer in E-Healthcare.

A U-Net Ensemble for breast lesion segmentation in DCE MRI

Dynamic Contrast Enhanced Magnetic Resonance Imaging (DCE-MRI) has been recognized as an effective tool for Breast Cancer (BC) diagnosis. Automatic BC analysis from DCE-MRI depends on features extracted particularly from lesions, hence, lesions need to be accurately segmented as a prior step. Due to the time and experience required to manually segment lesions in 4D DCE-MRI, automating this task is expected to reduce the workload, reduce observer variability and improve diagnostic accuracy. In this paper we propose an automated method for breast lesion segmentation from DCE-MRI based on a U-Net framework. The contributions of this work are the proposal of a modified U-Net architecture and the analysis of the input DCE information. In that sense, we propose the use of an ensemble method combining three U-Net models, each using a different input combination, outperforming all individual methods and other existing approaches. For evaluation, we use a subset of 46 cases from the TCGA-BRCA dataset, a challenging and publicly available dataset not reported to date for this task. Due to the incomplete annotations provided, we complement them with the help of a radiologist in order to include secondary lesions that were not originally segmented. The proposed ensemble method obtains a mean Dice Similarity Coefficient (DSC) of 0.680 (0.802 for main lesions) which outperforms state-of-the art methods using the same dataset, demonstrating the effectiveness of our method considering the complexity of the dataset.

Quantitative magnetic resonance imaging and tumor forecasting of breast cancer patients in the community setting

This protocol describes a complete data acquisition, analysis and computational forecasting pipeline for employing quantitative MRI data to predict the response of locally advanced breast cancer to neoadjuvant therapy in a community-based care setting. The methodology has previously been successfully applied to a heterogeneous patient population. The protocol details how to acquire the necessary images followed by registration, segmentation, quantitative perfusion and diffusion analysis, model calibration, and prediction. The data collection portion of the protocol requires ~25 min of scanning, postprocessing requires 2-3 h, and the model calibration and prediction components require ~10 h per patient depending on tumor size. The response of individual breast cancer patients to neoadjuvant therapy is forecast by application of a biophysical, reaction-diffusion mathematical model to these data. Successful application of the protocol results in coregistered MRI data from at least two scan visits that quantifies an individual tumor's size, cellularity and vascular properties. This enables a spatially resolved prediction of how a particular patient's tumor will respond to therapy. Expertise in image acquisition and analysis, as well as the numerical solution of partial differential equations, is required to carry out this protocol.

Deep Learning for Automated Triaging of 4581 Breast MRI Examinations from the DENSE Trial

Background Supplemental screening with MRI has proved beneficial in women with extremely dense breasts. Most MRI examinations show normal anatomic and physiologic variation that may not require radiologic review. Thus, ways to triage these normal MRI examinations to reduce radiologist workload are needed. Purpose To determine the feasibility of an automated triaging method using deep learning (DL) to dismiss the highest number of MRI examinations without lesions while still identifying malignant disease. Materials and Methods This secondary analysis of data from the Dense Tissue and Early Breast Neoplasm Screening, or DENSE, trial evaluated breast MRI examinations from the first screening round performed in eight hospitals between December 2011 and January 2016. A DL model was developed to differentiate between breasts with lesions and breasts without lesions. The model was trained to dismiss breasts with normal phenotypical variation and to triage lesions (Breast Imaging Reporting and Data System [BI-RADS] categories 2-5) using eightfold internal-external validation. The model was trained on data from seven hospitals and tested on data from the eighth hospital, alternating such that each hospital was used once as an external test set. Performance was assessed using receiver operating characteristic analysis. At 100% sensitivity for malignant disease, the fraction of examinations dismissed from radiologic review was estimated. Results A total of 4581 MRI examinations of extremely dense breasts from 4581women (mean age, 54.3 years; interquartile range, 51.5-59.8 years) were included. Of the 9162 breasts, 838 had at least one lesion (BI-RADS category 2-5, of which 77 were malignant) and 8324 had no lesions. At 100% sensitivity for malignant lesions, the DL model considered 90.7% (95% CI: 86.7, 94.7) of the MRI examinations with lesions to be nonnormal and triaged them to radiologic review. The DL model dismissed 39.7% (95% CI: 30.0, 49.4) of the MRI examinations without lesions. The DL model had an average area under the receiver operating characteristic curve of 0.83 (95% CI: 0.80, 0.85) in the differentiation between normal breast MRI examinations and MRI examinations with lesions. Conclusion Automated analysis of breast MRI examinations in women with dense breasts dismissed nearly 40% of MRI scans without lesions while not missing any cancers. ClinicalTrials.gov: NCT01315015 © RSNA, 2021 Online supplemental material is available for this article. See also the editorial by Joe in this issue.

AI-Enhanced Diagnosis of Challenging Lesions in Breast MRI: A Methodology and Application Primer

Computer-aided diagnosis (CAD) systems have become an important tool in the assessment of breast tumors with magnetic resonance imaging (MRI). CAD systems can be used for the detection and diagnosis of breast tumors as a "second opinion" review complementing the radiologist's review. CAD systems have many common parts, such as image preprocessing, tumor feature extraction, and data classification that are mostly based on machine-learning (ML) techniques. In this review article, we describe applications of ML-based CAD systems in MRI covering the detection of diagnostically challenging lesions of the breast such as nonmass enhancing (NME) lesions, and furthermore discuss how multiparametric MRI and radiomics can be applied to the study of NME, including prediction of response to neoadjuvant chemotherapy (NAC). Since ML has been widely used in the medical imaging community, we provide an overview about the state-of-the-art and novel techniques applied as classifiers to CAD systems. The differences in the CAD systems in MRI of the breast for several standard and novel applications for NME are explained in detail to provide important examples, illustrating: 1) CAD for detection and diagnosis, 2) CAD in multiparametric imaging, 3) CAD in NAC, and 4) breast cancer radiomics. We aim to provide a comparison between these CAD applications and to illustrate a global view on intelligent CAD systems based on machine and deep learning in MRI of the breast. LEVEL OF EVIDENCE: 2 TECHNICAL EFFICACY STAGE: 2.

Automatic breast lesion detection in ultrafast DCE-MRI using deep learning

PURPOSE

We propose a deep learning-based computer-aided detection (CADe) method to detect breast lesions in ultrafast DCE-MRI sequences. This method uses both the 3D spatial information and temporal information obtained from the early-phase of the dynamic acquisition.

METHODS

The proposed CADe method, based on a modified 3D RetinaNet model, operates on ultrafast T1 weighted sequences, which are preprocessed for motion compensation, temporal normalization, and are cropped before passing into the model. The model is optimized to enable the detection of relatively small breast lesions in a screening setting, focusing on detection of lesions that are harder to differentiate from confounding structures inside the breast.

RESULTS

The method was developed based on a dataset consisting of 489 ultrafast MRI studies obtained from 462 patients containing a total of 572 lesions (365 malignant, 207 benign) and achieved a detection rate, sensitivity, and detection rate of benign lesions of 0.90 (0.876-0.934), 0.95 (0.934-0.980), and 0.81 (0.751-0.871) at four false positives per normal breast with 10-fold cross-testing, respectively.

CONCLUSIONS

The deep learning architecture used for the proposed CADe application can efficiently detect benign and malignant lesions on ultrafast DCE-MRI. Furthermore, utilizing the less visible hard-to-detect lesions in training improves the learning process and, subsequently, detection of malignant breast lesions.

Comparison of DCE-MRI of murine model cancers with a low dose and high dose of contrast agent

There are increasing concerns regarding intracellular accumulation of gadolinium (Gd) after multiple dynamic contrast enhanced (DCE) MRI scans. We investigated whether a low dose (LD) of Gd-based contrast agent is as effective as a high dose (HD) for quantitative analysis of DCE-MRI data, and evaluated the use of a split dose protocol to obtain new diagnostic parameters. Female C3H mice (n = 6) were injected with mammary carcinoma cells in the hind leg. MRI experiments were performed on 9.4 T scanner. DCE-MRI data were acquired with 1.5 s temporal resolution before and after a LD (0.04 mmol/kg), then again after 30 min followed by a HD (0.2 mmol/kg) bolus injection of Omniscan. The standard Tofts model was used to extract physiological parameters (K^trans and v_e) with the arterial input function derived from muscle reference tissue. In addition, an empirical mathematical model was used to characterize maximum contrast agent uptake (A), contrast agent uptake rate (α) and washout rate (β and γ). There were moderate to strong correlations (r = 0.69-0.97, p < 0001) for parameters K^trans, v_e, A, α and β from LD versus HD data. On average, tumor parameters obtained from LD data were significantly larger (p < 0.05) than those from HD data. The parameter ratios, K^trans, v_e, A and α calculated from the LD data divided by the HD data, were all significantly larger than 1.0 (p < 0.003) for tumor. T₂* changes following contrast agent injection affected parameters calculated from HD data, but this was not the case for LD data. The results suggest that quantitative analysis of LD data may be at least as effective for cancer characterization as quantitative analysis of HD data. In addition, the combination of parameters from two different doses may provide useful diagnostic information.

Breast Cancer Image Classification: A Review

BACKGROUND

Breast cancer represents uncontrolled breast cell growth. Breast cancer is the most diagnosed cancer in women worldwide. Early detection of breast cancer improves the chances of survival and increases treatment options. There are various methods for screening breast cancer, such as mammogram, ultrasound, computed tomography and Magnetic Resonance Imaging (MRI). MRI is gaining prominence as an alternative screening tool for early detection and breast cancer diagnosis. Nevertheless, MRI can hardly be examined without the use of a Computer-Aided Diagnosis (CAD) framework, due to the vast amount of data.

OBJECTIVE

This paper aims to cover the approaches used in the CAD system for the detection of breast cancer.

METHODS

In this paper, the methods used in CAD systems are categories into two classes: the conventional approach and artificial intelligence (AI) approach.

RESULTS

The conventional approach covers the basic steps of image processing, such as preprocessing, segmentation, feature extraction and classification. The AI approach covers the various convolutional and deep learning networks used for diagnosis.

CONCLUSION

This review discusses some of the core concepts used in breast cancer and presents a comprehensive review of efforts in the past to address this problem.

Fully automatic quantification of fibroglandular tissue and background parenchymal enhancement with accurate implementation for axial and sagittal breast MRI protocols

PURPOSE

To propose and evaluate a fully automated technique for quantification of fibroglandular tissue (FGT) and background parenchymal enhancement (BPE) in breast MRI.

METHODS

We propose a fully automated method, where after preprocessing, FGT is segmented in T1-weighted, nonfat-saturated MRI. Incorporating an anatomy-driven prior probability for FGT and robust texture descriptors against intensity variations, our method effectively addresses major image processing challenges, including wide variations in breast anatomy and FGT appearance among individuals. Our framework then propagates this segmentation to dynamic contrast-enhanced (DCE)-MRI to quantify BPE within the segmented FGT regions. Axial and sagittal image data from 40 cancer-unaffected women were used to evaluate our proposed method vs a manually annotated reference standard.

RESULTS

High spatial correspondence was observed between the automatic and manual FGT segmentation (mean Dice similarity coefficient 81.14%). The FGT and BPE quantifications (denoted FGT% and BPE%) indicated high correlation (Pearson's r = 0.99 for both) between automatic and manual segmentations. Furthermore, the differences between the FGT% and BPE% quantified using automatic and manual segmentations were low (mean differences: -0.66 ± 2.91% for FGT% and -0.17 ± 1.03% for BPE%). When correlated with qualitative clinical BI-RADS ratings, the correlation coefficient for FGT% was still high (Spearman's ρ = 0.92), whereas that for BPE was lower (ρ = 0.65). Our proposed approach also performed significantly better than a previously validated method for sagittal breast MRI.

CONCLUSIONS

Our method demonstrated accurate fully automated quantification of FGT and BPE in both sagittal and axial breast MRI. Our results also suggested the complexity of BPE assessment, demonstrating relatively low correlation between segmentation and clinical rating.

Computer-Aided Diagnosis Scheme for Distinguishing Between Benign and Malignant Masses on Breast DCE-MRI Images Using Deep Convolutional Neural Network with Bayesian Optimization

Although magnetic resonance imaging (MRI) has a higher sensitivity of early breast cancer than mammography, the specificity is lower. The purpose of this study was to develop a computer-aided diagnosis (CAD) scheme for distinguishing between benign and malignant breast masses on dynamic contrast material-enhanced MRI (DCE-MRI) by using a deep convolutional neural network (DCNN) with Bayesian optimization. Our database consisted of 56 DCE-MRI examinations for 56 patients, each of which contained five sequential phase images. It included 26 benign and 30 malignant masses. In this study, we first determined a baseline DCNN model from well-known DCNN models in terms of classification performance. The optimum architecture of the DCNN model was determined by changing the hyperparameters of the baseline DCNN model such as the number of layers, the filter size, and the number of filters using Bayesian optimization. As the input of the proposed DCNN model, rectangular regions of interest which include an entire mass were selected from each of DCE-MRI images by an experienced radiologist. Three-fold cross validation method was used for training and testing of the proposed DCNN model. The classification accuracy, the sensitivity, the specificity, the positive predictive value, and the negative predictive value were 92.9% (52/56), 93.3% (28/30), 92.3% (24/26), 93.3% (28/30), and 92.3% (24/26), respectively. These results were substantially greater than those with the conventional method based on handcrafted features and a classifier. The proposed DCNN model achieved high classification performance and would be useful in differential diagnoses of masses in breast DCE-MRI images as a diagnostic aid.

A Brief Review on Breast Carcinoma and Deliberation on Current Non Invasive Imaging Techniques for Detection

BACKGROUND

Breast carcinoma is a life threatening disease that accounts for 25.1% of all carcinoma among women worldwide. Early detection of the disease enhances the chance for survival.

DISCUSSION

This paper presents comprehensive report on breast carcinoma disease and its modalities available for detection and diagnosis, as it delves into the screening and detection modalities with special focus placed on the non-invasive techniques and its recent advancement work done, as well as a proposal on a novel method for the application of early breast carcinoma detection.

CONCLUSION

This paper aims to serve as a foundation guidance for the reader to attain bird's eye understanding on breast carcinoma disease and its current non-invasive modalities.

Artificial Intelligence Medical Ultrasound Equipment: Application of Breast Lesions Detection

Breast cancer ranks first among cancers affecting women's health. Our work aims to realize the intelligence of the medical ultrasound equipment with limited computational capability, which is used for the assistant detection of breast lesions. We embed the high-computational deep learning algorithm into the medical ultrasound equipment with limited computational capability by two techniques: (1) lightweight neural network: considering the limited computational capability of ultrasound equipment, a lightweight neural network is designed, which greatly reduces the amount of calculation. And we use the technique of knowledge distillation to train the low-precision network helped with the high-precision network; (2) asynchronous calculations: consider four frames of ultrasound images as a group; the image of the first frame of each group is used as the input of the network, and the result is respectively fused with the images of the fourth to seventh frames. An amount of computation of 30 GFLO/frame is required for the proposed lightweight neural network, about 1/6 of that of the large high-precision network. After trained from scratch using the knowledge distillation technique, the detection performance of the lightweight neural network (sensitivity = 89.25%, specificity = 96.33%, the average precision [AP] = 0.85) is close to that of the high-precision network (sensitivity = 98.3%, specificity = 88.33%, AP = 0.91). By asynchronous calculation, we achieve real-time automatic detection of 24 fps (frames per second) on the ultrasound equipment. Our work proposes a method to realize the intelligence of the low-computation-power ultrasonic equipment, and successfully achieves the real-time assistant detection of breast lesions. The significance of the study is as follows: (1) The proposed method is of practical significance in assisting doctors to detect breast lesions; (2) our method provides some practical and theoretical support for the development and engineering of intelligent equipment based on artificial intelligence algorithms.

Recent Progress for the Techniques of MRI-Guided Breast Interventions and their applications on Surgical Strategy

With a high sensitivity of breast lesions, MRI can detect suspicious lesions which are occult in traditional breast examination equipment. However, the lower and variable specificity of MRI makes the MRI-guided intervention, including biopsies and localizations, necessary before surgery, especially for patients who need the treatment of breast-conserving surgery (BCS). MRI techniques and patient preparation should be first carefully considered before the intervention to avoid lengthening the procedure time and compromising targeting accuracy. Doctors and radiologists need to reconfirm the target of the lesion and be very familiar with the process approach and equipment techniques involving the computer-aided diagnosis (CAD) tools and the biopsy system and follow a correct way. The basic steps of MRI-guided biopsy and localization are nearly the same regardless of the vendor or platform, and this article systematically introduces detailed methods and techniques of MRI-guided intervention. The two interventions both face different challenging situations during procedures with solutions given in the article. Post-operative statistics show that the complications of MRI-guided intervention are infrequent and mild, and MRI-guided biopsy provides the pathological information for the subsequent surgical decisions and MRI-guided localization fully prepared for follow-up surgical biopsy. New techniques for MRI-guided intervention are also elaborated in the article, which leads to future development. In a word, MRI-guided intervention is a safe, accurate, and effective technique with a low complication rate and successful MRI-guided intervention is truly teamwork with efforts from patients to surgeons, radiologists, MRI technologists, and nurses.

Deep Convolutional Neural Networks-Based Automatic Breast Segmentation and Mass Detection in DCE-MRI

Breast segmentation and mass detection in medical images are important for diagnosis and treatment follow-up. Automation of these challenging tasks can assist radiologists by reducing the high manual workload of breast cancer analysis. In this paper, deep convolutional neural networks (DCNN) were employed for breast segmentation and mass detection in dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI). First, the region of the breasts was segmented from the remaining body parts by building a fully convolutional neural network based on U-Net++. Using the method of deep learning to extract the target area can help to reduce the interference external to the breast. Second, a faster region with convolutional neural network (Faster RCNN) was used for mass detection on segmented breast images. The dataset of DCE-MRI used in this study was obtained from 75 patients, and a 5-fold cross validation method was adopted. The statistical analysis of breast region segmentation was carried out by computing the Dice similarity coefficient (DSC), Jaccard coefficient, and segmentation sensitivity. For validation of breast mass detection, the sensitivity with the number of false positives per case was computed and analyzed. The Dice and Jaccard coefficients and the segmentation sensitivity value for breast region segmentation were 0.951, 0.908, and 0.948, respectively, which were better than those of the original U-Net algorithm, and the average sensitivity for mass detection achieved 0.874 with 3.4 false positives per case.

A knowledge-driven feature learning and integration method for breast cancer diagnosis on multi-sequence MRI

BACKGROUND

The classification of benign versus malignant breast lesions on multi-sequence Magnetic Resonance Imaging (MRI) is a challenging task since breast lesions are heterogeneous and complex. Recently, deep learning methods have been used for breast lesion diagnosis with raw image input. However, without the guidance of domain knowledge, these data-driven methods cannot ensure that the features extracted from images are comprehensive for breast cancer diagnosis. Specifically, these features are difficult to relate to clinically relevant phenomena.

PURPOSE

Inspired by the cognition process of radiologists, we propose a Knowledge-driven Feature Learning and Integration (KFLI) framework, to discriminate between benign and malignant breast lesions using Multi-sequences MRI.

METHODS

Starting from sequence division based on characteristics, we use domain knowledge to guide the feature learning process so that the feature vectors of sub-sequence are constrained to lie in characteristic-related semantic space. Then, different deep networks are designed to extract various sub-sequence features. Furthermore, a weighting module is employed for the integration of the features extracted from different sub-sequence images adaptively.

RESULTS

The KFLI is a domain knowledge and deep network ensemble, which can extract sufficient and effective features from each sub-sequence for a comprehensive diagnosis of breast cancer. Experiments on 100 MRI studies have demonstrated that the KFLI achieves sensitivity, specificity, and accuracy of 84.6%, 85.7% and 85.0%, respectively, which outperforms other state-of-the-art algorithms.

Deformable Registration for Longitudinal Breast MRI Screening

MRI screening of high-risk patients for breast cancer provides very high sensitivity, but with a high recall rate and negative biopsies. Comparing the current exam to prior exams reduces the number of follow-up procedures requested by radiologists. Such comparison, however, can be challenging due to the highly deformable nature of breast tissues. Automated co-registration of multiple scans has the potential to aid diagnosis by providing 3D images for side-by-side comparison and also for use in CAD systems. Although many deformable registration techniques exist, they generally have a large number of parameters that need to be optimized and validated for each new application. Here, we propose a framework for such optimization and also identify the optimal input parameter set for registration of 3D T₁-weighted MRI of breast using Elastix, a widely used and freely available registration tool. A numerical simulation study was first conducted to model the breast tissue and its deformation through finite element (FE) modeling. This model generated the ground truth for evaluating the registration accuracy by providing the deformation of each voxel in the breast volume. An exhaustive search was performed over various values of 7 registration parameters (4050 different combinations of parameters were assessed) and the optimum parameter set was determined. This study showed that there was a large variation in the registration accuracy of different parameter sets ranging from 0.29 mm to 2.50 mm in median registration error and 3.71 mm to 8.90 mm in 95 percentile of the registration error. Mean registration errors of 0.32 mm, 0.29 mm, and 0.30 mm and 95 percentile errors of 3.71 mm, 5.02 mm, and 4.70 mm were obtained by the three best parameter sets. The optimal parameter set was applied to consecutive breast MRI scans of 13 patients. A radiologist identified 113 landmark pairs (~ 11 per patient) which were used to assess registration accuracy. The results demonstrated that using the optimal registration parameter set, a registration accuracy (in mm) of 3.4 [1.8 6.8] was achieved.

Artificial intelligence in the interpretation of breast cancer on MRI

Advances in both imaging and computers have led to the rise in the potential use of artificial intelligence (AI) in various tasks in breast imaging, going beyond the current use in computer-aided detection to include diagnosis, prognosis, response to therapy, and risk assessment. The automated capabilities of AI offer the potential to enhance the diagnostic expertise of clinicians, including accurate demarcation of tumor volume, extraction of characteristic cancer phenotypes, translation of tumoral phenotype features to clinical genotype implications, and risk prediction. The combination of image-specific findings with the underlying genomic, pathologic, and clinical features is becoming of increasing value in breast cancer. The concurrent emergence of newer imaging techniques has provided radiologists with greater diagnostic tools and image datasets to analyze and interpret. Integrating an AI-based workflow within breast imaging enables the integration of multiple data streams into powerful multidisciplinary applications that may lead the path to personalized patient-specific medicine. In this article we describe the goals of AI in breast cancer imaging, in particular MRI, and review the literature as it relates to the current application, potential, and limitations in breast cancer. Level of Evidence: 3 Technical Efficacy: Stage 3 J. Magn. Reson. Imaging 2020;51:1310-1324.

Preliminary results of computer-aided diagnosis for magnetic resonance imaging of solid breast lesions

PURPOSE

The present study aimed to determine suitable optimal classifiers and investigate the general applicability of computer-aided diagnosis (CAD) to compare magnetic resonance (MR)-CAD with MR imaging (MRI) in distinguishing benign from malignant solid breast masses.

METHODS

We analyzed a total of 251 patients (mean age: 44.8 ± 12.3 years; range: 21-81 years) with 274 breast masses (154 benign masses, 120 malignant masses) using a Gaussian mixture model and a random forest machine model for segmentation and classification.

RESULTS

The diagnostic performance of MRI alone and MRI plus CAD were compared with respect to sensitivity, specificity, and area under the curve (AUC), using receiver operating characteristic curve analysis. The discriminating power to detect malignancy using MR-CAD with an AUC of 0.955 (sensitivity was 95.8% and the specificity was 92.9%) was significantly higher than that of MRI alone with an AUC of 0.785 (sensitivity was 71.7% and the specificity was 85.7%).

CONCLUSION

CAD is feasible to differentiate breast lesions, and it can complement MRI, thereby making it easier to diagnose breast lesions and obviating the need for unnecessary biopsies.

Automatic segmentation and classification of breast lesions through identification of informative multiparametric PET/MRI features

Background

Multiparametric positron emission tomography/magnetic resonance imaging (mpPET/MRI) shows clinical potential for detection and classification of breast lesions. Yet, the contribution of features for computer-aided segmentation and diagnosis (CAD) need to be better understood. We proposed a data-driven machine learning approach for a CAD system combining dynamic contrast-enhanced (DCE)-MRI, diffusion-weighted imaging (DWI), and ¹⁸F-fluorodeoxyglucose (¹⁸F-FDG)-PET.

Methods

The CAD incorporated a random forest (RF) classifier combined with mpPET/MRI intensity-based features for lesion segmentation and shape features, kinetic and spatio-temporal texture features, for lesion classification. The CAD pipeline detected and segmented suspicious regions and classified lesions as benign or malignant. The inherent feature selection method of RF and alternatively the minimum-redundancy-maximum-relevance feature ranking method were used.

Results

In 34 patients, we report a detection rate of 10/12 (83.3%) and 22/22 (100%) for benign and malignant lesions, respectively, a Dice similarity coefficient of 0.665 for segmentation, and a classification performance with an area under the curve at receiver operating characteristics analysis of 0.978, a sensitivity of 0.946, and a specificity of 0.936. Segmentation but not classification performance of DCE-MRI improved with information from DWI and FDG-PET. Feature ranking revealed that kinetic and spatio-temporal texture features had the highest contribution for lesion classification. ¹⁸F-FDG-PET and morphologic features were less predictive.

Conclusion

Our CAD enables the assessment of the relevance of mpPET/MRI features on segmentation and classification accuracy. It may aid as a novel computational tool for exploring different modalities/features and their contributions for the detection and classification of breast lesions.

Electronic supplementary material

The online version of this article (10.1186/s41747-019-0096-3) contains supplementary material, which is available to authorized users.

Amount of fibroglandular tissue FGT and background parenchymal enhancement BPE in relation to breast cancer risk and false positives in a breast MRI screening program : A retrospective cohort study

Objectives

The purpose of this study is to evaluate the predictive value of the amount of fibroglandular tissue (FGT) and background parenchymal enhancement (BPE), measured at baseline on breast MRI, for breast cancer development and risk of false-positive findings in women at increased risk for breast cancer.

Methods

Negative baseline MRI scans of 1533 women participating in a screening program for women at increased risk for breast cancer between January 1, 2003, and January 1, 2014, were selected. Automated tools based on deep learning were used to obtain quantitative measures of FGT and BPE. Logistic regression using forward selection was used to assess relationships between FGT, BPE, cancer detection, false-positive recall, and false-positive biopsy.

Results

Sixty cancers were detected in follow-up. FGT was only associated to short-term cancer risk; BPE was not associated with cancer risk. High FGT and BPE did lead to more false-positive recalls at baseline (OR 1.259, p = 0.050, and OR 1.475, p = 0.003) and to more frequent false-positive biopsies at baseline (OR 1.315, p = 0.049, and OR 1.807, p = 0.002), but were not predictive for false-positive findings in subsequent screening rounds.

Conclusions

FGT and BPE, measured on baseline MRI, are not predictive for overall breast cancer development in women at increased risk. High FGT and BPE lead to more false-positive findings at baseline.

Key Points

• Amount of fibroglandular tissue is only predictive for short-term breast cancer risk in women at increased risk.

• Background parenchymal enhancement measured on baseline MRI is not predictive for breast cancer development in women at increased risk.

• High amount of fibroglandular tissue and background parenchymal enhancement lead to more false-positive findings at baseline MRI.

Electronic supplementary material

The online version of this article (10.1007/s00330-019-06020-2) contains supplementary material, which is available to authorized users.

Artificial Intelligence for Breast MRI in 2008-2018: A Systematic Mapping Review

OBJECTIVE

The purpose of this study is to review literature from the past decade on applications of artificial intelligence (AI) to breast MRI.

MATERIALS AND METHODS

In June 2018, a systematic search of the literature was performed to identify articles on the use of AI in breast MRI. For each article identified, the surname of the first author, year of publication, journal of publication, Web of Science Core Collection journal category, country of affiliation of the first author, study design, dataset, study aim(s), AI methods used, and, when available, diagnostic performance were recorded.

RESULTS

Sixty-seven studies, 58 (87%) of which had a retrospective design, were analyzed. When journal categories were considered, 36% of articles were identified as being included in the radiology and imaging journal category. Contrast-enhanced sequences were used for most AI applications (n = 50; 75%) and, on occasion, were combined with other MRI sequences (n = 8; 12%). Four main clinical aims were addressed: breast lesion classification (n = 36; 54%), image processing (n = 14; 21%), prognostic imaging (n = 9; 13%), and response to neoadjuvant therapy (n = 8; 12%). Artificial neural networks, support vector machines, and clustering were the most frequently used algorithms, accounting for 66%. The performance achieved and the most frequently used techniques were then analyzed according to specific clinical aims. Supervised learning algorithms were primarily used for lesion characterization, with the AUC value from ROC analysis ranging from 0.74 to 0.98 (median, 0.87) and with that from prognostic imaging ranging from 0.62 to 0.88 (median, 0.80), whereas unsupervised learning was mainly used for image processing purposes.

CONCLUSION

Interest in the application of advanced AI methods to breast MRI is growing worldwide. Although this growth is encouraging, the current performance of AI applications in breast MRI means that such applications are still far from being incorporated into clinical practice.

Automated Detection and Segmentation of Nonmass-Enhancing Breast Tumors with Dynamic Contrast-Enhanced Magnetic Resonance Imaging

Nonmass-enhancing (NME) lesions constitute a diagnostic challenge in dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) of the breast. Computer-aided diagnosis (CAD) systems provide physicians with advanced tools for analysis, assessment, and evaluation that have a significant impact on the diagnostic performance. Here, we propose a new approach to address the challenge of NME lesion detection and segmentation, taking advantage of independent component analysis (ICA) to extract data-driven dynamic lesion characterizations. A set of independent sources was obtained from the DCE-MRI dataset of breast cancer patients, and the dynamic behavior of the different tissues was described by multiple dynamic curves, together with a set of eigenimages describing the scores for each voxel. A new test image is projected onto the independent source space using the unmixing matrix, and each voxel is classified by a support vector machine (SVM) that has already been trained with manually delineated data. A solution to the high false-positive rate problem is proposed by controlling the SVM hyperplane location, outperforming previously published approaches.

Chemical exchange saturation transfer MRI to assess cell death in breast cancer xenografts at 7T

Purpose

Detecting cell death and predicting tumor response early in a course of chemotherapy could help optimize treatment regimens and improve clinical outcomes. Chemical exchange saturation transfer (CEST) MRI was investigated in vivo to study properties that may be able to detect cancer death.

Results

Using a magnetization transfer ratio (MTR) cutoff of 0.12 at 1.8 ppm was able to differentiate between viable tumor and cell death regions. Comparison of MTR values at this frequency showed significant differences (p < 0.0001) between viable tumor and cell death regions, matching patterns seen on histology. Using this cutoff, the mean increase in cell death index (± standard error of the mean) after chemotherapy was 4 ± 4%, 10% ± 7%, 10 ± 8%, and 4 ± 9% at 4, 8, 12, and 24 h, respectively.

Conclusions

CEST MRI can detect cell death in MDA-231 xenografts but further work is needed to characterize the clinical applications of this finding. Maximum response to chemotherapy occurred at 8-12 h after chemotherapy injection in this in vivo tumor model.

Materials and Methods

Breast cancer xenografts (MDA-MB-231) were scanned using 7 T MRI before and after chemotherapy. As a measure of CEST effect at 0.5 µT saturation amplitude, MTR values at frequency offsets of 1.8 and -3.3 ppm were evaluated. CEST signals after chemotherapy treatment were compared to cell-death histopathology of tumors.

Appearance Constrained Semi-Automatic Segmentation from DCE-MRI is Reproducible and Feasible for Breast Cancer Radiomics: A Feasibility Study

We present a segmentation approach that combines GrowCut (GC) with cancer-specific multi-parametric Gaussian Mixture Model (GCGMM) to produce accurate and reproducible segmentations. We evaluated GCGMM using a retrospectively collected 75 invasive ductal carcinoma with ERPR+ HER2− (n = 15), triple negative (TN) (n = 9), and ER-HER2+ (n = 57) cancers with variable presentation (mass and non-mass enhancement) and background parenchymal enhancement (mild and marked). Expert delineated manual contours were used to assess the segmentation performance using Dice coefficient (DSC), mean surface distance (mSD), Hausdorff distance, and volume ratio (VR). GCGMM segmentations were significantly more accurate than GrowCut (GC) and fuzzy c-means clustering (FCM). GCGMM’s segmentations and the texture features computed from those segmentations were the most reproducible compared with manual delineations and other analyzed segmentation methods. Finally, random forest (RF) classifier trained with leave-one-out cross-validation using features extracted from GCGMM segmentation resulted in the best accuracy for ER-HER2+ vs. ERPR+/TN (GCGMM 0.95, expert 0.95, GC 0.90, FCM 0.92) and for ERPR + HER2− vs. TN (GCGMM 0.92, expert 0.91, GC 0.77, FCM 0.83).

Machine learning techniques for breast cancer computer aided diagnosis using different image modalities: A systematic review

BACKGROUND AND OBJECTIVE

The high incidence of breast cancer in women has increased significantly in the recent years. Physician experience of diagnosing and detecting breast cancer can be assisted by using some computerized features extraction and classification algorithms. This paper presents the conduction and results of a systematic review (SR) that aims to investigate the state of the art regarding the computer aided diagnosis/detection (CAD) systems for breast cancer.

METHODS

The SR was conducted using a comprehensive selection of scientific databases as reference sources, allowing access to diverse publications in the field. The scientific databases used are Springer Link (SL), Science Direct (SD), IEEE Xplore Digital Library, and PubMed. Inclusion and exclusion criteria were defined and applied to each retrieved work to select those of interest. From 320 studies retrieved, 154 studies were included. However, the scope of this research is limited to scientific and academic works and excludes commercial interests.

RESULTS

This survey provides a general analysis of the current status of CAD systems according to the used image modalities and the machine learning based classifiers. Potential research studies have been discussed to create a more objective and efficient CAD systems.

Potential of metric homotopy between intensity and geometry information for multi-modal 3D registration

This paper focuses on a novel strategy increasing robustness with respect to local optima when using Mutual Information (MI) in multi-modal image registration. This is realized by integrating additional geometry information in the cost function. Hereby, the main innovation is a generalization of multi-metric registration approaches by means of a metric homotopy. Particularly we realize a method which automatically determines the parameters of the metric homotopy. To construct the cost function independent of the choice of the optimizer, the weighting is defined as a function of one of the metrics instead of optimizer steps. In addition, a differentiable cost function is developed. In comparison to the commonly used technique to process an intensity based registration on different resolutions, the proposed method is three times faster with unchanged accuracy. It is also shown that in the presence of large landmark errors the proposed method outperforms an approach in accuracy in which both similarity functionals are applied one after the other. The method is evaluated on 3D multi-modal human brain data sets from the Retrospective Image Registration Evaluation Project (RIRE). The evaluation is performed using the evaluation website of the RIRE project to make the registration results of the proposed method easily comparable to other methods. Therefore, the presented results are also available online on the RIRE project page.

The frequency of missed breast cancers in women participating in a high-risk MRI screening program

Purpose

To evaluate the frequency of missed cancers on breast MRI in women participating in a high-risk screening program.

Methods

Patient files from women who participated in an increased risk mammography and MRI screening program (2003–2014) were coupled to the Dutch National Cancer Registry. For each cancer detected, we determined whether an MRI scan was available (0–24 months before cancer detection), which was reported to be negative. These negative MRI scans were in consensus re-evaluated by two dedicated breast radiologists, with knowledge of the cancer location. Cancers were scored as invisible, minimal sign, or visible. Additionally, BI-RADS scores, background parenchymal enhancement, and image quality (IQ; perfect, sufficient, bad) were determined. Results were stratified by detection mode (mammography, MRI, interval cancers, or cancers in prophylactic mastectomies) and patient characteristics (presence of BRCA mutation, age, menopausal state).

Results

Negative prior MRI scans were available for 131 breast cancers. Overall 31% of cancers were visible at the initially negative MRI scan and 34% of cancers showed a minimal sign. The presence of a BRCA mutation strongly reduced the likelihood of visible findings in the last negative MRI (19 vs. 46%, P < 0.001). Less than perfect IQ increased the likelihood of visible findings and minimal signs in the negative MRI (P = 0.021).

Conclusion

This study shows that almost one-third of cancers detected in a high-risk screening program are already visible at the last negative MRI scan, and even more in women without BRCA mutations. Regular auditing and double reading for breast MRI screening is warranted.

The correlation of background parenchymal enhancement in the contralateral breast with patient and tumor characteristics of MRI-screen detected breast cancers

PURPOSE

Higher background parenchymal enhancement (BPE) could be used for stratification of MRI screening programs since it might be related to a higher breast cancer risk. Therefore, the purpose of this study is to correlate BPE to patient and tumor characteristics in women with unilateral MRI-screen detected breast cancer who participated in an intermediate and high risk screening program. As BPE in the affected breast may be difficult to discern from enhancing cancer, we assumed that BPE in the contralateral breast is a representative measure for BPE in women with unilateral breast cancer.

MATERIALS AND METHODS

This retrospective study was approved by our local institutional board and a waiver for consent was granted. MR-examinations of women with unilateral breast cancers screen-detected on breast MRI were evaluated by two readers. BPE in the contralateral breast was rated according to BI-RADS. Univariate analyses were performed to study associations. Observer variability was computed.

RESULTS

Analysis included 77 breast cancers in 76 patients (age: 48±9.8 years), including 62 invasive and 15 pure ductal carcinoma in-situ cases. A negative association between BPE and tumor grade (p≤0.016) and a positive association with progesterone status (p≤0.021) was found. The correlation was stronger when only considering invasive disease. Inter-reader agreement was substantial.

CONCLUSION

Lower BPE in the contralateral breast in women with unilateral breast cancer might be associated to higher tumor grade and progesterone receptor negativity. Great care should be taken using BPE for stratification of patients to tailored screening programs.

Automatic outer and inner breast tissue segmentation using multi-parametric MRI images of breast tumor patients

The objectives of the study were to develop a framework for automatic outer and inner breast tissue segmentation using multi-parametric MRI images of the breast tumor patients; and to perform breast density and tumor tissue analysis. MRI of the breast was performed on 30 patients at 3T-MRI. T₁, T₂ and PD-weighted(W) images, with and without fat saturation(WWFS), and dynamic-contrast-enhanced(DCE)-MRI data were acquired. The proposed automatic segmentation approach was performed in two steps. In step-1, outer segmentation of breast tissue from rest of body parts was performed on structural images (T₂-W/T₁-W/PD-W without fat saturation images) using automatic landmarks detection technique based on operations like profile screening, Otsu thresholding, morphological operations and empirical observation. In step-2, inner segmentation of breast tissue into fibro-glandular(FG), fatty and tumor tissue was performed. For validation of breast tissue segmentation, manual segmentation was carried out by two radiologists and similarity coefficients(Dice and Jaccard) were computed for outer as well as inner tissues. FG density and tumor volume were also computed and analyzed. The proposed outer and inner segmentation approach worked well for all the subjects and was validated by two radiologists. The average Dice and Jaccard coefficients value for outer segmentation using T₂-W images, obtained by two radiologists, were 0.977 and 0.951 respectively. These coefficient values for FG tissue were 0.915 and 0.875 respectively whereas for tumor tissue, values were 0.968 and 0.95 respectively. The volume of segmented tumor ranged over 2.1 cm3–7.08 cm³. The proposed approach provided automatic outer and inner breast tissue segmentation, which enables automatic calculations of breast tissue density and tumor volume. This is a complete framework for outer and inner breast segmentation method for all structural images.

Fully automated detection of breast cancer in screening MRI using convolutional neural networks

Current computer-aided detection (CADe) systems for contrast-enhanced breast MRI rely on both spatial information obtained from the early-phase and temporal information obtained from the late-phase of the contrast enhancement. However, late-phase information might not be available in a screening setting, such as in abbreviated MRI protocols, where acquisition is limited to early-phase scans. We used deep learning to develop a CADe system that exploits the spatial information obtained from the early-phase scans. This system uses three-dimensional (3-D) morphological information in the candidate locations and the symmetry information arising from the enhancement differences of the two breasts. We compared the proposed system to a previously developed system, which uses the full dynamic breast MRI protocol. For training and testing, we used 385 MRI scans, containing 161 malignant lesions. Performance was measured by averaging the sensitivity values between 1/8-eight false positives. In our experiments, the proposed system obtained a significantly ([Formula: see text]) higher average sensitivity ([Formula: see text]) compared with that of the previous CADe system ([Formula: see text]). In conclusion, we developed a CADe system that is able to exploit the spatial information obtained from the early-phase scans and can be used in screening programs where abbreviated MRI protocols are used.

A clinical application of dynamic contrast-enhanced CT (DCE-CT) in patients with variously differentiated breast ductal carcinoma

PURPOSE

To explore the hemodynamic characteristics of variously differentiated breast ductal carcinoma (BDC) using the dynamic contrast-enhanced CT (DCE-CT) based CT perfusion imaging (CTPI), including the specific perfusion parameter values, and to identify potential clinical applications in the cell differentiation degree of BDC.

MATERIALS AND METHODS

Forty patients with breast ductal carcinoma confirmed by needle puncture biopsy were studied prospectively using CTPI on a 64-slice spiral CT scanner. The acquired volume data were used for calculations, mapping, and analysis by using a tumor perfusion protocol in the CT perfusion software package to measure 4 parameters namely, blood flow (BF), blood volume (BV), mean transit time (MTT), and the permeability surface (PS) area product. The different differentiated BDC with CT perfusion parameters were divided into 3 groups of high, moderate and poor differentiation. The comparison among these groups were then made using statistical data analysis software.

RESULTS

The patients were categorized into three groups of 12, 13, and 15 highly, moderately and poorly differentiated ductal carcinoma cases, respectively. Comparing the perfusion parameters values of the three groups, BF, BV, and PS values increased from highly to poorly differentiated BDC cases. Differences between the highly and moderately or poorly differentiated groups were all statistically significant for BF, BV, and PS values (p < 0.05), while MTT value showed no statistical difference among the three groups (p > 0.05).

CONCLUSION

CTPI is a functional imaging technology from the perspective of hemodynamics with potential clinical applications. Three parameters of BF, BV and PS values have potential to serve as indicators of the cell differentiation degree of the breast ductal carcinoma.