A deep learning model based on dynamic contrast-enhanced magnetic resonance imaging enables accurate prediction of benign and malignant breast lessons

A twin convolutional neural network with hybrid binary optimizer for multimodal breast cancer digital image classification

There is a wide application of deep learning technique to unimodal medical image analysis with significant classification accuracy performance observed. However, real-world diagnosis of some chronic diseases such as breast cancer often require multimodal data streams with different modalities of visual and textual content. Mammography, magnetic resonance imaging (MRI) and image-guided breast biopsy represent a few of multimodal visual streams considered by physicians in isolating cases of breast cancer. Unfortunately, most studies applying deep learning techniques to solving classification problems in digital breast images have often narrowed their study to unimodal samples. This is understood considering the challenging nature of multimodal image abnormality classification where the fusion of high dimension heterogeneous features learned needs to be projected into a common representation space. This paper presents a novel deep learning approach combining a dual/twin convolutional neural network (TwinCNN) framework to address the challenge of breast cancer image classification from multi-modalities. First, modality-based feature learning was achieved by extracting both low and high levels features using the networks embedded with TwinCNN. Secondly, to address the notorious problem of high dimensionality associated with the extracted features, binary optimization method is adapted to effectively eliminate non-discriminant features in the search space. Furthermore, a novel method for feature fusion is applied to computationally leverage the ground-truth and predicted labels for each sample to enable multimodality classification. To evaluate the proposed method, digital mammography images and digital histopathology breast biopsy samples from benchmark datasets namely MIAS and BreakHis respectively. Experimental results obtained showed that the classification accuracy and area under the curve (AUC) for the single modalities yielded 0.755 and 0.861871 for histology, and 0.791 and 0.638 for mammography. Furthermore, the study investigated classification accuracy resulting from the fused feature method, and the result obtained showed that 0.977, 0.913, and 0.667 for histology, mammography, and multimodality respectively. The findings from the study confirmed that multimodal image classification based on combination of image features and predicted label improves performance. In addition, the contribution of the study shows that feature dimensionality reduction based on binary optimizer supports the elimination of non-discriminant features capable of bottle-necking the classifier.

AI-Based Cancer Detection Model for Contrast-Enhanced Mammography

BACKGROUND

The recent development of deep neural network models for the analysis of breast images has been a breakthrough in computer-aided diagnostics (CAD). Contrast-enhanced mammography (CEM) is a recent mammography modality providing anatomical and functional imaging of the breast. Despite the clinical benefits it could bring, only a few research studies have been conducted around deep-learning (DL) based CAD for CEM, especially because the access to large databases is still limited. This study presents the development and evaluation of a CEM-CAD for enhancing lesion detection and breast classification.

MATERIALS & METHODS

A deep learning enhanced cancer detection model based on a YOLO architecture has been optimized and trained on a large CEM dataset of 1673 patients (7443 images) with biopsy-proven lesions from various hospitals and acquisition systems. The evaluation was conducted using metrics derived from the free receiver operating characteristic (FROC) for the lesion detection and the receiver operating characteristic (ROC) to evaluate the overall breast classification performance. The performances were evaluated for different types of image input and for each patient background parenchymal enhancement (BPE) level.

RESULTS

The optimized model achieved an area under the curve (AUROC) of 0.964 for breast classification. Using both low-energy and recombined image as inputs for the DL model shows greater performance than using only the recombined image. For the lesion detection, the model was able to detect 90% of all cancers with a false positive (non-cancer) rate of 0.128 per image. This study demonstrates a high impact of BPE on classification and detection performance.

CONCLUSION

The developed CEM CAD outperforms previously published papers and its performance is comparable to radiologist-reported classification and detection capability.