Breast Ultrasound Image Classification and Segmentation Using Convolutional Neural Networks

Development of a Novel CNN Architecture for Improved Diagnosis from Liver Ultrasound Tumor Images

Malignant liver tumors are considered as one of the most common cancers and a leading cause of cancer death worldwide. While using convolutional neural networks (CNNs) for feature extraction from ultrasound (US) images and tasks thereafter, most works focus on pre-trained architectures using transfer learning which can sometimes cause negative transfer and reduced performance in medical domain. A new method based on Pascal’s Triangle was developed for feature extraction using CNN. The convolutions and the kernels in Pascal’s Triangle based CNN (PT-CNN) are according to the coefficients at each level of Pascal’s Triangle. Due to the fuzzy nature of US images, the input layer takes a combination of the image and its neutrosophically pre-processed components as a single unit to improve noise robustness. The proposed CNN when implemented as a backbone for feature extraction for binary classification, gave validation accuracy > 90% and test accuracy >95% than other state-of-the-art CNN architectures. For tumor segmentation using Mask R-CNN framework, the aggregated feature maps from all convolutional layers were given as the input to the region proposal network for multiscale region proposals and to facilitate the detection of tumors of varying sizes. This gave an F1 score > 0.95 when compared with other architectures as backbone on Mask R-CNN framework and simple U-Net based segmentation. It is suggested that the promising results of PT-CNN as a feature extraction backbone could be further investigated in other domains.

A Multi-Task Learning Framework for Automated Segmentation and Classification of Breast Tumors From Ultrasound Images

Breast cancer is one of the most fatal diseases leading to the death of several women across the world. But early diagnosis of breast cancer can help to reduce the mortality rate. So an efficient multi-task learning approach is proposed in this work for the automatic segmentation and classification of breast tumors from ultrasound images. The proposed learning approach consists of an encoder, decoder, and bridge blocks for segmentation and a dense branch for the classification of tumors. For efficient classification, multi-scale features from different levels of the network are used. Experimental results show that the proposed approach is able to enhance the accuracy and recall of segmentation by 1.08%, 4.13%, and classification by 1.16%, 2.34%, respectively than the methods available in the literature.

LRSCnet: Local Reference Semantic Code learning for breast tumor classification in ultrasound images

Purpose

This study proposed a novel Local Reference Semantic Code (LRSC) network for automatic breast ultrasound image classification with few labeled data.

Methods

In the proposed network, the local structure extractor is firstly developed to learn the local reference which describes common local characteristics of tumors. After that, a two-stage hierarchical encoder is developed to encode the local structures of lesion into the high-level semantic code. Based on the learned semantic code, the self-matching layer is proposed for the final classification.

Results

In the experiment, the proposed method outperformed traditional classification methods and AUC (Area Under Curve), ACC (Accuracy), Sen (Sensitivity), Spec (Specificity), PPV (Positive Predictive Values), and NPV(Negative Predictive Values) are 0.9540, 0.9776, 0.9629, 0.93, 0.9774 and 0.9090, respectively. In addition, the proposed method also improved matching speed.

Conclusions

LRSC-network is proposed for breast ultrasound images classification with few labeled data. In the proposed network, a two-stage hierarchical encoder is introduced to learn high-level semantic code. The learned code contains more effective high-level classification information and is simpler, leading to better generalization ability.

Automatic semantic segmentation of breast tumors in ultrasound images based on combining fuzzy logic and deep learning-A feasibility study

Computer aided diagnosis (CAD) of biomedical images assists physicians for a fast facilitated tissue characterization. A scheme based on combining fuzzy logic (FL) and deep learning (DL) for automatic semantic segmentation (SS) of tumors in breast ultrasound (BUS) images is proposed. The proposed scheme consists of two steps: the first is a FL based preprocessing, and the second is a Convolutional neural network (CNN) based SS. Eight well-known CNN based SS models have been utilized in the study. Studying the scheme was by a dataset of 400 cancerous BUS images and their corresponding 400 ground truth images. SS process has been applied in two modes: batch and one by one image processing. Three quantitative performance evaluation metrics have been utilized: global accuracy (GA), mean Jaccard Index (mean intersection over union (IoU)), and mean BF (Boundary F1) Score. In the batch processing mode: quantitative metrics’ average results over the eight utilized CNNs based SS models over the 400 cancerous BUS images were: 95.45% GA instead of 86.08% without applying fuzzy preprocessing step, 78.70% mean IoU instead of 49.61%, and 68.08% mean BF score instead of 42.63%. Moreover, the resulted segmented images could show tumors’ regions more accurate than with only CNN based SS. While, in one by one image processing mode: there has been no enhancement neither qualitatively nor quantitatively. So, only when a batch processing is needed, utilizing the proposed scheme may be helpful in enhancing automatic ss of tumors in BUS images. Otherwise applying the proposed approach on a one-by-one image mode will disrupt segmentation’s efficiency. The proposed batch processing scheme may be generalized for an enhanced CNN based SS of a targeted region of interest (ROI) in any batch of digital images. A modified small dataset is available: https://www.kaggle.com/mohammedtgadallah/mt-small-dataset (S1 Data).