Dynamic multiple thresholding breast boundary detection algorithm for mammograms

Mass Detection and Segmentation in Digital Breast Tomosynthesis Using 3D-Mask Region-Based Convolutional Neural Network: A Comparative Analysis

Digital breast tomosynthesis (DBT) is an emerging breast cancer screening and diagnostic modality that uses quasi-three-dimensional breast images to provide detailed assessments of the dense tissue within the breast. In this study, a framework of a 3D-Mask region-based convolutional neural network (3D-Mask RCNN) computer-aided diagnosis (CAD) system was developed for mass detection and segmentation with a comparative analysis of performance on patient subgroups with different clinicopathological characteristics. To this end, 364 samples of DBT data were used and separated into a training dataset (n = 201) and a testing dataset (n = 163). The detection and segmentation results were evaluated on the testing set and on subgroups of patients with different characteristics, including different age ranges, lesion sizes, histological types, lesion shapes and breast densities. The results of our 3D-Mask RCNN framework were compared with those of the 2D-Mask RCNN and Faster RCNN methods. For lesion-based mass detection, the sensitivity of 3D-Mask RCNN-based CAD was 90% with 0.8 false positives (FPs) per lesion, whereas the sensitivity of the 2D-Mask RCNN- and Faster RCNN-based CAD was 90% at 1.3 and 2.37 FPs/lesion, respectively. For breast-based mass detection, the 3D-Mask RCNN generated a sensitivity of 90% at 0.83 FPs/breast, and this framework is better than the 2D-Mask RCNN and Faster RCNN, which generated a sensitivity of 90% with 1.24 and 2.38 FPs/breast, respectively. Additionally, the 3D-Mask RCNN achieved significantly (p < 0.05) better performance than the 2D methods on subgroups of samples with characteristics of ages ranged from 40 to 49 years, malignant tumors, spiculate and irregular masses and dense breast, respectively. Lesion segmentation using the 3D-Mask RCNN achieved an average precision (AP) of 0.934 and a false negative rate (FNR) of 0.053, which are better than those achieved by the 2D methods. The results suggest that the 3D-Mask RCNN CAD framework has advantages over 2D-based mass detection on both the whole data and subgroups with different characteristics.

Computer-aided detection of mass in digital breast tomosynthesis using a faster region-based convolutional neural network

Digital breast tomosynthesis (DBT) is a newly developed three-dimensional tomographic imaging modality in the field of breast cancer screening designed to alleviate the limitations of conventional digital mammography-based breast screening methods. A computer-aided detection (CAD) system was designed for masses in DBT using a faster region-based convolutional neural network (faster-RCNN). To this end, a data set was collected, including 89 patients with 105 masses. An efficient detection architecture of convolution neural network with a region proposal network (RPN) was used for each slice to generate region proposals (i.e., bounding boxes) with a mass likelihood score. In each DBT volume, a slice fusion procedure was used to merge the detection results on consecutive 2D slices into one 3D DBT volume. The performance of the CAD system was evaluated using free-response receiver operating characteristic (FROC) curves. Our RCNN-based CAD system was compared with a deep convolutional neural network (DCNN)-based CAD system. The RCNN-based CAD generated a performance with an area under the ROC (AUC) of 0.96, whereas the DCNN-based CAD achieved a performance with AUC of 0.92. For lesion-based mass detection, the sensitivity of RCNN-based CAD was 90% at 1.54 false positive (FP) per volume, whereas the sensitivity of DCNN-based CAD was 90% at 2.81 FPs/volume. For breast-based mass detection, RCNN-based CAD generated a sensitivity of 90% at 0.76 FP/breast, which is significantly increased compared with the DCNN-based CAD with a sensitivity of 90% at 2.25 FPs/breast. The results suggest that the faster R-CNN has the potential to augment the prescreening and FP reduction in the CAD system for masses.

Detector Blur and Correlated Noise Modeling for Digital Breast Tomosynthesis Reconstruction

This paper describes a new image reconstruction method for digital breast tomosynthesis (DBT). The new method incorporates detector blur into the forward model. The detector blur in DBT causes correlation in the measurement noise. By making a few approximations that are reasonable for breast imaging, we formulated a regularized quadratic optimization problem with a data-fit term that incorporates models for detector blur and correlated noise (DBCN). We derived a computationally efficient separable quadratic surrogate (SQS) algorithm to solve the optimization problem that has a non-diagonal noise covariance matrix. We evaluated the SQS-DBCN method by reconstructing DBT scans of breast phantoms and human subjects. The contrast-to-noise ratio and sharpness of microcalcifications were analyzed and compared with those by the simultaneous algebraic reconstruction technique. The quality of soft tissue lesions and parenchymal patterns was examined. The results demonstrate the potential to improve the image quality of reconstructed DBT images by incorporating the system physics model. This paper is a first step toward model-based iterative reconstruction for DBT.

Improving image quality for digital breast tomosynthesis: an automated detection and diffusion-based method for metal artifact reduction

In digital breast tomosynthesis (DBT), the high-attenuation metallic clips marking a previous biopsy site in the breast cause errors in the estimation of attenuation along the ray paths intersecting the markers during reconstruction, which result in interplane and inplane artifacts obscuring the visibility of subtle lesions. We proposed a new metal artifact reduction (MAR) method to improve image quality. Our method uses automatic detection and segmentation to generate a marker location map for each projection (PV). A voting technique based on the geometric correlation among different PVs is designed to reduce false positives (FPs) and to label the pixels on the PVs and the voxels in the imaged volume that represent the location and shape of the markers. An iterative diffusion method replaces the labeled pixels on the PVs with estimated tissue intensity from the neighboring regions while preserving the original pixel values in the neighboring regions. The inpainted PVs are then used for DBT reconstruction. The markers are repainted on the reconstructed DBT slices for radiologists' information. The MAR method is independent of reconstruction techniques or acquisition geometry. For the training set, the method achieved 100% success rate with one FP in 19 views. For the test set, the success rate by view was 97.2% for core biopsy microclips and 66.7% for clusters of large post-lumpectomy markers with a total of 10 FPs in 58 views. All FPs were large dense benign calcifications that also generated artifacts if they were not corrected by MAR. For the views with successful detection, the metal artifacts were reduced to a level that was not visually apparent in the reconstructed slices. The visibility of breast lesions obscured by the reconstruction artifacts from the metallic markers was restored.

Iterative fuzzy segmentation for an accurate delimitation of the breast region

In mammographic images, extracting different anatomical structures and tissues types is a critical requirement for the breast cancer diagnosis. For instance, separating breast and background regions increases the accuracy and efficiency of mammographic processing algorithms. In this paper, we propose a new region-based method to properly segment breast and background regions in mammographic images. These regions are estimated by an Iterative Fuzzy Breast Segmentation method (IFBS). Based on the Fuzzy C-Means (FCM) algorithm, IFBS method iteratively increases the precision of an initially extracted breast region. This proposal is evaluated using the MIAS database. Experimental results show high accuracy and reliability in breast extraction when compared with Ground-Truth (GT) images.

CT-PET weighted image fusion for separately scanned whole body rat

PURPOSE

The limited resolution and lack of spatial information in positron emission tomography (PET) images require the complementary anatomic information from the computed tomography (CT) and/or magnetic resonance imaging (MRI). Therefore, multimodality image fusion techniques such as PET/CT are critical in mapping the functional images to structural images and thus facilitate the interpretation of PET studies. In our experimental situation, the CT and PET images are acquired in separate scanners at different times and the inherent differences in the imaging protocols produce significant nonrigid changes between the two acquisitions in addition to dissimilar image characteristics. The registration conditions are also poor because CT images have artifacts due to the limitation of current scanning settings, while PET images are very blurry (in transmission-PET) and have vague anatomical structure boundaries (in emission-PET).

METHODS

The authors present a new method for whole body small animal multimodal registration. In particular, the authors register whole body rat CT image and PET images using a weighted demons algorithm. The authors use both the transmission-PET and the emission-PET images in the registration process emphasizing particular regions of the moving transmission-PET image using the emission-PET image. After a rigid transformation and a histogram matching between the CT and the transmission-PET images, the authors deformably register the transmission-PET image to the CT image with weights based on the intensity-normalized emission-PET image. For the deformable registration process, the authors develop a weighted demons registration method that can give preferences to particular regions of the input image using a weight image.

RESULTS

The authors validate the results with nine rat image sets using the M-Hausdorff distance (M-HD) similarity measure with different outlier-suppression parameters (OSP). In comparison with standard methods such as the regular demons and the normalized mutual information (NMI)-based nonrigid free-form deformation (FFD) registration, the proposed weighted demons registration method shows average M-HD errors: 3.99 ± 1.37 (OSP = 10), 5.04 ± 1.59 (OSP = 20) and 5.92 ± 1.61 (OSP = ∞) with statistical significance (p < 0.0003) respectively, while NMI-based nonrigid FFD has average M-HD errors: 5.74 ± 1.73 (OSP = 10), 7.40 ± 7.84 (OSP = 20) and 9.83 ± 4.13 (OSP = ∞), and the regular demons has average M-HD errors: 6.79 ± 0.83 (OSP = 10), 9.19 ± 2.39 (OSP = 20) and 11.63 ± 3.99 (OSP = ∞), respectively. In addition to M-HD comparisons, the visual comparisons on the faint-edged region between the CT and the aligned PET images also show the encouraging improvements over the other methods.

CONCLUSIONS

In the whole body multimodal registration between CT and PET images, the utilization of both the transmission-PET and the emission-PET images in the registration process by emphasizing particular regions of the transmission-PET image using an emission-PET image is effective. This method holds promise for other image fusion applications where multiple (more than two) input images should be registered into a single informative image.

Breast skin-line detection using dynamic programming

In this paper, we present a novel method to extract the breast skin-line based on dynamic programming. Skin-line extraction is an important preprocessing step in CAD systems; however, it is a challenging problem due to the presence of noise, underexposed regions, which results in a low contrast area near the skin-air interface, and artifacts such as labels. Our proposal utilizes the stroma edge to constrain searching for the border. In order to cope with noise, we consider several candidate points for the border interface which are obtained by the Laplace operator applied in pre-defined directions in the mammogram. The breast contour is obtained from the candidate points using a dynamic programming algorithm. This utilizes a criterion of optimality to obtain the optimum contour by minimization of a cost function. The method was evaluated using 82 mammograms whose contour were manually extracted by a radiologist from the mini-MIAS database. The Polyline Distance Measure was evaluated for each contour selected with the proposed method, obtaining a mean error of 2.05 pixels and a standard deviation of 0.80.