Optimizing Case-based detection performance in a multiview CAD system for mammography

Detection of abdominopelvic lymph nodes in multi-parametric MRI

Reliable localization of lymph nodes (LNs) in multi-parametric MRI (mpMRI) studies plays a major role in the assessment of lymphadenopathy and staging of metastatic disease. Radiologists routinely measure the nodal size in order to distinguish benign from malignant nodes, which require subsequent cancer staging. However, identification of lymph nodes is a cumbersome task due to their myriad appearances in mpMRI studies. Multiple sequences are acquired in mpMRI studies, including T2 fat suppressed (T2FS) and diffusion weighted imaging (DWI) sequences among others; consequently, the sizing of LNs is rendered challenging due to the variety of signal intensities in these sequences. Furthermore, radiologists can miss potentially metastatic LNs during a busy clinical day. To lighten these imaging and workflow challenges, we propose a computer-aided detection (CAD) pipeline to detect both benign and malignant LNs in the body for their subsequent measurement. We employed the recently proposed Dynamic Head (DyHead) neural network to detect LNs in mpMRI studies that were acquired using a variety of scanners and exam protocols. The T2FS and DWI series were co-registered, and a selective augmentation technique called Intra-Label LISA (ILL) was used to blend the two volumes with the interpolation factor drawn from a Beta distribution. In this way, ILL diversified the samples that the model encountered during the training phase, while the requirement for both sequences to be present at test time was nullified. Our results showed a mean average precision (mAP) of 53.5% and a sensitivity of ∼78% with ILL at 4 FP/vol. This corresponded to an improvement of ≥10% in mAP and ≥12% in sensitivity at 4FP (p ¡ 0.05) respectively over current LN detection approaches evaluated on the same dataset. We also established the out-of-distribution robustness of the DyHead model by training it on data acquired by a Siemens Aera scanner and testing it on data from the Siemens Verio, Siemens Biograph mMR, and Philips Achieva scanners. Our pilot work represents an important first step towards automated detection, segmentation, and classification of lymph nodes in mpMRI.

Atypical architectural distortion detection in digital breast tomosynthesis: a multi-view computer-aided detection model with ipsilateral learning

Objective.Breast architectural distortion (AD), a common imaging symptom of breast cancer, is associated with a particularly high rate of missed clinical detection. In clinical practice, atypical ADs that lack an obvious radiating appearance constitute most cases, and detection models based on single-view images often exhibit poor performance in detecting such ADs. Existing multi-view deep learning methods have overlooked the correspondence between anatomical structures across different views.Approach.To develop a computer-aided detection (CADe) model for AD detection that effectively utilizes the craniocaudal (CC) and mediolateral oblique (MLO) views of digital breast tomosynthesis (DBT) images, we proposed an anatomic-structure-based multi-view information fusion approach by leveraging the related anatomical structure information between these ipsilateral views. To obtain a representation that can effectively capture the similarity between ADs in images from ipsilateral views, our approach utilizes a Siamese network architecture to extract and compare information from both views. Additionally, we employed a triplet module that utilizes the anatomical structural relationship between the ipsilateral views as supervision information.Main results.Our method achieved a mean true positive fraction (MTPF) of 0.05-2.0, false positives (FPs) per volume of 64.40%, and a number of FPs at 80% sensitivity (FPs@0.8) of 3.5754; this indicates a 6% improvement in MPTF and 16% reduction in FPs@0.8 compared to the state-of-the-art baseline model.Significance.From our experimental results, it can be observed that the anatomic-structure-based fusion of ipsilateral view information contributes significantly to the improvement of CADe model performance for atypical AD detection based on DBT. The proposed approach has the potential to lead to earlier diagnosis and better patient outcomes.

Classification of Breast Cancer Images by Implementing Improved DCNN with Artificial Fish School Model

Breast cancer is an important factor affecting human health. This issue has various diagnosis process which were evolved such as mammography, fine needle aspirate, and surgical biopsy. These techniques use pathological breast cancer images for diagnosis. Breast cancer surgery allows the forensic doctor to histologist to access the microscopic level of breast tissues. The conventional method uses an optimized radial basis neural network using a cuckoo search algorithm. Existing radial basis neural network techniques utilized feature extraction and reduction parts separately. It is proposed that it overcomes the CNN approach for all the feature extraction and classification process to reduce time complexity. In this proposed method, a convolutional neural network is proposed based on an artificial fish school algorithm. The breast cancer image dataset is taken from cancer imaging archives. In the preprocessing step of classification, the breast cancer image is filtered with the support of a wiener filter for classification. The convolutional neural network has set the intense data of an image and is used to remove the features. After executing the extraction procedure, the reduction process is performed to speed up the train and test data processing. Here, the artificial fish school optimization algorithm is utilized to give the direct training data to the deep convolutional neural network. The extraction, reduction, and classification of features are utilized in the single deep convolutional neural network process. In this process, the optimization technique helps to decrease the error rate and increases the performance efficiency by finding the number of epochs and training images to the Deep CNN. In this system, the normal, benign, and malignant tissues are predicted. By comparing the existing RBF technique with the cuckoo search algorithm, the presented model attains the outcome in the way of sensitivity, accuracy, specificity, F1 score, and recall.

Compare and contrast: Detecting mammographic soft-tissue lesions with C2-Net

Detecting breast soft-tissue lesions including masses, structural distortions and asymmetries is of great importance due to the high risk leading to breast cancer. Most existing deep learning based approaches detect lesions with only unilateral images. However, multi-view mammogram images provide highly related and complementary information which helps to make the clinical analysis more comprehensive and reliable. In this paper, we propose a multi-view network for breast soft-tissue lesion detection called C²-Net (Compare and Contrast, C²) that fuses information across different views. The proposed model contains the following three modules. The spatial context enhancing (SCE) module compares ipsilateral views and extracts complementary features to model lesion inherent 3D structure. The multi-scale kernel pooling (MKP) module contrasts contralateral views with added misalignment tolerance. Finally, the logic guided fusion (LGF) module fuses multi-view features by enhancing logic modeling capacity. Experimental results on both the public DDSM dataset and the in-house multi-center dataset demonstrate that the proposed method has achieved state-of-the-art performance.

A new near-term breast cancer risk prediction scheme based on the quantitative analysis of ipsilateral view mammograms

PURPOSE

To help improve efficacy of screening mammography and eventually establish an optimal personalized screening paradigm, this study aimed to develop and test a new near-term breast cancer risk prediction scheme based on the quantitative analysis of ipsilateral view of the negative screening mammograms.

METHODS

The dataset includes digital mammograms acquired from 392 women with two sequential full-field digital mammography examinations. All the first ("prior") sets of mammograms were interpreted as negative during the original reading. In the sequential ("current") screening, 202 were proved positive and 190 remained negative/benign. For each pair of the "prior" ipsilateral mammograms, we adaptively fused the image features computed from two views. Using four different types of image features, we built four elastic net support vector machine (EnSVM) based classifiers. Then, the initial prediction scores form the 4 EnSVMs were combined to build a final artificial neural network (ANN) classifier that produces the final risk prediction score. The performance of the new scheme was evaluated by using a 10-fold cross-validation method and an assessment index of the area under the receiver operating characteristic curve (AUC).

RESULTS

A total number of 466 features were initially extracted from each pair of ipsilateral mammograms. Among them, 51 were selected to build the EnSVM based prediction scheme. The AUC = 0.737 ± 0.052 was yielded using the new scheme. Applying an optimal operating threshold, the prediction sensitivity was 60.4% (122 of 202) and the specificity was 79.0% (150 of 190).

CONCLUSION

The study results showed moderately high positive association between computed risk scores using the "prior" negative mammograms and the actual outcome of the image-detectable breast cancers in the next subsequent screening examinations. The study also demonstrated that quantitative analysis of the ipsilateral views of the mammograms enabled to provide useful information in predicting near-term breast cancer risk.

Automated Analysis of Unregistered Multi-View Mammograms With Deep Learning

We describe an automated methodology for the analysis of unregistered cranio-caudal (CC) and medio-lateral oblique (MLO) mammography views in order to estimate the patient's risk of developing breast cancer. The main innovation behind this methodology lies in the use of deep learning models for the problem of jointly classifying unregistered mammogram views and respective segmentation maps of breast lesions (i.e., masses and micro-calcifications). This is a holistic methodology that can classify a whole mammographic exam, containing the CC and MLO views and the segmentation maps, as opposed to the classification of individual lesions, which is the dominant approach in the field. We also demonstrate that the proposed system is capable of using the segmentation maps generated by automated mass and micro-calcification detection systems, and still producing accurate results. The semi-automated approach (using manually defined mass and micro-calcification segmentation maps) is tested on two publicly available data sets (INbreast and DDSM), and results show that the volume under ROC surface (VUS) for a 3-class problem (normal tissue, benign, and malignant) is over 0.9, the area under ROC curve (AUC) for the 2-class "benign versus malignant" problem is over 0.9, and for the 2-class breast screening problem (malignancy versus normal/benign) is also over 0.9. For the fully automated approach, the VUS results on INbreast is over 0.7, and the AUC for the 2-class "benign versus malignant" problem is over 0.78, and the AUC for the 2-class breast screening is 0.86.

Multi-View Probabilistic Classification of Breast Microcalcifications

Classification of clustered breast microcalcifications into benign and malignant categories is an extremely challenging task for computerized algorithms and expert radiologists alike. In this paper we apply a multi-view-classifier for the task. We describe a two-step classification method that is based on a view-level decision, implemented by a logistic regression classifier, followed by a stochastic combination of the two view-level indications into a single benign or malignant decision. The proposed method was evaluated on a large number of cases from a standardized digital database for screening mammography (DDSM). Experimental results demonstrate the advantage of the proposed multi-view classification algorithm that automatically learns the best way to combine the views.

Predicting malignancy from mammography findings and image-guided core biopsies

The main goal of this work is to produce machine learning models that predict the outcome of a mammography from a reduced set of annotated mammography findings. In the study we used a dataset consisting of 348 consecutive breast masses that underwent image guided core biopsy performed between October 2005 and December 2007 on 328 female subjects. We applied various algorithms with parameter variation to learn from the data. The tasks were to predict mass density and to predict malignancy. The best classifier that predicts mass density is based on a support vector machine and has accuracy of 81.3%. The expert correctly annotated 70% of the mass densities. The best classifier that predicts malignancy is also based on a support vector machine and has accuracy of 85.6%, with a positive predictive value of 85%. One important contribution of this work is that our model can predict malignancy in the absence of the mass density attribute, since we can fill up this attribute using our mass density predictor.

Breast mass detection using slice conspicuity in 3D reconstructed digital breast volumes

In digital breast tomosynthesis, the three dimensional (3D) reconstructed volumes only provide quasi-3D structure information with limited resolution along the depth direction due to insufficient sampling in depth direction and the limited angular range. The limitation could seriously hamper the conventional 3D image analysis techniques for detecting masses because the limited number of projection views causes blurring in the out-of-focus planes. In this paper, we propose a novel mass detection approach using slice conspicuity in the 3D reconstructed digital breast volumes to overcome the above limitation. First, to overcome the limited resolution along the depth direction, we detect regions of interest (ROIs) on each reconstructed slice and separately utilize the depth directional information to combine the ROIs effectively. Furthermore, we measure the blurriness of each slice for resolving the degradation of performance caused by the blur in the out-of-focus plane. Finally, mass features are extracted from the selected in focus slices and analyzed by a support vector machine classifier to reduce the false positives. Comparative experiments have been conducted on a clinical data set. Experimental results demonstrate that the proposed approach outperforms the conventional 3D approach by achieving a high sensitivity with a small number of false positives.

Mass detection in reconstructed digital breast tomosynthesis volumes with a computer-aided detection system trained on 2D mammograms

PURPOSE

To develop a computer-aided detection (CAD) system for masses in digital breast tomosynthesis (DBT) which can make use of an existing CAD system for detection of breast masses in full-field digital mammography (FFDM). This approach has the advantage that large digital screening databases that are becoming available can be used for training. DBT is currently not used for screening which makes it hard to obtain sufficient data for training.

METHODS

The proposed CAD system is applied to reconstructed DBT volumes and consists of two stages. In the first stage, an existing 2D CAD system is applied to slabs composed of multiple DBT slices, after processing the slabs to a representation similar to that of the FFDM training data. In the second stage, the authors group detections obtained in the slabs that detect the same object and determine the 3D location of the grouped findings using one of three different approaches, including one that uses a set of features extracted from the DBT slabs. Experiments were conducted to determine performance of the CAD system, the optimal slab thickness for this approach and the best method to establish the 3D location. Experiments were performed using a database of 192 patients (752 DBT volumes). In 49 patients, one or more malignancies were present which were described as a mass, architectural distortion, or asymmetry. Free response receiver operating characteristic analysis and bootstrapping were used for statistical evaluation.

RESULTS

Best performance was obtained when slab thickness was in the range of 1-2 cm. Using the feature based 3D localization procedure developed in the study, accurate 3D localization could be obtained in most cases. Case sensitivities of 80% and 90% were achieved at 0.35 and 0.99 false positives per volume, respectively.

CONCLUSIONS

This study indicates that there may be a large benefit in using 2D mammograms for the development of CAD for DBT and that there is no need to exclusively limit development to DBT data.

Detection of architectural distortion in prior mammograms via analysis of oriented patterns

We demonstrate methods for the detection of architectural distortion in prior mammograms of interval-cancer cases based on analysis of the orientation of breast tissue patterns in mammograms. We hypothesize that architectural distortion modifies the normal orientation of breast tissue patterns in mammographic images before the formation of masses or tumors. In the initial steps of our methods, the oriented structures in a given mammogram are analyzed using Gabor filters and phase portraits to detect node-like sites of radiating or intersecting tissue patterns. Each detected site is then characterized using the node value, fractal dimension, and a measure of angular dispersion specifically designed to represent spiculating patterns associated with architectural distortion. Our methods were tested with a database of 106 prior mammograms of 56 interval-cancer cases and 52 mammograms of 13 normal cases using the features developed for the characterization of architectural distortion, pattern classification via quadratic discriminant analysis, and validation with the leave-one-patient out procedure. According to the results of free-response receiver operating characteristic analysis, our methods have demonstrated the capability to detect architectural distortion in prior mammograms, taken 15 months (on the average) before clinical diagnosis of breast cancer, with a sensitivity of 80% at about five false positives per patient.

Breast image analysis for risk assessment, detection, diagnosis, and treatment of cancer

The role of breast image analysis in radiologists' interpretation tasks in cancer risk assessment, detection, diagnosis, and treatment continues to expand. Breast image analysis methods include segmentation, feature extraction techniques, classifier design, biomechanical modeling, image registration, motion correction, and rigorous methods of evaluation. We present a review of the current status of these task-based image analysis methods, which are being developed for the various image acquisition modalities of mammography, tomosynthesis, computed tomography, ultrasound, and magnetic resonance imaging. Depending on the task, image-based biomarkers from such quantitative image analysis may include morphological, textural, and kinetic characteristics and may depend on accurate modeling and registration of the breast images. We conclude with a discussion of future directions.

Standalone computer-aided detection compared to radiologists' performance for the detection of mammographic masses

OBJECTIVES

We developed a computer-aided detection (CAD) system aimed at decision support for detection of malignant masses and architectural distortions in mammograms. The effect of this system on radiologists' performance depends strongly on its standalone performance. The purpose of this study was to compare the standalone performance of this CAD system to that of radiologists.

METHODS

In a retrospective study, nine certified screening radiologists and three residents read 200 digital screening mammograms without the use of CAD. Performances of the individual readers and of CAD were computed as the true-positive fraction (TPF) at a false-positive fraction of 0.05 and 0.2. Differences were analysed using an independent one-sample t-test.

RESULTS

At a false-positive fraction of 0.05, the performance of CAD (TPF = 0.487) was similar to that of the certified screening radiologists (TPF = 0.518, P = 0.17). At a false-positive fraction of 0.2, CAD performance (TPF = 0.620) was significantly lower than the radiologist performance (TPF = 0.736, P <0.001). Compared to the residents, CAD performance was similar for all false-positive fractions.

CONCLUSIONS

The sensitivity of CAD at a high specificity was comparable to that of human readers. These results show potential for CAD to be used as an independent reader in breast cancer screening.

Retrieval boosted computer-aided diagnosis of clustered microcalcifications for breast cancer

PURPOSE

The authors propose an image-retrieval based approach for case-adaptive classifier design in computer-aided diagnosis (CADx). The conventional approach in CADx is to first train a pattern-classifier based on a set of existing training samples and then apply this classifier to subsequent new cases. The purpose of this work is to improve the classification accuracy of a CADx classifier by making use of a set of known cases retrieved from a reference library that are similar to the case under consideration.

METHODS

In the proposed approach, the authors will first apply image-retrieval to obtain a set of lesion images from a library of known cases that have similar image features to a case being diagnosed (i.e., query). These retrieved cases are then used to optimize a pattern-classifier toward boosting its classification accuracy on the query case. The basic idea is to put more emphasis on those cases that are similar to the query. The proposed approach is demonstrated first using a linear classifier and then extended to a nonlinear classifier induced by kernel principal component analysis.

RESULTS

The proposed retrieval-driven approach was tested on a library of mammogram images from 1006 cases (646 benign and 360 malignant) obtained from multiple institutions and was demonstrated to yield significant improvement in classification performance. Measured by the area under the receiver operating characteristic curve (AUC), the case-adaptive approach could boost the classification performance of a linear classifier from AUC = 0.7415 to AUC = 0.7807; similar improvement was also obtained for a nonlinear classifier, with AUC boosted from 0.7527 to 0.7838.

CONCLUSIONS

Use of additional cases from a reference library that have similar image features can improve the classification accuracy of a CADx classifier on a query case. It can even outperform retraining the classifier with all the cases from the entire reference library. This implies that cases with similar image features are more relevant in defining the local decision boundary of the CADx classifier around the query.

Predicting Malignancy from Mammography Findings and Surgical Biopsies

Breast screening is the regular examination of a woman's breasts to find breast cancer earlier. The sole exam approved for this purpose is mammography. Usually, findings are annotated through the Breast Imaging Reporting and Data System (BIRADS) created by the American College of Radiology. The BIRADS system determines a standard lexicon to be used by radiologists when studying each finding. Although the lexicon is standard, the annotation accuracy of the findings depends on the experience of the radiologist. Moreover, the accuracy of the classification of a mammography is also highly dependent on the expertise of the radiologist. A correct classification is paramount due to economical and humanitarian reasons. The main goal of this work is to produce machine learning models that predict the outcome of a mammography from a reduced set of annotated mammography findings. In the study we used a data set consisting of 348 consecutive breast masses that underwent image guided or surgical biopsy performed between October 2005 and December 2007 on 328 female subjects. The main conclusions are threefold: (1) automatic classification of a mammography, independent on information about mass density, can reach equal or better results than the classification performed by a physician; (2) mass density seems to be a good indicator of malignancy, as previous studies suggested; (3) a machine learning model can predict mass density with a quality as good as the specialist blind to biopsy, which is one of our main contributions. Our model can predict malignancy in the absence of the mass density attribute, since we can fill up this attribute using our mass density predictor.