Detection of masses based on asymmetric regions of digital bilateral mammograms using spatial description with variogram and cross-variogram functions

The textures of sarcoidosis: quantifying lung disease through variograms

Objective

Sarcoidosis is a granulomatous disease affecting the lungs in over 90% of patients. Qualitative assessment of chest CT by radiologists is standard clinical practice and reliable quantification of disease from CT would support ongoing efforts to identify sarcoidosis phenotypes. Standard imaging feature engineering techniques such as radiomics suffer from extreme sensitivity to image acquisition and processing, potentially impeding generalizability of research to clinical populations. In this work, we instead investigate approaches to engineering variogram-based features with the intent to identify a robust, generalizable pipeline for image quantification in the study of sarcoidosis.

Approach

For a cohort of more than 300 individuals with sarcoidosis, we investigated 24 feature engineering pipelines differing by decisions for image registration to a template lung, empirical and model variogram estimation methods, and feature harmonization for CT scanner model, and subsequently 48 sets of phenotypes produced through unsupervised clustering. We then assessed sensitivity of engineered features, phenotypes produced through unsupervised clustering, and sarcoidosis disease signal strength to pipeline.

Main results

We found that variogram features had low to mild association with scanner model and associations were reduced by image registration. For each feature type, features were also typically robust to all pipeline decisions except image registration. Strength of disease signal as measured by association with pulmonary function testing and some radiologist visual assessments was strong (optimistic AUC ≈ 0.9, p ≪ 0.0001 in models for architectural distortion, conglomerate mass, fibrotic abnormality, and traction bronchiectasis) and fairly consistent across engineering approaches regardless of registration and harmonization for CT scanner.

Significance

Variogram-based features appear to be a suitable approach to image quantification in support of generalizable research in pulmonary sarcoidosis.

Bilateral Analysis Boosts the Performance of Mammography-based Deep Learning Models in Breast Cancer Risk Prediction

Breast cancer is one of the leading causes of death among women. Early prediction of breast cancer can significantly improve the survival rates. Breast density was proven as a reliable risk factor. Deep learning models can learn subtle cues in the mammogram images. CNN models were recently shown to improve the risk discrimination in full-field mammograms. This study aims to improve risk prediction models using bilateral analysis. Bilateral analysis is the process of comparing two breasts to verify presence of anomalies. We developed a Siamese neural network to leverage the bilateral information and asymmetries between the two mammograms of the same patient. We tested our model on 271 patients and compared the results of our Siamese model against the traditional unilateral CNN model. Our results showed AUCs of 0.75 and 0.70 respectively (p = 0.0056). The Siamese model also exhibits higher sensitivity, specificity, precision, and false positive rate with values of 0.68, 0.69, 0.71, 0.31 respectively. While the CNN values were 0.61, 0.66, 0.67, 0.34 respectively. We merged both models by two techniques using pre-trained weights and weighted voting ensemble. The merging technique boosted the AUC to 0.78. The results suggest that bilateral analysis can significantly improve the risk discrimination.

Texture Analysis and its Applications in Biomedical Imaging: A Survey

Texture analysis describes a variety of image analysis techniques that quantify the variation in intensity and pattern. This paper provides an overview of several texture analysis approaches addressing the rationale supporting them, their advantages, drawbacks, and applications. This surveys emphasis is in collecting and categorising over five decades of active research on texture analysis. Brief descriptions of different approaches are presented along with application examples. From a broad range of texture analysis applications, this surveys final focus is on biomedical image analysis. An up-to-date list of biological tissues and organs in which disorders produce texture changes that may be used to spot disease onset and progression is provided. Finally, the role of texture analysis methods as biomarkers of disease is summarised.

Detecting Asymmetric Patterns and Localizing Cancers on Mammograms

One in eight women develops invasive breast cancer in her lifetime. The frontline protection against this disease is mammography. While computer-assisted diagnosis algorithms have made great progress in generating reliable global predictions, few focus on simultaneously producing regions of interest (ROIs) for biopsy. Can we combine ROI-oriented algorithms with global classification of cancer status, which simultaneously highlight suspicious regions and optimize classification performance? Can the asymmetry of breasts be adopted in deep learning for finding lesions and classifying cancers? We answer the above questions by building deep-learning networks that identify masses and microcalcifications in paired mammograms, exclude false positives, and stepwisely improve performance of the model with asymmetric information regarding the breasts. This method achieved a co-leading place in the Digital Mammography DREAM Challenge for predicting breast cancer. We highlight here the importance of this dual-purpose process that simultaneously provides the locations of potential lesions in mammograms.

•

A top-performing algorithm in the International DREAM Digital Mammography Challenge

•

Shows efficacy of asymmetric information from opposite breasts in identifying cancers

•

Integrated pixel-level localization and overall classification into the same software

Breast cancer affects one out of eight women in their lifetime. Given the importance of the need, in this work we present a region-of-interest-oriented deep-learning pipeline for detecting and locating breast cancers based on digital mammograms. It is a leading algorithm in the well-received Digital Mammography DREAM Challenge, in which computational methods were evaluated on large-scale, held-out testing sets of digital mammograms. This algorithm connects two aims: (1) determining whether a breast has cancer and (2) determining cancer-associated regions of interest. Particularly, we addressed the challenge of variation of mammogram images across different patients by pairing up the two opposite breasts to examine asymmetry, which substantially improved global classification as well as local lesion detection. We have dockerized this code, envisioning that it will be widely used in practice and as a future reference for digital mammography analysis.

Mass detection in mammograms by bilateral analysis using convolution neural network

BACKGROUND AND OBJECTIVE

Automatic detection of the masses in mammograms is a big challenge and plays a crucial role to assist radiologists for accurate diagnosis. In this paper, a bilateral image analysis method based on Convolution Neural Network (CNN) is developed for mass detection in mammograms.

METHODS

The proposed bilateral mass detection method consists of two networks: a registration network for registering bilateral mammograms and a Siamese-Faster-RCNN network for mass detection using a pair of registered mammograms. In the first step, self-supervised learning network is built to learn the spatial transformation between bilateral mammograms. This network can directly estimate spatial transformation by maximizing an image-wise similarity metric and corresponding points labeling is not needed. In the second step, an end-to-end network combining the Region Proposal Network (RPN) and a Siamese Fully Connected (Siamese-FC) network is designed. Different from existing methods, the designed network integrates mass detection on single image with registered bilateral images comparison.

RESULTS

The proposed method is evaluated on three datasets (publicly available dataset INbreast and private dataset BCPKUPH and TXMD). For INbreast dataset, the proposed method achieves 0.88 true positive rate (TPR) with 1.12 false positives per image (FPs/I). For BCPKUPH dataset, the proposed method achieves 0.85 TPR with 1.86 FPs/I. For TXMD dataset, the proposed method achieves 0.85 TPR with 2.70 FPs/I.

CONCLUSIONS

Registration experimental result shows that the proposed method is suitable for bilateral mass detection. Mass detection experimental results show that the proposed method performs better than unilateral mass detection method, different bilateral connection schemes and image level fusion bilateral schemes.

Assessment and Classification of Mass Lesions Based on Expert Knowledge Using Mammographic Analysis

BACKGROUND

Masses are one of the most important indicators of breast cancer in mammograms, and their classification into two groups as benign and malignant is highly necessary. Computer Aided Diagnosis (CADx) helps radiologists enhance the accuracy of their decision. Hence, the system is required to support and assess with radiologist's interaction as an expert.

METHODS

In this research, classification of breast masses using mammography in the two main views which include MLO and CC, is evaluated with respect to the shape, texture and asymmetry aspect. Additionally, a method was developed and proposed using the classification of breast tissue density based on the decision tree.

DISCUSSION

This study therefore, aims to provide a method based on the human decision-making model that will help in designing the perfect tool for radiologists, regardless of the complexity of computing, costly procedures and also reducing the diagnosis error.

CONCLUSION

Results show that the proposed system for entirely fat, scattered fibroglandular densities, heterogeneously dense, and extremely dense breast achieved 100, 99, 99 and 98% true malignant rate, respectively with cross-validation procedure.

Detection of mass regions in mammograms by bilateral analysis adapted to breast density using similarity indexes and convolutional neural networks

BACKGROUND AND OBJECTIVE

The processing of medical image is an important tool to assist in minimizing the degree of uncertainty of the specialist, while providing specialists with an additional source of detect and diagnosis information. Breast cancer is the most common type of cancer that affects the female population around the world. It is also the most deadly type of cancer among women. It is the second most common type of cancer among all others. The most common examination to diagnose breast cancer early is mammography. In the last decades, computational techniques have been developed with the purpose of automatically detecting structures that maybe associated with tumors in mammography examination. This work presents a computational methodology to automatically detection of mass regions in mammography by using a convolutional neural network.

METHODS

The materials used in this work is the DDSM database. The method proposed consists of two phases: training phase and test phase. The training phase has 2 main steps: (1) create a model to classify breast tissue into dense and non-dense (2) create a model to classify regions of breast into mass and non-mass. The test phase has 7 step: (1) preprocessing; (2) registration; (3) segmentation; (4) first reduction of false positives; (5) preprocessing of regions segmented; (6) density tissue classification (7) second reduction of false positives where regions will be classified into mass and non-mass.

RESULTS

The proposed method achieved 95.6% of accuracy in classify non-dense breasts tissue and 97,72% accuracy in classify dense breasts. To detect regions of mass in non-dense breast, the method achieved a sensitivity value of 91.5%, and specificity value of 90.7%, with 91% accuracy. To detect regions in dense breasts, our method achieved 90.4% of sensitivity and 96.4% of specificity, with accuracy of 94.8%.

CONCLUSIONS

According to the results achieved by CNN, we demonstrate the feasibility of using convolutional neural networks on medical image processing techniques for classification of breast tissue and mass detection.

Machine learning techniques for breast cancer computer aided diagnosis using different image modalities: A systematic review

BACKGROUND AND OBJECTIVE

The high incidence of breast cancer in women has increased significantly in the recent years. Physician experience of diagnosing and detecting breast cancer can be assisted by using some computerized features extraction and classification algorithms. This paper presents the conduction and results of a systematic review (SR) that aims to investigate the state of the art regarding the computer aided diagnosis/detection (CAD) systems for breast cancer.

METHODS

The SR was conducted using a comprehensive selection of scientific databases as reference sources, allowing access to diverse publications in the field. The scientific databases used are Springer Link (SL), Science Direct (SD), IEEE Xplore Digital Library, and PubMed. Inclusion and exclusion criteria were defined and applied to each retrieved work to select those of interest. From 320 studies retrieved, 154 studies were included. However, the scope of this research is limited to scientific and academic works and excludes commercial interests.

RESULTS

This survey provides a general analysis of the current status of CAD systems according to the used image modalities and the machine learning based classifiers. Potential research studies have been discussed to create a more objective and efficient CAD systems.

A new idea for visualization of lesions distribution in mammogram based on CPD registration method

BACKGROUND

Mammography is currently the most effective technique for breast cancer. Lesions distribution can provide support for clinical diagnosis and epidemiological studies.

OBJECTIVE

We presented a new idea to help radiologists study breast lesions distribution conveniently. We also developed an automatic tool based on this idea which could show visualization of lesions distribution in a standard mammogram.

METHODS

Firstly, establishing a lesion database to study; then, extracting breast contours and match different women's mammograms to a standard mammogram; finally, showing the lesion distribution in the standard mammogram, and providing the distribution statistics. The crucial process of developing this tool was matching different women's mammograms correctly. We used a hybrid breast contour extraction method combined with coherent point drift method to match different women's mammograms.

RESULTS

We tested our automatic tool by four mass datasets of 641 images. The distribution results shown by the tool were consistent with the results counted according to their reports and mammograms by manual. We also discussed the registration error that was less than 3.3 mm in average distance.

CONCLUSIONS

The new idea is effective and the automatic tool can provide lesions distribution results which are consistent with radiologists simply and conveniently.

Towards localization of malignant sites of asymmetry across bilateral mammograms

BACKGROUND AND OBJECTIVES

The analysis of patterns of asymmetry between the left and right mammograms of a patient can provide meaningful insights into the presence of an underlying tumor in its early stage. However, the identification of breast cancer by investigating bilateral asymmetry is difficult to perform due to the indistinct and borderline nature of the asymmetric signs as they appear on mammograms.

METHODS

In this study, to increase the positive-predictive value of asymmetry in mammographic screening, a novel computerized approach for the automatic localization of malignant sites of asymmetry in mammograms is proposed. The sites of anatomical correspondence between the right and left regions of each radiographic projection were extracted by means of two bilateral masking procedures, inspired by radiologists' criteria in interpreting mammograms and based on the use of detected landmarking structures. Relative variations of spatial patterns of intensity values and of orientations of directional components within each site were quantified by combining multidirectional Gabor filters and indices of structural similarity. The localization of the sites of malignant asymmetry was performed by coupling two quadratic discriminant analysis classifiers, one for each masking procedure, that assigned the likelihood of malignancy to each site of correspondence.

RESULTS

The performance of the proposed method was assessed on 94 mammographic images from two publicly available databases and containing at least one asymmetric site. Sensitivity, specificity and balanced accuracy levels of 0.83 (0.09), 0.75 (0.06), and 0.79 (0.04), respectively were obtained in the classification of malignant asymmetric sites vs benign/normal sites using cross-validation. In addition, a further blind test on a dataset of Full Field Digital Mammograms achieved levels of sensitivity, specificity, and balanced accuracy of 0.86, 0.65, and 0.75, respectively.

CONCLUSIONS

The achieved performance indicates that the proposed system is effective in localizing sites of malignant asymmetry and it is expected to improve computer-aided diagnosis of breast cancer.

A Type-2 Fuzzy Image Processing Expert System for Diagnosing Brain Tumors

The focus of this paper is diagnosing and differentiating Astrocytomas in MRI scans by developing an interval Type-2 fuzzy automated tumor detection system. This system consists of three modules: working memory, knowledge base, and inference engine. An image processing method with three steps of preprocessing, segmentation and feature extraction, and approximate reasoning is used in inference engine module to enhance the quality of MRI scans, segment them into desired regions, extract the required features, and finally diagnose and differentiate Astrocytomas. However, brain tumors have different characteristics in different planes, so considering one plane of patient's MRI scan may cause inaccurate results. Therefore, in the developed system, several consecutive planes are processed. The performance of this system is evaluated using 95 MRI scans and the results show good improvement in diagnosing and differentiating Astrocytomas.

Analysis of structural similarity in mammograms for detection of bilateral asymmetry

We hypothesize that quantification of structural similarity or dissimilarity between paired mammographic regions can be effective in detecting asymmetric signs of breast cancer. Bilateral masking procedures are applied for this purpose by using automatically detected anatomical landmarks. Changes in structural information of the extracted regions are investigated using spherical semivariogram descriptors and correlation-based structural similarity indices in the spatial and complex wavelet domains. The spatial distribution of grayscale values as well as of the magnitude and phase responses of multidirectional Gabor filters are used to represent the structure of mammographic density and of the directional components of breast tissue patterns, respectively. A total of 188 mammograms from the DDSM and mini-MIAS databases, consisting of 47 asymmetric cases and 47 normal cases, were analyzed. For the combined dataset of mammograms, areas under the receiver operating characteristic curves of 0.83, 0.77, and 0.87 were obtained, respectively, with linear discriminant analysis, the Bayesian classifier, and an artificial neural network with radial basis functions, using the features selected by stepwise logistic regression and leave-one-patient-out cross-validation. Two-view analysis provided accuracy up to 0.94, with sensitivity and specificity of 1 and 0.88, respectively.