Mammographic feature enhancement by multiscale analysis

Computer-aided breast cancer detection and classification in mammography: A comprehensive review

Cancer is the second cause of mortality worldwide and it has been identified as a perilous disease. Breast cancer accounts for ∼20% of all new cancer cases worldwide, making it a major cause of morbidity and mortality. Mammography is an effective screening tool for the early detection and management of breast cancer. However, the identification and interpretation of breast lesions is challenging even for expert radiologists. For that reason, several Computer-Aided Diagnosis (CAD) systems are being developed to assist radiologists to accurately detect and/or classify breast cancer. This review examines the recent literature on the automatic detection and/or classification of breast cancer in mammograms, using both conventional feature-based machine learning and deep learning algorithms. The review begins with a comparison of algorithms developed specifically for the detection and/or classification of two types of breast abnormalities, micro-calcifications and masses, followed by the use of sequential mammograms for improving the performance of the algorithms. The available Food and Drug Administration (FDA) approved CAD systems related to triage and diagnosis of breast cancer in mammograms are subsequently presented. Finally, a description of the open access mammography datasets is provided and the potential opportunities for future work in this field are highlighted. The comprehensive review provided here can serve both as a thorough introduction to the field but also provide indicative directions to guide future applications.

RICE: A method for quantitative mammographic image enhancement

We introduce Region of Interest Contrast Enhancement (RICE) to identify focal densities in mammograms. It aims to help radiologists: 1) enhancing the contrast of mammographic images; and 2) detecting regions of interest (such as focal densities) that are candidate masses potentially masked behind dense parenchyma. Cancer masking is an unsolved issue, particularly in breast density categories BI-RADS C and D. RICE suppresses normal breast parenchyma in order to highlight focal densities. Unlike methods that enhance mammograms by modifying the dynamic range of an image; RICE relies on the actual tissue composition of the breast. It segments Volumetric Breast Density (VBD) maps into smaller regions and then applies a recursive mechanism to estimate the 'neighbourhood' for each segment. The method then subtracts and updates the neighbourhood, or the encompassing tissue, from each piecewise constant component of the breast image. This not only enhances the appearance of a candidate mass but also helps in estimating the mass density. In extensive experiments, RICE enhances focal densities in all breast density types including the most challenging category BI-RADS D. Suitably adapted, RICE can be used as a precursor to any computer-aided diagnostics and detection system.

An adaptive enhancement method for breast X-ray images based on the nonsubsampled contourlet transform domain and whale optimization algorithm

We propose a new method for breast X-ray image adaptive enhancement that combines nonsubsampled contourlet transform (NSCT) with the whale optimization algorithm (WOA). First, the mammography X-ray image was processed by histogram equalization to ensure global image contrast. The processed image was then decomposed into three layers in the NSCT domain. Each layer was each decomposed into two, four, and eight directions. A median filter was used to remove noise in the first and second layers. Then, a special edge filter was adopted to enhance each sub-band image, and two parameters are involved. WOA is used to automatically search the optimal two parameters. Blind image quality index (BIQI) adaptive function was used as an objective function of WOA. Then, inverse NSCT was employed to reconstruct the processed image, generating the final adaptive enhancement image. The digital database for screening mammography (DDSM) was used to verify the performance of the proposed method. Five objective evaluation indexes, including information entropy, average gradient, standard deviation, contrast improvement index (CII), and BIQI, are combined together to construct a new comprehensive index to evaluate the visual quality of the enhanced image. The results show that the proposed method has a good enhancement effect for mammography X-ray images. The overall performance of the proposed method is better than some existing similar methods. Graphical abstract .

Radiogenomics analysis identifies correlations of digital mammography with clinical molecular signatures in breast cancer

In breast cancer, well-known gene expression subtypes have been related to a specific clinical outcome. However, their impact on the breast tissue phenotype has been poorly studied. Here, we investigate the association of imaging data of tumors to gene expression signatures from 71 patients with breast cancer that underwent pre-treatment digital mammograms and tumor biopsies. From digital mammograms, a semi-automated radiogenomics analysis generated 1,078 features describing the shape, signal distribution, and texture of tumors along their contralateral image used as control. From tumor biopsy, we estimated the OncotypeDX and PAM50 recurrence scores using gene expression microarrays. Then, we used multivariate analysis under stringent cross-validation to train models predicting recurrence scores. Few univariate features reached Spearman correlation coefficients above 0.4. Nevertheless, multivariate analysis yielded significantly correlated models for both signatures (correlation of OncotypeDX = 0.49 ± 0.07 and PAM50 = 0.32 ± 0.10 in stringent cross-validation and OncotypeDX = 0.83 and PAM50 = 0.78 for a unique model). Equivalent models trained from the unaffected contralateral breast were not correlated suggesting that the image signatures were tumor-specific and that overfitting was not a considerable issue. We also noted that models were improved by combining clinical information (triple negative status and progesterone receptor). The models used mostly wavelets and fractal features suggesting their importance to capture tumor information. Our results suggest that molecular-based recurrence risk and breast cancer subtypes have observable radiographic phenotypes. To our knowledge, this is the first study associating mammographic information to gene expression recurrence signatures.

Postprocessing Approaches for the Improvement of Cardiac Ultrasound B-Mode Images: A Review

The improvement in the quality and diagnostic value of ultrasound images has been an ongoing research theme for the last three decades. Cardiac ultrasound suffers from a wide range of artifacts such as acoustic noise, shadowing, and enhancement. Most artifacts are a consequence of the interaction of the transmitted ultrasound signals with anatomic structures of the examined body. Structures such as bone, lungs (air), and fat have a direct limiting effect on the quality of the acquired images. Furthermore, physical phenomena such as speckle introduce a granular pattern on the imaged tissue structures that can sometimes obscure fine anatomic detail. Over the years, numerous studies have attempted to address a range of artifacts in medical ultrasound, including cardiac ultrasound B-mode images. This review provides extensive coverage of such attempts identifying their limitations as well as future research opportunities.

Application of wavelet techniques for cancer diagnosis using ultrasound images: A Review

Ultrasound is an important and low cost imaging modality used to study the internal organs of human body and blood flow through blood vessels. It uses high frequency sound waves to acquire images of internal organs. It is used to screen normal, benign and malignant tissues of various organs. Healthy and malignant tissues generate different echoes for ultrasound. Hence, it provides useful information about the potential tumor tissues that can be analyzed for diagnostic purposes before therapeutic procedures. Ultrasound images are affected with speckle noise due to an air gap between the transducer probe and the body. The challenge is to design and develop robust image preprocessing, segmentation and feature extraction algorithms to locate the tumor region and to extract subtle information from isolated tumor region for diagnosis. This information can be revealed using a scale space technique such as the Discrete Wavelet Transform (DWT). It decomposes an image into images at different scales using low pass and high pass filters. These filters help to identify the detail or sudden changes in intensity in the image. These changes are reflected in the wavelet coefficients. Various texture, statistical and image based features can be extracted from these coefficients. The extracted features are subjected to statistical analysis to identify the significant features to discriminate normal and malignant ultrasound images using supervised classifiers. This paper presents a review of wavelet techniques used for preprocessing, segmentation and feature extraction of breast, thyroid, ovarian and prostate cancer using ultrasound images.

A combined approach for the enhancement and segmentation of mammograms using modified fuzzy C-means method in wavelet domain

In this paper, a combined approach for enhancement and segmentation of mammograms is proposed. In preprocessing stage, a contrast limited adaptive histogram equalization (CLAHE) method is applied to obtain the better contrast mammograms. After this, the proposed combined methods are applied. In the first step of the proposed approach, a two dimensional (2D) discrete wavelet transform (DWT) is applied to all the input images. In the second step, a proposed nonlinear complex diffusion based unsharp masking and crispening method is applied on the approximation coefficients of the wavelet transformed images to further highlight the abnormalities such as micro-calcifications, tumours, etc., to reduce the false positives (FPs). Thirdly, a modified fuzzy c-means (FCM) segmentation method is applied on the output of the second step. In the modified FCM method, the mutual information is proposed as a similarity measure in place of conventional Euclidian distance based dissimilarity measure for FCM segmentation. Finally, the inverse 2D-DWT is applied. The efficacy of the proposed unsharp masking and crispening method for image enhancement is evaluated in terms of signal-to-noise ratio (SNR) and that of the proposed segmentation method is evaluated in terms of random index (RI), global consistency error (GCE), and variation of information (VoI). The performance of the proposed segmentation approach is compared with the other commonly used segmentation approaches such as Otsu's thresholding, texture based, k-means, and FCM clustering as well as thresholding. From the obtained results, it is observed that the proposed segmentation approach performs better and takes lesser processing time in comparison to the standard FCM and other segmentation methods in consideration.

A new full-field digital mammography system with and without the use of an advanced post-processing algorithm: comparison of image quality and diagnostic performance

Objective

To compare new full-field digital mammography (FFDM) with and without use of an advanced post-processing algorithm to improve image quality, lesion detection, diagnostic performance, and priority rank.

Materials and Methods

During a 22-month period, we prospectively enrolled 100 cases of specimen FFDM mammography (Brestige®), which was performed alone or in combination with a post-processing algorithm developed by the manufacturer: group A (SMA), specimen mammography without application of "Mammogram enhancement ver. 2.0"; group B (SMB), specimen mammography with application of "Mammogram enhancement ver. 2.0". Two sets of specimen mammographies were randomly reviewed by five experienced radiologists. Image quality, lesion detection, diagnostic performance, and priority rank with regard to image preference were evaluated.

Results

Three aspects of image quality (overall quality, contrast, and noise) of the SMB were significantly superior to those of SMA (p < 0.05). SMB was significantly superior to SMA for visualizing calcifications (p < 0.05). Diagnostic performance, as evaluated by cancer score, was similar between SMA and SMB. SMB was preferred to SMA by four of the five reviewers.

Conclusion

The post-processing algorithm may improve image quality with better image preference in FFDM than without use of the software.

Feature and contrast enhancement of mammographic image based on multiscale analysis and morphology

A new algorithm for feature and contrast enhancement of mammographic images is proposed in this paper. The approach bases on multiscale transform and mathematical morphology. First of all, the Laplacian Gaussian pyramid operator is applied to transform the mammography into different scale subband images. In addition, the detail or high frequency subimages are equalized by contrast limited adaptive histogram equalization (CLAHE) and low-pass subimages are processed by mathematical morphology. Finally, the enhanced image of feature and contrast is reconstructed from the Laplacian Gaussian pyramid coefficients modified at one or more levels by contrast limited adaptive histogram equalization and mathematical morphology, respectively. The enhanced image is processed by global nonlinear operator. The experimental results show that the presented algorithm is effective for feature and contrast enhancement of mammogram. The performance evaluation of the proposed algorithm is measured by contrast evaluation criterion for image, signal-noise-ratio (SNR), and contrast improvement index (CII).

Texture enhanced histogram equalization using TV- L¹ image decomposition

Histogram transformation defines a class of image processing operations that are widely applied in the implementation of data normalization algorithms. In this paper, we present a new variational approach for image enhancement that is constructed to alleviate the intensity saturation effects that are introduced by standard contrast enhancement (CE) methods based on histogram equalization. In this paper, we initially apply total variation (TV) minimization with a L(1) fidelity term to decompose the input image with respect to cartoon and texture components. Contrary to previous papers that rely solely on the information encompassed in the distribution of the intensity information, in this paper, the texture information is also employed to emphasize the contribution of the local textural features in the CE process. This is achieved by implementing a nonlinear histogram warping CE strategy that is able to maximize the information content in the transformed image. Our experimental study addresses the CE of a wide variety of image data and comparative evaluations are provided to illustrate that our method produces better results than conventional CE strategies.

Curvelet processing of MRI for local image enhancement

Magnetic resonance imaging provides very good contrast between different soft tissues; however, in some cases, this technique is not so suitable to image calcified structures like bones. The quality of images is often degraded by blur edges or noises, which makes it difficult to accurately identify bone structures. In this paper, we proposed a new curvelet preprocessing method for local image enhancement to especially improve the quality of spinal MRI. Our objective is to both sharpen boundaries and smoothen the intensity variation of the vertebra. In the first phase, we extract features through curvelet coefficients and the gradient of the original image, then we utilize fuzzy cluster method to classify the whole image scope into the 'edge' region and the 'nonedge' region. In the second phase, we locally sharpen or smoothen the image by adaptive adjustment of curvelet coefficients and Gaussian smoothing method in different subregions. To evaluate the effect of the preprocessing method, we examine the gradient of the image and its segmentation results as the assessments. The experiment results show that the feature extraction method is effective for classification and the vertebra performs higher contrast on boundaries and less noises after the enhancement, which indeed helps increase the accuracy of further segmentation.

ENHANCEMENT OF MAMMOGRAPHIC PHANTOM FEATURES BY NOISE REDUCTION

A noise reduction scheme on digitized mammographic phantom images is presented. This algorithm is based on a direct contrast modification method with an optimal function, obtained by using the mean squared error as a criterion. Computer simulated images containing objects similar to those observed in the phantom are built to evaluate the performance of the algorithm. Noise reduction results obtained on both simulated and real phantom images show that the developed method may be considered as a good preprocessing step from the point of view of automating phantom film evaluation by means of image processing.

Steerable pyramids and tight wavelet frames in L2(R(d))

We present a functional framework for the design of tight steerable wavelet frames in any number of dimensions. The 2-D version of the method can be viewed as a generalization of Simoncelli's steerable pyramid that gives access to a larger palette of steerable wavelets via a suitable parametrization. The backbone of our construction is a primal isotropic wavelet frame that provides the multiresolution decomposition of the signal. The steerable wavelets are obtained by applying a one-to-many mapping (Nth-order generalized Riesz transform) to the primal ones. The shaping of the steerable wavelets is controlled by an M×M unitary matrix (where M is the number of wavelet channels) that can be selected arbitrarily; this allows for a much wider range of solutions than the traditional equiangular configuration (steerable pyramid). We give a complete functional description of these generalized wavelet transforms and derive their steering equations. We describe some concrete examples of transforms, including some built around a Mallat-type multiresolution analysis of L(2)(R(d)), and provide a fast Fourier transform-based decomposition algorithm. We also propose a principal-component-based method for signal-adapted wavelet design. Finally, we present some illustrative examples together with a comparison of the denoising performance of various brands of steerable transforms. The results are in favor of an optimized wavelet design (equalized principal component analysis), which consistently performs best.

Nonlinear unsharp masking for mammogram enhancement

This paper introduces a new unsharp masking (UM) scheme, called nonlinear UM (NLUM), for mammogram enhancement. The NLUM offers users the flexibility 1) to embed different types of filters into the nonlinear filtering operator; 2) to choose different linear or nonlinear operations for the fusion processes that combines the enhanced filtered portion of the mammogram with the original mammogram; and 3) to allow the NLUM parameter selection to be performed manually or by using a quantitative enhancement measure to obtain the optimal enhancement parameters. We also introduce a new enhancement measure approach, called the second-derivative-like measure of enhancement, which is shown to have better performance than other measures in evaluating the visual quality of image enhancement. The comparison and evaluation of enhancement performance demonstrate that the NLUM can improve the disease diagnosis by enhancing the fine details in mammograms with no a priori knowledge of the image contents. The human-visual-system-based image decomposition is used for analysis and visualization of mammogram enhancement.

Sub-hexagonal phase correlation for motion estimation

We present a novel frequency-domain motion estimation technique, which operates on hexagonal images and employs the hexagonal Fourier transform. Our method involves image sampling on a hexagonal lattice followed by a normalised hexagonal cross-correlation in the frequency domain. The term subpixel (or subcell) is defined on a hexagonal grid in order to achieve floating point registration. Experiments using both artificially induced motion and actual motion demonstrate that the proposed method outperforms the state-of-the-art in frequency-domain motion estimation operating on a square lattice, in the shape of phase correlation, in terms of subpixel accuracy for a range of test material and motion scenarios.

Computer-assisted quantification of lung tumors in respiratory gated PET/CT images: phantom study

A computer-aided method was developed to automatically localize tumors in lung PET images of discrete bins within the breathing cycle, followed by an algorithm that registers all the information of a complete respiratory cycle into a single reference bin. Four registration/integration algorithms: Centroid Based, Intensity Based, Rigid Body, and Optical Flow registration were compared as well as two registration schemes: Direct scheme and Successive scheme. Validation was demonstrated by conducting experiments with the computerized 4D NCAT phantom and with a dynamic lung-chest phantom imaged using a GE PET/CT System. Iterations were conducted on different size simulated tumors. Static tumors without respiratory motion were used as gold standard; quantitative results were compared with respect to tumor activity concentration, cross-correlation coefficient, relative noise level, and computation time. After motion correction, the best compromise between short PET scan time and reduced image noise can be achieved, while quantification and clinical analysis become faster and more precise.

Anniversary paper: History and status of CAD and quantitative image analysis: the role of Medical Physics and AAPM

The roles of physicists in medical imaging have expanded over the years, from the study of imaging systems (sources and detectors) and dose to the assessment of image quality and perception, the development of image processing techniques, and the development of image analysis methods to assist in detection and diagnosis. The latter is a natural extension of medical physicists' goals in developing imaging techniques to help physicians acquire diagnostic information and improve clinical decisions. Studies indicate that radiologists do not detect all abnormalities on images that are visible on retrospective review, and they do not always correctly characterize abnormalities that are found. Since the 1950s, the potential use of computers had been considered for analysis of radiographic abnormalities. In the mid-1980s, however, medical physicists and radiologists began major research efforts for computer-aided detection or computer-aided diagnosis (CAD), that is, using the computer output as an aid to radiologists-as opposed to a completely automatic computer interpretation-focusing initially on methods for the detection of lesions on chest radiographs and mammograms. Since then, extensive investigations of computerized image analysis for detection or diagnosis of abnormalities in a variety of 2D and 3D medical images have been conducted. The growth of CAD over the past 20 years has been tremendous-from the early days of time-consuming film digitization and CPU-intensive computations on a limited number of cases to its current status in which developed CAD approaches are evaluated rigorously on large clinically relevant databases. CAD research by medical physicists includes many aspects-collecting relevant normal and pathological cases; developing computer algorithms appropriate for the medical interpretation task including those for segmentation, feature extraction, and classifier design; developing methodology for assessing CAD performance; validating the algorithms using appropriate cases to measure performance and robustness; conducting observer studies with which to evaluate radiologists in the diagnostic task without and with the use of the computer aid; and ultimately assessing performance with a clinical trial. Medical physicists also have an important role in quantitative imaging, by validating the quantitative integrity of scanners and developing imaging techniques, and image analysis tools that extract quantitative data in a more accurate and automated fashion. As imaging systems become more complex and the need for better quantitative information from images grows, the future includes the combined research efforts from physicists working in CAD with those working on quantitative imaging systems to readily yield information on morphology, function, molecular structure, and more-from animal imaging research to clinical patient care. A historical review of CAD and a discussion of challenges for the future are presented here, along with the extension to quantitative image analysis.

An enhanced segmentation of blood vessels in retinal images using contourlet

Retinal images acquired using a fundus camera often contain low grey, low level contrast and are of low dynamic range. This may seriously affect the automatic segmentation stage and subsequent results; hence, it is necessary to carry-out preprocessing to improve image contrast results before segmentation. Here we present a new multi-scale method for retinal image contrast enhancement using Contourlet transform. In this paper, a combination of feature extraction approach which utilizes Local Binary Pattern (LBP), morphological method and spatial image processing is proposed for segmenting the retinal blood vessels in optic fundus images. Furthermore, performance of Adaptive Neuro-Fuzzy Inference System (ANFIS) and Multilayer Perceptron (MLP) is investigated in the classification section. The performance of the proposed algorithm is tested on the publicly available DRIVE database. The results are numerically assessed for different proposed algorithms.

The pairing of a wavelet basis with a mildly redundant analysis via subband regression

A distinction is usually made between wavelet bases and wavelet frames. The former are associated with a one-to-one representation of signals, which is somewhat constrained but most efficient computationally. The latter are over-complete, but they offer advantages in terms of flexibility (shape of the basis functions) and shift-invariance. In this paper, we propose a framework for improved wavelet analysis based on an appropriate pairing of a wavelet basis with a mildly redundant version of itself (frame). The processing is accomplished in four steps: 1) redundant wavelet analysis, 2) wavelet-domain processing, 3) projection of the results onto the wavelet basis, and 4) reconstruction of the signal from its nonredundant wavelet expansion. The wavelet analysis is pyramid-like and is obtained by simple modification of Mallat's filterbank algorithm (e.g., suppression of the down-sampling in the wavelet channels only). The key component of the method is the subband regression filter (Step 3) which computes a wavelet expansion that is maximally consistent in the least squares sense with the redundant wavelet analysis. We demonstrate that this approach significantly improves the performance of soft-threshold wavelet denoising with a moderate increase in computational cost. We also show that the analysis filters in the proposed framework can be adjusted for improved feature detection; in particular, a new quincunx Mexican-hat-like wavelet transform that is fully reversible and essentially behaves the (gamma/2)th Laplacian of a Gaussian.

Improvement of microcalcification cluster detection in mammography utilizing image enhancement techniques

In this work, the effect of an image enhancement processing stage and the parameter tuning of a computer-aided detection (CAD) system for the detection of microcalcifications in mammograms is assessed. Five (5) image enhancement algorithms were tested introducing the contrast-limited adaptive histogram equalization (CLAHE), the local range modification (LRM) and the redundant discrete wavelet (RDW) linear stretching and shrinkage algorithms. CAD tuning optimization was targeted to the percentage of the most contrasted pixels and the size of the minimum detectable object which could satisfactorily represent a microcalcification. The highest performance in two mammographic datasets, were achieved for LRM (A(Z)=0.932) and the wavelet-based linear stretching (A(Z)=0.926) methodology.

FIR filter banks for hexagonal data processing

Images are conventionally sampled on a rectangular lattice. Thus, traditional image processing is carried out on the rectangular lattice. The hexagonal lattice was proposed more than four decades ago as an alternative method for sampling. Compared with the rectangular lattice, the hexagonal lattice has certain advantages which include that it needs less sampling points; it has better consistent connectivity and higher symmetry; the hexagonal structure is also pertinent to the vision process. In this paper, we investigate the construction of symmetric FIR hexagonal filter banks for multiresolution hexagonal image processing. We obtain block structures of FIR hexagonal filter banks with 3-fold rotational symmetry and 3-fold axial symmetry. These block structures yield families of orthogonal and biorthogonal FIR hexagonal filter banks with 3-fold rotational symmetry and 3-fold axial symmetry. In this paper, we also discuss the construction of orthogonal and biorthogonal FIR filter banks with scaling functions and wavelets having optimal smoothness. In addition, we present a few of such orthogonal and biorthogonal FIR filters banks.

A differential evolution approach to PET image de-noising

Positron emission tomography (PET) plays an increasingly potential role in modern clinical diagnosis. But, often, the quality of PET images is compromised due to the photon noise which reduces the signal to noise ratio (SNR) of these images. The degradation of images by noise may influence the diagnosis of critical diseases in clinical environments. The de-noising of PET images, by means of differential evolution based wavelet thresholding, is proposed here. This method keeps the resolution loss minimum and removes the photon noise from the images. The percentage of improvement in SNR was found to be more than 16% as opposed to 8% and 1.4% improvement obtained by means of median and Wiener filtering respectively.

Trans-illuminated image restoration of Nevoscope

Nevoscope is an optical imaging device to obtain images of skin-lesions through back-scattered diffused light using trans-illumination to determine abnormalities such as skin-cancers. Due to the nature of the process of transillumination, images obtained from Nevoscope suffer from a dark-field effect. We proposed a two-step algorithm to restore Nevoscope images under the trans-illumination mode. First, a background attenuation matrix was extracted from an image of normal skin close to the suspicious abnormality. This matrix was then applied to the trans-illuminated image to correct background. Second, the background corrected image was decomposed using wavelet transform. By adjusting the wavelet coefficients judiciously, a denoised and feature enhanced image was obtained.

Digital Mammography Image Quality: Image Display

This paper on digital mammography image display is 1 of 3 papers written as part of an intersociety effort to establish image quality standards for digital mammography. The information included in this paper is intended to support the development of an American College of Radiology (ACR) guideline on image quality for digital mammography. The topics of the other 2 papers are digital mammography image acquisition and digital mammography image storage, transmission, and retrieval. The societies represented in compiling this document were the Radiological Society of North America, the ACR, the American Association of Physicists in Medicine, and the Society for Computer Applications in Radiology. These papers describe in detail what is known to improve image quality for digital mammography and make recommendations about how digital mammography should be performed to optimize the visualization of breast cancers using this imaging tool. Through the publication of these papers, the ACR is seeking input from industry, radiologists, and other interested parties on their contents so that the final ACR guideline for digital mammography will represent the consensus of the broader community interested in these topics.

Denoising and enhancing digital mammographic images for visual screening

Dense regions in digital mammographic images are usually noisy and have low contrast, and their visual screening is difficult. This paper describes a new method for mammographic image noise suppression and enhancement, which can be effective particularly for screening image dense regions. Initially, the image is preprocessed to improve its local contrast and the discrimination of subtle details. Next, image noise suppression and edge enhancement are performed based on the wavelet transform. At each resolution, coefficients associated with noise are modelled by Gaussian random variables; coefficients associated with edges are modelled by Generalized Laplacian random variables, and a shrinkage function is assembled based on posterior probabilities. The shrinkage functions at consecutive scales are combined, and then applied to the wavelets coefficients. Given a resolution of analysis, the image denoising process is adaptive (i.e. does not require further parameter adjustments), and the selection of a gain factor provides the desired detail enhancement. The enhancement function was designed to avoid introducing artifacts in the enhancement process, which is essential in mammographic image analysis. Our preliminary results indicate that our method allows to enhance local contrast, and detect microcalcifications and other suspicious structures in situations where their detection would be difficult otherwise. Compared to other approaches, our method requires less parameter adjustments by the user.

Computer-aided diagnosis scheme using a filter bank for detection of microcalcification clusters in mammograms

Mammography is considered the most effective method for early detection of breast cancers. However, it is difficult for radiologists to detect microcalcification clusters. Therefore, we have developed a computerized scheme for detecting early-stage microcalcification clusters in mammograms. We first developed a novel filter bank based on the concept of the Hessian matrix for classifying nodular structures and linear structures. The mammogram images were decomposed into several subimages for second difference at scales from 1 to 4 by this filter bank. The subimages for the nodular component (NC) and the subimages for the nodular and linear component (NLC) were then obtained from analysis of the Hessian matrix. Many regions of interest (ROIs) were selected from the mammogram image. In each ROI, eight features were determined from the subimages for NC at scales from 1 to 4 and the subimages for NLC at scales from 1 to 4. The Bayes discriminant function was employed for distinguishing among abnormal ROIs with a microcalcification cluster and two different types of normal ROIs without a microcalcification cluster. We evaluated the detection performance by using 600 mammograms. Our computerized scheme was shown to have the potential to detect microcalcification clusters with a clinically acceptable sensitivity and low false positives.

Reconstruction and rendering of microcalcifications from two mammogram views by modified projective grid space (MPGS)

Mammograms taken by two views: cranio-caudal (CC) and medio-lateral oblique (MLO) views provide only 2D projections of the microcalcifications, which lack the depth information. Thus, envisioning the relative lesion location from mammograms is a challenge for radiologists. To assist radiologists in locating and rendering lesion tissues, a modified projective grid space (MPGS) scheme is proposed to reconstruct 3D microcalcifications. The MPGS scheme reconstructs 3D microcalcifications in a unique space defined by corresponding points and the epipoles retrieved from the fundamental matrix of the CC and MLO views. Since only corresponding points of images are required in the proposed MPGS scheme, we can avoid the difficulty associated with most reconstruction approaches that require prior complicated calibration of X-ray machine. Considering the deformation of the breast, a new method based on the concept of bundle adjustment is proposed to rectify the 3D locations of reconstructed microcalcifications by uncompressed breast model reconstructed from the real patient body using MPGS scheme with iterative closest point (ICP). Then, the reconstructed microcalcifications are augmented in the real patient body model to show their relative positions.

Computer-aided detection of breast masses on full field digital mammograms

We are developing a computer-aided detection (CAD) system for breast masses on full field digital mammographic (FFDM) images. To develop a CAD system that is independent of the FFDM manufacturer's proprietary preprocessing methods, we used the raw FFDM image as input and developed a multiresolution preprocessing scheme for image enhancement. A two-stage prescreening method that combines gradient field analysis with gray level information was developed to identify mass candidates on the processed images. The suspicious structure in each identified region was extracted by clustering-based region growing. Morphological and spatial gray-level dependence texture features were extracted for each suspicious object. Stepwise linear discriminant analysis (LDA) with simplex optimization was used to select the most useful features. Finally, rule-based and LDA classifiers were designed to differentiate masses from normal tissues. Two data sets were collected: a mass data set containing 110 cases of two-view mammograms with a total of 220 images, and a no-mass data set containing 90 cases of two-view mammograms with a total of 180 images. All cases were acquired with a GE Senographe 2000D FFDM system. The true locations of the masses were identified by an experienced radiologist. Free-response receiver operating characteristic analysis was used to evaluate the performance of the CAD system. It was found that our CAD system achieved a case-based sensitivity of 70%, 80%, and 90% at 0.72, 1.08, and 1.82 false positive (FP) marks/image on the mass data set. The FP rates on the no-mass data set were 0.85, 1.31, and 2.14 FP marks/image, respectively, at the corresponding sensitivities. This study demonstrated the usefulness of our CAD techniques for automated detection of masses on FFDM images.

Enhancing digital cephalic radiography with mixture models and local gamma correction

We present a new algorithm, called the soft-tissue filter, that can make both soft and bone tissue clearly visible in digital cephalic radiographies under a wide range of exposures. It uses a mixture model made up of two Gaussian distributions and one inverted lognormal distribution to analyze the image histogram. The image is clustered in three parts: background, soft tissue, and bone using this model. Improvement in the visibility of both structures is achieved through a local transformation based on gamma correction, stretching, and saturation, which is applied using different parameters for bone and soft-tissue pixels. A processing time of 1 s for 5 Mpixel images allows the filter to operate in real time. Although the default value of the filter parameters is adequate for most images, real-time operation allows adjustment to recover under- and overexposed images or to obtain the best quality subjectively. The filter was extensively clinically tested: quantitative and qualitative results are reported here.

Detection of clustered microcalcifications in small field digital mammography

The most frequent symptoms of ductal carcinoma recognised by mammography are clusters of microcalcifications. Their detection from mammograms is difficult, especially for glandular breasts. We present a new computer-aided detection system for small field digital mammography in planning of breast biopsy. The system processes the mammograms in several steps. First, we filter the original picture with a filter that is sensitive to microcalcification contrast shape. Then, we enhance the mammogram contrast by using wavelet-based sharpening algorithm. Afterwards, we present to radiologist, for visual analysis, such a contrast-enhanced mammogram with suggested positions of microcalcification clusters. We have evaluated the usefulness of the system with the help of four experienced radiologists, who found that it significantly improves the detection of microcalcifications in small field digital mammography.

Pattern recognition techniques for automatic detection of suspicious-looking anomalies in mammograms

We have employed two pattern recognition methods used commonly for face recognition in order to analyse digital mammograms. The methods are based on novel classification schemes, the AdaBoost and the support vector machines (SVM). A number of tests have been carried out to evaluate the accuracy of these two algorithms under different circumstances. Results for the AdaBoost classifier method are promising, especially for classifying mass-type lesions. In the best case the algorithm achieved accuracy of 76% for all lesion types and 90% for masses only. The SVM based algorithm did not perform as well. In order to achieve a higher accuracy for this method, we should choose image features that are better suited for analysing digital mammograms than the currently used ones.

Spectral phase based medical image processing

RATIONALE AND OBJECTIVES

To exploit the spectral phase characteristics of digital or digitized mammograms for early detection of microcalcifications, shape, and sizes of suspected lesions and to demonstrate its use for training radiologists to discriminate signal features in different spatially varying backgrounds.

MATERIALS AND METHODS

We propose two algorithms: in the phase-only image (POI) reconstruction algorithm the spectral phase of the digital mammogram is extracted from its Fourier spectrum. This is coupled with unit magnitude and inverse Fourier transformed to reconstruct the POI thus enhancing the features of interest such as microcalcifications, shape, and sizes of suspected lesions. In the algorithm for image reconstruction from a priori phase-only information, spectral phase is used to extract signal features of the digital mammogram and then this is combined with spectral magnitude that is extracted and averaged over an ensemble of unrelated digital mammograms.

RESULTS

The results for several digital phantoms and mammograms show that POI reconstructs only high spatial frequencies related to the features such as microcalcifications, shape, and size of masses like cysts and tumors. The results on image reconstruction from a priori phase-only information demonstrate the changes in the visibility of signal features when buried in a wide variety of real world mammogram backgrounds with different densities.

CONCLUSION

The POI can aid radiologists in early detection of microcalcifications, lesions, and other masses of interest in digital mammograms. This reconstruction method is self-adaptive to changes in the background. The image reconstruction from a priori phase-only information can help the radiologist as a training tool in his decision-making process. Preliminary experiments indicate the potential of the techniques for early diagnosis of breast cancer. Clinical studies on these algorithm procedures are in progress for application as a diagnostic CAD tool in digital mammography. These methods can in general be applied to other medical images such as CT and MRI images.

Digital radiographic image denoising via wavelet-based hidden Markov model estimation

This paper presents a technique for denoising digital radiographic images based upon the wavelet-domain Hidden Markov tree (HMT) model. The method uses the Anscombe's transformation to adjust the original image, corrupted by Poisson noise, to a Gaussian noise model. The image is then decomposed in different subbands of frequency and orientation responses using the dual-tree complex wavelet transform, and the HMT is used to model the marginal distribution of the wavelet coefficients. Two different correction functions were used to shrink the wavelet coefficients. Finally, the modified wavelet coefficients are transformed back into the original domain to get the denoised image. Fifteen radiographic images of extremities along with images of a hand, a line-pair, and contrast-detail phantoms were analyzed. Quantitative and qualitative assessment showed that the proposed algorithm outperforms the traditional Gaussian filter in terms of noise reduction, quality of details, and bone sharpness. In some images, the proposed algorithm introduced some undesirable artifacts near the edges.