Improvement in breast tumor discrimination by support vector machines and speckle-emphasis texture analysis

Computer-Aided Classification of Breast Lesions Based on US RF Time Series Using a Novel Machine Learning Approach

OBJECTIVES

One of the most promising adjuncts for screening breast cancer is ultrasound (US) radio-frequency (RF) time series. It has the superiority of not requiring any supplementary equipment over other methods. This research aimed to propound a machine learning (ML) approach for automatically classifying benign, probably benign, suspicious, and malignant breast lesions based on the features extracted from the accumulated US RF time series.

METHODS

In this article, 220 data of the aforementioned categories, recorded from 118 patients, were analyzed. The dataset, named RFTSBU, was registered by a SuperSonic Imagine Aixplorer medical/research system equipped with a linear transducer. The regions of interest (ROIs) of the B-mode images were manually selected by an expert radiologist before computing the suggested features. Regarding time, frequency, and time-frequency domains, 291 various features were extracted from each ROI. Finally, the features were classified by a pioneering technique named the reference classification method (RCM). Furthermore, the Lee filter was applied to evaluate the effectiveness of reducing speckle noise on the outcomes.

RESULTS

The accuracy of two-class, three-class, and four-class classifications were respectively calculated 98.59 ± 0.71%, 98.13 ± 0.69%, and 96.10 ± 0.66% (considering 10 repetitions) while support vector machine (SVM) and K-nearest neighbor (KNN) classifiers with 5-fold cross-validation were utilized.

CONCLUSIONS

This article represented the proposed approach, named CCRFML, to distinguish between breast lesions based on registered in vivo RF time series employing an ML framework. The proposed method's impressive level of classification accuracy attests to its capability of effectively assisting medical professionals in the noninvasive differentiation of breast lesions.

Breast Cancer Classification by Using Multi-Headed Convolutional Neural Network Modeling

Breast cancer is one of the most widely recognized diseases after skin cancer. Though it can occur in all kinds of people, it is undeniably more common in women. Several analytical techniques, such as Breast MRI, X-ray, Thermography, Mammograms, Ultrasound, etc., are utilized to identify it. In this study, artificial intelligence was used to rapidly detect breast cancer by analyzing ultrasound images from the Breast Ultrasound Images Dataset (BUSI), which consists of three categories: Benign, Malignant, and Normal. The relevant dataset comprises grayscale and masked ultrasound images of diagnosed patients. Validation tests were accomplished for quantitative outcomes utilizing the exhibition measures for each procedure. The proposed framework is discovered to be effective, substantiating outcomes with only raw image evaluation giving a 78.97% test accuracy and masked image evaluation giving 81.02% test precision, which could decrease human errors in the determination cycle. Additionally, our described framework accomplishes higher accuracy after using multi-headed CNN with two processed datasets based on masked and original images, where the accuracy hopped up to 92.31% (±2) with a Mean Squared Error (MSE) loss of 0.05. This work primarily contributes to identifying the usefulness of multi-headed CNN when working with two different types of data inputs. Finally, a web interface has been made to make this model usable for non-technical personals.

A VGG attention vision transformer network for benign and malignant classification of breast ultrasound images

PURPOSE

Breast cancer is the most commonly occurring cancer worldwide. The ultrasound reflectivity imaging technique can be used to obtain breast ultrasound (BUS) images, which can be used to classify benign and malignant tumors. However, the classification is subjective and dependent on the experience and skill of operators and doctors. The automatic classification method can assist doctors and improve the objectivity, but current convolution neural network (CNN) is not good at learning global features and vision transform (ViT) is not good at extraction local features. In this study, we proposed an VGG attention vision transformer (VGGA-ViT) network to overcome their disadvantages.

METHODS

In the proposed method, we used a convolutional neural network (CNN) module to extract the local features and employed a vision transformer (ViT) module to learn the global relationship between different regions and enhance the relevant local features. The CNN module was named the VGG attention (VGGA) module. It was composed of a visual geometry group (VGG) backbone, a feature extraction fully connected layer, and a squeeze-and-excitation (SE) block. Both the VGG backbone and the ViT module were pre-trained on the ImageNet dataset and re-trained using BUS samples in this study. Two BUS datasets were employed for validation.

RESULTS

Cross-validation was conducted on two BUS datasets.

CONCLUSIONS

In this study, we proposed the VGGA-ViT for the BUS classification, which was good at learning both local and global features. The proposed network achieved higher accuracy than the compared previous methods. This article is protected by copyright. All rights reserved.

Quantitative Evaluation of Rotator Cuff Tears Based on Non-linear Statistical Analysis of Ultrasound Radiofrequency Signals

There is increasing clinical requirement for early and accurate ultrasound diagnosis of rotator cuff tears (RCTs). A method based on non-linear statistical analysis was proposed for the detection of RCTs using ultrasound radiofrequency (RF) signals. One hundred fifty-two patients with shoulder pain were first examined with ultrasound and then diagnosed with magnetic resonance imaging (MRI) as the ground truth. By comparison of the region of interest (ROI) with a part of the supraspinatus with no pathologic change part in the same RF signal frame, the relative P_ks value (viz., rP_ks value) was evaluated to quantify the pathophysiologic changes. The results indicated that the rP_ks values of all RCTs are <0.7, and the accuracy, sensitivity and specificity of the proposed method can reach 97.5%, 100% and 91.4%, respectively. This computer-aided method was found to perform better diagnostic than the results reported by an experienced radiologist (accuracy = 75.7%, sensitivity = 72.6%, and specificity = 85.7%). The high sensitivity advantage of this method indicates that the prospects for its application in the computer-aided diagnosis of RCTs are good.

Classification of malignant tumors in breast ultrasound using a pretrained deep residual network model and support vector machine

In this study, a transfer learning method was utilized to recognize and classify benign and malignant breast tumors, using two-dimensional breast ultrasound (US) images, to decrease the effort expended by physicians and improve the quality of clinical diagnosis. The pretrained deep residual network model was utilized for image feature extraction from the convolutional layer of the trained network; whereas, the linear support vector machine (SVM), with a sequential minimal optimization solver, was used to classify the extracted feature. We used an image dataset with 2099 unlabeled two-dimensional breast US images, collected from 543 patients (benign: 302, malignant: 241). The classification performance yielded a sensitivity of 94.34 % and a specificity of 93.22 % for malignant images (Area under curve = 0.938). The positive and negative predictive values were 92.6 and 94.8, respectively. A comparison between the diagnosis made by the physician and the automated classification by a trained classifier, showed that the latter had significantly better outcomes. This indicates the potential applicability of the proposed approach that incorporates both the pretrained deep learning network and a well-trained classifier, to improve the quality and efficacy of clinical diagnosis.

Technology trends and applications of deep learning in ultrasonography: image quality enhancement, diagnostic support, and improving workflow efficiency

In this review of the most recent applications of deep learning to ultrasound imaging, the architectures of deep learning networks are briefly explained for the medical imaging applications of classification, detection, segmentation, and generation. Ultrasonography applications for image processing and diagnosis are then reviewed and summarized, along with some representative imaging studies of the breast, thyroid, heart, kidney, liver, and fetal head. Efforts towards workflow enhancement are also reviewed, with an emphasis on view recognition, scanning guide, image quality assessment, and quantification and measurement. Finally some future prospects are presented regarding image quality enhancement, diagnostic support, and improvements in workflow efficiency, along with remarks on hurdles, benefits, and necessary collaborations.

Nodule Localization in Thyroid Ultrasound Images with a Joint-Training Convolutional Neural Network

The accurate localization of nodules in ultrasound images can convey crucial information to support a reliable diagnosis. However, this is usually challenging due to low contrast and image artifacts, especially in thyroid ultrasound images where nodules are relatively small in most cases. To address these problems, in this paper, we propose a joint-training convolutional neural network (CNN) for thyroid nodule localization in ultrasound images. Considering the advantage of the faster region-based CNN (Faster R-CNN) in detecting natural targets, we adopt it as the basic framework. To boost the representative power and noise suppression capability of the network, the attention mechanism module is embedded for adaptive feature refinement along the channel and spatial dimensions. Furthermore, in the training process, we annotate the training set in a novel way, called joint-training annotation, by exploiting the fake foreground (FFG) area around the nodule as a spatial prior constraint to improve the sensitivity to small nodules. Ablation experiments are conducted to verify the effectiveness of our proposed method. The experimental results show that our method outperforms others by a mean average precision (mAP) of 0.93 and achieves an intersection over union (IoU) of 0.9, indicating that the localization results agree well with the ground truth. Furthermore, extended experiments on breast nodule datasets are also conducted to verify the generalizability of the proposed approach. Above all, the proposed algorithm is of considerable significance for accurate thyroid nodule localization in ultrasound images and can be generalized to other types of nodules, thereby providing trustworthy assistance for clinical diagnosis.

Reducing the number of unnecessary biopsies of US-BI-RADS 4a lesions through a deep learning method for residents-in-training: a cross-sectional study

OBJECTIVE

The aim of the study is to explore the potential value of S-Detect for residents-in-training, a computer-assisted diagnosis system based on deep learning (DL) algorithm.

METHODS

The study was designed as a cross-sectional study. Routine breast ultrasound examinations were conducted by an experienced radiologist. The ultrasonic images of the lesions were retrospectively assessed by five residents-in-training according to the Breast Imaging Report and Data System (BI-RADS) lexicon, and a dichotomic classification of the lesions was provided by S-Detect. The diagnostic performances of S-Detect and the five residents were measured and compared using the pathological results as the gold standard. The category 4a lesions assessed by the residents were downgraded to possibly benign as classified by S-Detect. The diagnostic performance of the integrated results was compared with the original results of the residents.

PARTICIPANTS

A total of 195 focal breast lesions were consecutively enrolled, including 82 malignant lesions and 113 benign lesions.

RESULTS

S-Detect presented higher specificity (77.88%) and area under the curve (AUC) (0.82) than the residents (specificity: 19.47%-48.67%, AUC: 0.62-0.74). A total of 24, 31, 38, 32 and 42 identified as BI-RADS 4a lesions by residents 1, 2, 3, 4 and 5 were downgraded to possibly benign lesions by S-Detect, respectively. Among these downgraded lesions, 24, 28, 35, 30 and 40 lesions were proven to be pathologically benign, respectively. After combining the residents' results with the results of the software in category 4a lesions, the specificity and AUC of the five residents significantly improved (specificity: 46.02%-76.11%, AUC: 0.71-0.85, p<0.001). The intraclass correlation coefficient of the five residents also increased after integration (from 0.480 to 0.643).

CONCLUSIONS

With the help of the DL software, the specificity, overall diagnostic performance and interobserver agreement of the residents greatly improved. The software can be used as adjunctive tool for residents-in-training, downgrading 4a lesions to possibly benign and reducing unnecessary biopsies.

Texture Analysis Based on Auto-Mutual Information for Classifying Breast Lesions with Ultrasound

Described here is a novel texture extraction method based on auto-mutual information (AMI) for classifying breast lesions. The objective is to extract discriminating information found in the non-linear relationship of textures in breast ultrasound (BUS) images. The AMI method performs three basic tasks: (i) it transforms the input image using the ranklet transform to handle intensity variations of BUS images acquired with distinct ultrasound scanners; (ii) it extracts the AMI-based texture features in the horizontal and vertical directions from each ranklet image; and (iii) it classifies the breast lesions into benign and malignant classes, in which a support-vector machine is used as the underlying classifier. The image data set is composed of 2050 BUS images consisting of 1347 benign and 703 malignant tumors. Additionally, nine commonly used texture extraction methods proposed in the literature for BUS analysis are compared with the AMI method. The bootstrap method, which considers 1000 bootstrap samples, is used to evaluate classification performance. The experimental results indicate that the proposed approach outperforms its counterparts in terms of area under the receiver operating characteristic curve, sensitivity, specificity and Matthews correlation coefficient, with values of 0.82, 0.80, 0.85 and 0.63, respectively. These results suggest that the AMI method is suitable for breast lesion classification systems.

Feasibility of computer-assisted diagnosis for breast ultrasound: the results of the diagnostic performance of S-detect from a single center in China

Objective

To investigate the feasibility of a CAD system S-detect on a database from a single Chinese medical center.

Materials and methods

An experienced radiologist performed breast US examinations and made assessments of 266 consecutive breast lesions in 227 patients. S-detect classified the lesions automatically in a dichotomous form. An in-training resident who was blind to both the US diagnostic results and histological results reviewed the images afterward. The final histological results were considered as the diagnostic gold standard. The diagnostic performances and interrater agreements were analyzed.

Results

A total of 266 focal breast lesions (161 benign lesions and 105 malignant lesions) were assessed in this study. S-detect had a lower sensitivity (87.07%) and a higher specificity (72.27%) compared with the experienced radiologist (sensitivity 98.1% and specificity 65.43%). The sensitivity and specificity of S-detect were better than that of the resident (sensitivity 82.86% and specificity 68.94%). The AUC value of S-detect (0.807) showed no significant difference with the experienced radiologist (0.817) and was higher than that of the resident (0.758). S-detect had moderate agreement with the experienced radiologist.

Conclusion

In this single-center study, a high level of diagnostic performance of S-detect on 266 breast lesions of Chinese women was observed. S-detect had almost equal diagnostic capacity with an experienced radiologist and performed better than a novice reader. S-detect was also distinguished for its high specificity. These results supported the feasibility of S-detect in aiding the diagnosis of breast lesions on an independent database.

Attributes, Performance, and Gaps in Current & Emerging Breast Cancer Screening Technologies

Background:

Early detection of breast cancer, combined with effective treatment, can reduce mortality. Millions of women are diagnosed with breast cancer and many die every year globally. Numerous early detection screening tests have been employed. A wide range of current breast cancer screening methods are reviewed based on a series of searchers focused on clinical testing and performance. </P><P> Discussion: The key factors evaluated centre around the trade-offs between accuracy (sensitivity and specificity), operator dependence of results, invasiveness, comfort, time required, and cost. All of these factors affect the quality of the screen, access/eligibility, and/or compliance to screening programs by eligible women. This survey article provides an overview of the working principles, benefits, limitations, performance, and cost of current breast cancer detection techniques. It is based on an extensive literature review focusing on published works reporting the main performance, cost, and comfort/compliance metrics considered.

Conclusion:

Due to limitations and drawbacks of existing breast cancer screening methods there is a need for better screening methods. Emerging, non-invasive methods offer promise to mitigate the issues particularly around comfort/pain and radiation dose, which would improve compliance and enable all ages to be screened regularly. However, these methods must still undergo significant validation testing to prove they can provide realistic screening alternatives to the current accepted standards.

Automatic tumor segmentation in breast ultrasound images using a dilated fully convolutional network combined with an active contour model

PURPOSE

Due to the low contrast, blurry boundaries, and large amount of shadows in breast ultrasound (BUS) images, automatic tumor segmentation remains a challenging task. Deep learning provides a solution to this problem, since it can effectively extract representative features from lesions and the background in BUS images.

METHODS

A novel automatic tumor segmentation method is proposed by combining a dilated fully convolutional network (DFCN) with a phase-based active contour (PBAC) model. The DFCN is an improved fully convolutional neural network with dilated convolution in deeper layers, fewer parameters, and batch normalization techniques; and has a large receptive field that can separate tumors from background. The predictions made by the DFCN are relatively rough due to blurry boundaries and variations in tumor sizes; thus, the PBAC model, which adds both region-based and phase-based energy functions, is applied to further improve segmentation results. The DFCN model is trained and tested in dataset 1 which contains 570 BUS images from 89 patients. In dataset 2, a 10-fold support vector machine (SVM) classifier is employed to verify the diagnostic ability using 460 features extracted from the segmentation results of the proposed method.

RESULTS

Advantages of the present method were compared with three state-of-the-art networks; the FCN-8s, U-net, and dilated residual network (DRN). Experimental results from 170 BUS images show that the proposed method had a Dice Similarity coefficient of 88.97 ± 10.01%, a Hausdorff distance (HD) of 35.54 ± 29.70 pixels, and a mean absolute deviation (MAD) of 7.67 ± 6.67 pixels, which showed the best segmentation performance. In dataset 2, the area under curve (AUC) of the 10-fold SVM classifier was 0.795 which is similar to the classification using the manual segmentation results.

CONCLUSIONS

The proposed automatic method may be sufficiently accurate, robust, and efficient for medical ultrasound applications.

A computer-aided diagnosis system for breast ultrasound based on weighted BI-RADS classes

BACKGROUND AND OBJECTIVE

Conventional computer-aided diagnosis (CAD) systems for breast ultrasound (BUS) are trained to classify pathological classes, that is, benign and malignant. However, from a clinical perspective, this kind of classification does not agree totally with radiologists' diagnoses. Usually, the tumors are assessed by using a BI-RADS (Breast Imaging-Reporting and Data System) category and, accordingly, a recommendation is emitted: annual study for category 2 (benign), six-month follow-up study for category 3 (probably benign), and biopsy for categories 4 and 5 (suspicious of malignancy). Hence, in this paper, a CAD system based on BI-RADS categories weighted by pathological information is presented. The goal is to increase the classification performance by reducing the common class imbalance found in pathological classes as well as to provide outcomes quite similar to radiologists' recommendations.

METHODS

The BUS dataset considers 781 benign lesions and 347 malignant tumors proven by biopsy. Moreover, every lesion is associated to one BI-RADS category in the set {2, 3, 4, 5}. Thus, the dataset is split into three weighted classes: benign, BI-RADS 2 in benign lesions; probably benign, BI-RADS 3 and 4 in benign lesions; and malignant, BI-RADS 4 and 5 in malignant lesions. Thereafter, a random forest (RF) classifier, denoted by RF_w, is trained to predict the weighted BI-RADS classes. In addition, for comparison purposes, a RF classifier is trained to predict pathological classes, denoted as RF_p.

RESULTS

The ability of the classifiers to predict the pathological classes is measured by the area under the ROC curve (AUC), sensitivity (SEN), and specificity (SPE). The RF_w classifier obtained AUC=0.872,SEN=0.826, and SPE=0.919, whereas the RF_p classifier reached AUC=0.868,SEN=0.808, and SPE=0.929. According to a one-way analysis of variance test, the RF_w classifier statistically outperforms (p < 0.001) the RF_p classifier in terms of the AUC and SEN. Moreover, the classification performance of RF_w to predict weighted BI-RADS classes is given by the Matthews correlation coefficient that obtained 0.614.

CONCLUSIONS

The division of the classification problem into three classes reduces the imbalance between benign and malignant classes; thus, the sensitivity is increased without degrading the specificity. Therefore, the CAD based on weighted BI-RADS classes improves the classification performance of the conventional CAD systems. Additionally, the proposed approach has the advantage of being capable of providing a multiclass outcome related to radiologists' recommendations.

Involvement of Machine Learning for Breast Cancer Image Classification: A Survey

Breast cancer is one of the largest causes of women's death in the world today. Advance engineering of natural image classification techniques and Artificial Intelligence methods has largely been used for the breast-image classification task. The involvement of digital image classification allows the doctor and the physicians a second opinion, and it saves the doctors' and physicians' time. Despite the various publications on breast image classification, very few review papers are available which provide a detailed description of breast cancer image classification techniques, feature extraction and selection procedures, classification measuring parameterizations, and image classification findings. We have put a special emphasis on the Convolutional Neural Network (CNN) method for breast image classification. Along with the CNN method we have also described the involvement of the conventional Neural Network (NN), Logic Based classifiers such as the Random Forest (RF) algorithm, Support Vector Machines (SVM), Bayesian methods, and a few of the semisupervised and unsupervised methods which have been used for breast image classification.

A nonlinear approach to identify pathological change of thyroid nodules based on statistical analysis of ultrasound RF signals

In order to reassure the majority of patients with benign nodules from unnecessary needle biopsy, there is an increasing clinical requirement to identify benign and malignant thyroid nodules during ultrasound diagnosis. A nonlinear approach based on statistical analysis of ultrasound radio-frequency (RF) signals was developed for differential diagnosing the thyroid nodules to improve the diagnostic accuracy. Data from 44 patients with solitary thyroid nodules were collected, following with the ultrasound-guided fine needle aspiration (FNA) as the ground truth. The relative P-value (rP-value) was estimated to quantify the pathophysiologic changes by comparing the region of interest (ROI) with the no pathological change part in the thyroid gland using only one frame of raw RF data. The malignant nodules were distinguished from benign ones with high accuracy and high credibility (sensitivity = 100%, specificity = 80%). Suspicious nodules (rP-value < 0.5) could be picked out for FNA with no additional instruments. This method shows promising in differentiating malignant from benign thyroid nodules, subsequently avoiding unnecessary biopsies.

Approach to breast cancer early detection via tracking of secondary speckle patterns reflected from the skin with artificial intradermal impurity

Breast cancer has become a major cause of death among women. The lifetime risk of a woman developing this disease has been established as one in eight. The most useful way to reduce breast cancer death is to treat the disease as early as possible. The existing methods of early diagnostics of breast cancer are mainly based on screening mammography or Magnetic Resonance Imaging (MRI) periodically conducted at medical facilities. In this paper the authors proposing a new approach for simple breast cancer detection. It is based on skin stimulation by sound waves, illuminating it by laser beam and tracking the reflected secondary speckle patterns. As first approach, plastic balls of different sizes were placed under the skin of chicken breast and detected by the proposed method.

Enhancement of hepatitis virus immunoassay outcome predictions in imbalanced routine pathology data by data balancing and feature selection before the application of support vector machines

Background

Data mining techniques such as support vector machines (SVMs) have been successfully used to predict outcomes for complex problems, including for human health. Much health data is imbalanced, with many more controls than positive cases.

Methods

The impact of three balancing methods and one feature selection method is explored, to assess the ability of SVMs to classify imbalanced diagnostic pathology data associated with the laboratory diagnosis of hepatitis B (HBV) and hepatitis C (HCV) infections. Random forests (RFs) for predictor variable selection, and data reshaping to overcome a large imbalance of negative to positive test results in relation to HBV and HCV immunoassay results, are examined. The methodology is illustrated using data from ACT Pathology (Canberra, Australia), consisting of laboratory test records from 18,625 individuals who underwent hepatitis virus testing over the decade from 1997 to 2007.

Results

Overall, the prediction of HCV test results by immunoassay was more accurate than for HBV immunoassay results associated with identical routine pathology predictor variable data. HBV and HCV negative results were vastly in excess of positive results, so three approaches to handling the negative/positive data imbalance were compared. Generating datasets by the Synthetic Minority Oversampling Technique (SMOTE) resulted in significantly more accurate prediction than single downsizing or multiple downsizing (MDS) of the dataset. For downsized data sets, applying a RF for predictor variable selection had a small effect on the performance, which varied depending on the virus. For SMOTE, a RF had a negative effect on performance. An analysis of variance of the performance across settings supports these findings. Finally, age and assay results for alanine aminotransferase (ALT), sodium for HBV and urea for HCV were found to have a significant impact upon laboratory diagnosis of HBV or HCV infection using an optimised SVM model.

Conclusions

Laboratories looking to include machine learning via SVM as part of their decision support need to be aware that the balancing method, predictor variable selection and the virus type interact to affect the laboratory diagnosis of hepatitis virus infection with routine pathology laboratory variables in different ways depending on which combination is being studied. This awareness should lead to careful use of existing machine learning methods, thus improving the quality of laboratory diagnosis.

A Fusion-Based Approach for Breast Ultrasound Image Classification Using Multiple-ROI Texture and Morphological Analyses

Ultrasound imaging is commonly used for breast cancer diagnosis, but accurate interpretation of breast ultrasound (BUS) images is often challenging and operator-dependent. Computer-aided diagnosis (CAD) systems can be employed to provide the radiologists with a second opinion to improve the diagnosis accuracy. In this study, a new CAD system is developed to enable accurate BUS image classification. In particular, an improved texture analysis is introduced, in which the tumor is divided into a set of nonoverlapping regions of interest (ROIs). Each ROI is analyzed using gray-level cooccurrence matrix features and a support vector machine classifier to estimate its tumor class indicator. The tumor class indicators of all ROIs are combined using a voting mechanism to estimate the tumor class. In addition, morphological analysis is employed to classify the tumor. A probabilistic approach is used to fuse the classification results of the multiple-ROI texture analysis and morphological analysis. The proposed approach is applied to classify 110 BUS images that include 64 benign and 46 malignant tumors. The accuracy, specificity, and sensitivity obtained using the proposed approach are 98.2%, 98.4%, and 97.8%, respectively. These results demonstrate that the proposed approach can effectively be used to differentiate benign and malignant tumors.

Automatic Differential Diagnosis of Melanocytic Skin Tumors Using Ultrasound Data

We describe a novel automatic diagnostic system based on quantitative analysis of ultrasound data for differential diagnosis of melanocytic skin tumors. The proposed method has been tested on 160 ultrasound data sets (80 of malignant melanoma and 80 of benign melanocytic nevi). Acoustical, textural and shape features have been evaluated for each segmented lesion. Using parameters selected according to Mahalanobis distance and linear support vector machine classifier, we are able to differentiate malignant melanoma from benign melanocytic skin tumors with 82.4% accuracy (sensitivity = 85.8%, specificity = 79.6%). The results indicate that high-frequency ultrasound has the potential to be used for differential diagnosis of melanocytic skin tumors and to provide supplementary information on lesion penetration depth. The proposed system can be used as an additional tool for clinical decision support to improve the early-stage detection of malignant melanoma.

New Fully Automated Method for Segmentation of Breast Lesions on Ultrasound Based on Texture Analysis

The study described here explored a fully automatic segmentation approach based on texture analysis for breast lesions on ultrasound images. The proposed method involves two main stages: (i) In lesion region detection, the original gray-scale image is transformed into a texture domain based on log-Gabor filters. Local texture patterns are then extracted from overlapping lattices that are further classified by a linear discriminant analysis classifier to distinguish between the "normal tissue" and "breast lesion" classes. Next, an incremental method based on the average radial derivative function reveals the region with the highest probability of being a lesion. (ii) In lesion delineation, using the detected region and the pre-processed ultrasound image, an iterative thresholding procedure based on the average radial derivative function is performed to determine the final lesion contour. The experiments are carried out on a data set of 544 breast ultrasound images (including cysts, benign solid masses and malignant lesions) acquired with three distinct ultrasound machines. In terms of the area under the receiver operating characteristic curve, the one-way analysis of variance test (α=0.05) indicates that the proposed approach significantly outperforms two published fully automatic methods (p<0.001), for which the areas under the curve are 0.91, 0.82 and 0.63, respectively. Hence, these results suggest that the log-Gabor domain improves the discrimination power of texture features to accurately segment breast lesions. In addition, the proposed approach can potentially be used for automated computer diagnosis purposes to assist physicians in detection and classification of breast masses.

Computer-aided diagnosis for distinguishing between triple-negative breast cancer and fibroadenomas based on ultrasound texture features

PURPOSE

Triple-negative breast cancer (TNBC), an aggressive subtype, is frequently misclassified as fibroadenoma due to benign morphologic features on breast ultrasound (US). This study aims to develop a computer-aided diagnosis (CAD) system based on texture features for distinguishing between TNBC and benign fibroadenomas in US images.

METHODS

US images of 169 pathology-proven tumors (mean size, 1.65 cm; range, 0.7-3.0 cm) composed of 84 benign fibroadenomas and 85 TNBC tumors are used in this study. After a tumor is segmented out using the level-set method, morphological, conventional texture, and multiresolution gray-scale invariant texture feature sets are computed using a best-fitting ellipse, gray-level co-occurrence matrices, and the ranklet transform, respectively. The linear support vector machine with leave-one-out cross-validation schema is used as a classifier, and the diagnostic performance is assessed with receiver operating characteristic curve analysis.

RESULTS

The Az values of the morphology, conventional texture, and multiresolution gray-scale invariant texture feature sets are 0.8470 [95% confidence intervals (CIs), 0.7826-0.8973], 0.8542 (95% CI, 0.7911-0.9030), and 0.9695 (95% CI, 0.9376-0.9865), respectively. The Az of the CAD system based on the combined feature sets is 0.9702 (95% CI, 0.9334-0.9882).

CONCLUSIONS

The CAD system based on texture features extracted via the ranklet transform may be useful for improving the ability to discriminate between TNBC and benign fibroadenomas.

Computer Aided Theragnosis Using Quantitative Ultrasound Spectroscopy and Maximum Mean Discrepancy in Locally Advanced Breast Cancer

A noninvasive computer-aided-theragnosis (CAT) system was developed for the early therapeutic cancer response assessment in patients with locally advanced breast cancer (LABC) treated with neoadjuvant chemotherapy. The proposed CAT system was based on multi-parametric quantitative ultrasound (QUS) spectroscopic methods in conjunction with advanced machine learning techniques. Specifically, a kernel-based metric named maximum mean discrepancy (MMD), a technique for learning from imbalanced data based on random undersampling, and supervised learning were investigated with response-monitoring data from LABC patients. The CAT system was tested on 56 patients using statistical significance tests and leave-one-subject-out classification techniques. Textural features using state-of-the-art local binary patterns (LBP), and gray-scale intensity features were extracted from the spectral parametric maps in the proposed CAT system. The system indicated significant differences in changes between the responding and non-responding patient populations as well as high accuracy, sensitivity, and specificity in discriminating between the two patient groups early after the start of treatment, i.e., on weeks 1 and 4 of several months of treatment. The proposed CAT system achieved an accuracy of 85%, 87%, and 90% on weeks 1, 4 and 8, respectively. The sensitivity and specificity of developed CAT system for the same times was 85%, 95%, 90% and 85%, 85%, 91%, respectively. The proposed CAT system thus establishes a noninvasive framework for monitoring cancer treatment response in tumors using clinical ultrasound imaging in conjunction with machine learning techniques. Such a framework can potentially facilitate the detection of refractory responses in patients to treatment early on during a course of therapy to enable possibly switching to more efficacious treatments.

Application of wavelet techniques for cancer diagnosis using ultrasound images: A Review

Ultrasound is an important and low cost imaging modality used to study the internal organs of human body and blood flow through blood vessels. It uses high frequency sound waves to acquire images of internal organs. It is used to screen normal, benign and malignant tissues of various organs. Healthy and malignant tissues generate different echoes for ultrasound. Hence, it provides useful information about the potential tumor tissues that can be analyzed for diagnostic purposes before therapeutic procedures. Ultrasound images are affected with speckle noise due to an air gap between the transducer probe and the body. The challenge is to design and develop robust image preprocessing, segmentation and feature extraction algorithms to locate the tumor region and to extract subtle information from isolated tumor region for diagnosis. This information can be revealed using a scale space technique such as the Discrete Wavelet Transform (DWT). It decomposes an image into images at different scales using low pass and high pass filters. These filters help to identify the detail or sudden changes in intensity in the image. These changes are reflected in the wavelet coefficients. Various texture, statistical and image based features can be extracted from these coefficients. The extracted features are subjected to statistical analysis to identify the significant features to discriminate normal and malignant ultrasound images using supervised classifiers. This paper presents a review of wavelet techniques used for preprocessing, segmentation and feature extraction of breast, thyroid, ovarian and prostate cancer using ultrasound images.

Ultrasound RF time series for classification of breast lesions

This work reports the use of ultrasound radio frequency (RF) time series analysis as a method for ultrasound-based classification of malignant breast lesions. The RF time series method is versatile and requires only a few seconds of raw ultrasound data with no need for additional instrumentation. Using the RF time series features, and a machine learning framework, we have generated malignancy maps, from the estimated cancer likelihood, for decision support in biopsy recommendation. These maps depict the likelihood of malignancy for regions of size 1 mm(2) within the suspicious lesions. We report an area under receiver operating characteristics curve of 0.86 (95% confidence interval [CI]: 0.84%-0.90%) using support vector machines and 0.81 (95% CI: 0.78-0.85) using Random Forests classification algorithms, on 22 subjects with leave-one-subject-out cross-validation. Changing the classification method yielded consistent results which indicates the robustness of this tissue typing method. The findings of this report suggest that ultrasound RF time series, along with the developed machine learning framework, can help in differentiating malignant from benign breast lesions, subsequently reducing the number of unnecessary biopsies after mammography screening.

Quantification of heterogeneity as a biomarker in tumor imaging: a systematic review

BACKGROUND

Many techniques are proposed for the quantification of tumor heterogeneity as an imaging biomarker for differentiation between tumor types, tumor grading, response monitoring and outcome prediction. However, in clinical practice these methods are barely used. This study evaluates the reported performance of the described methods and identifies barriers to their implementation in clinical practice.

METHODOLOGY

The Ovid, Embase, and Cochrane Central databases were searched up to 20 September 2013. Heterogeneity analysis methods were classified into four categories, i.e., non-spatial methods (NSM), spatial grey level methods (SGLM), fractal analysis (FA) methods, and filters and transforms (F&T). The performance of the different methods was compared.

PRINCIPAL FINDINGS

Of the 7351 potentially relevant publications, 209 were included. Of these studies, 58% reported the use of NSM, 49% SGLM, 10% FA, and 28% F&T. Differentiation between tumor types, tumor grading and/or outcome prediction was the goal in 87% of the studies. Overall, the reported area under the curve (AUC) ranged from 0.5 to 1 (median 0.87). No relation was found between the performance and the quantification methods used, or between the performance and the imaging modality. A negative correlation was found between the tumor-feature ratio and the AUC, which is presumably caused by overfitting in small datasets. Cross-validation was reported in 63% of the classification studies. Retrospective analyses were conducted in 57% of the studies without a clear description.

CONCLUSIONS

In a research setting, heterogeneity quantification methods can differentiate between tumor types, grade tumors, and predict outcome and monitor treatment effects. To translate these methods to clinical practice, more prospective studies are required that use external datasets for validation: these datasets should be made available to the community to facilitate the development of new and improved methods.

Diagnostic assessment by dynamic contrast-enhanced and diffusion-weighted magnetic resonance in differentiation of breast lesions under different imaging protocols

BACKGROUND

The apparent diffusion coefficient (ADC) is a highly diagnostic factor in discriminating malignant and benign breast masses in diffusion-weighted magnetic resonance imaging (DW-MRI). The combination of ADC and other pictorial characteristics has improved lesion type identification accuracy. The objective of this study was to reassess the findings on an independent patient group by changing the magnetic field from 1.5-Tesla to 3.0-Tesla.

METHODS

This retrospective study consisted of a training group of 234 female patients, including 85 benign and 149 malignant lesions, imaged using 1.5-Tesla MRI, and a test group of 95 female patients, including 19 benign and 85 malignant lesions, imaged using 3.0-Tesla MRI. The lesion of interest was segmented from the raw image and four sets of measurements describing the morphology, kinetics, DW-MRI, and texture of the pictorial properties of each lesion were obtained. Each lesion was characterized by 28 features in total. Three classical machine-learning algorithms were used to build prediction models on the training group, which evaluated the prognostic performance of the multi-sided features in three scenarios. To reduce information redundancy, five highly diagnostic factors were selected to obtain a compact yet informative characterization of the lesion status.

RESULTS

Three classification models were built on the training of 1.5-Tesla patients and were tested on the independent 3.0-Tesla test group. The following results were found. i) Characterization of breast masses in a multi-sided way dramatically increased prediction performance. The usage of all features gave a higher performance in both sensitivity and specificity than any individual feature groups or their combinations. ii) ADC was a highly effective factor in improving the sensitivity in discriminating malignant from benign masses. iii) Five features, namely ADC, Sum Average, Entropy, Elongation, and Sum Variance, were selected to achieve the highest performance in diagnosis of the 3.0-Tesla patient group.

CONCLUSIONS

The combination of ADC and other multi-sided characteristics can increase the capability of discriminating malignant and benign breast lesions, even under different imaging protocols. The selected compact feature subsets achieved a high diagnostic performance and thus are promising in clinical applications for discriminating lesion type and for personalized treatment planning.

Diagnosis of solid breast tumors using vessel analysis in three-dimensional power Doppler ultrasound images

This study aims to evaluate whether the distribution of vessels inside and adjacent to tumor region at three-dimensional (3-D) power Doppler ultrasonography (US) can be used for the differentiation of benign and malignant breast tumors. 3-D power Doppler US images of 113 solid breast masses (60 benign and 53 malignant) were used in this study. Blood vessels within and adjacent to tumor were estimated individually in 3-D power Doppler US images for differential diagnosis. Six features including volume of vessels, vascularity index, volume of tumor, vascularity index in tumor, vascularity index in normal tissue, and vascularity index in surrounding region of tumor within 2 cm were evaluated. Neural network was then used to classify tumors by using these vascular features. The receiver operating characteristic (ROC) curve analysis and Student's t test were used to estimate the performance. All the six proposed vascular features are statistically significant (p < 0.001) for classifying the breast tumors as benign or malignant. The A Z (area under ROC curve) values for the classification result were 0.9138. Accuracy, sensitivity, specificity, positive predictive value, and negative predictive value of the diagnosis performance based on all six proposed features were 82.30 (93/113), 86.79 (46/53), 78.33 (47/60), 77.97 (46/59), and 87.04 % (47/54), respectively. The p value of A Z values between the proposed method and conventional vascularity index method using z test was 0.04.

Computer-aided detection system for masses in automated whole breast ultrasonography: development and evaluation of the effectiveness

Purpose:

The aim of this study was to evaluate the performance of a proposed computer-aided detection (CAD) system in automated breast ultrasonography (ABUS).

Methods:

Eighty-nine two-dimensional images (20 cysts, 42 benign lesions, and 27 malignant lesions) were obtained from 47 patients who underwent ABUS (ACUSON S2000). After boundary detection and removal, we detected mass candidates by using the proposed adjusted Otsu's threshold; the threshold was adaptive to the variations of pixel intensities in an image. Then, the detected candidates were segmented. Features of the segmented objects were extracted and used for training/testing in the classification. In our study, a support vector machine classifier was adopted. Eighteen features were used to determine whether the candidates were true lesions or not. A five-fold cross validation was repeated 20 times for the performance evaluation. The sensitivity and the false positive rate per image were calculated, and the classification accuracy was evaluated for each feature.

Results:

In the classification step, the sensitivity of the proposed CAD system was 82.67% (SD, 0.02%). The false positive rate was 0.26 per image. In the detection/segmentation step, the sensitivities for benign and malignant mass detection were 90.47% (38/42) and 92.59% (25/27), respectively. In the five-fold cross-validation, the standard deviation of pixel intensities for the mass candidates was the most frequently selected feature, followed by the vertical position of the centroids. In the univariate analysis, each feature had 50% or higher accuracy.

Conclusion:

The proposed CAD system can be used for lesion detection in ABUS and may be useful in improving the screening efficiency.

Robust Texture Analysis Using Multi-Resolution Gray-Scale Invariant Features for Breast Sonographic Tumor Diagnosis

Computer-aided diagnosis (CAD) systems in gray-scale breast ultrasound images have the potential to reduce unnecessary biopsy of breast masses. The purpose of our study is to develop a robust CAD system based on the texture analysis. First, gray-scale invariant features are extracted from ultrasound images via multi-resolution ranklet transform. Thus, one can apply linear support vector machines (SVMs) on the resulting gray-level co-occurrence matrix (GLCM)-based texture features for discriminating the benign and malignant masses. To verify the effectiveness and robustness of the proposed texture analysis, breast ultrasound images obtained from three different platforms are evaluated based on cross-platform training/testing and leave-one-out cross-validation (LOO-CV) schemes. We compare our proposed features with those extracted by wavelet transform in terms of receiver operating characteristic (ROC) analysis. The AUC values derived from the area under the curve for the three databases via ranklet transform are 0.918 (95% confidence interval [CI], 0.848 to 0.961), 0.943 (95% CI, 0.906 to 0.968), and 0.934 (95% CI, 0.883 to 0.961), respectively, while those via wavelet transform are 0.847 (95% CI, 0.762 to 0.910), 0.922 (95% CI, 0.878 to 0.958), and 0.867 (95% CI, 0.798 to 0.914), respectively. Experiments with cross-platform training/testing scheme between each database reveal that the diagnostic performance of our texture analysis using ranklet transform is less sensitive to the sonographic ultrasound platforms. Also, we adopt several co-occurrence statistics in terms of quantization levels and orientations (i.e., descriptor settings) for computing the co-occurrence matrices with 0.632+ bootstrap estimators to verify the use of the proposed texture analysis. These experiments suggest that the texture analysis using multi-resolution gray-scale invariant features via ranklet transform is useful for designing a robust CAD system.

Breast image analysis for risk assessment, detection, diagnosis, and treatment of cancer

The role of breast image analysis in radiologists' interpretation tasks in cancer risk assessment, detection, diagnosis, and treatment continues to expand. Breast image analysis methods include segmentation, feature extraction techniques, classifier design, biomechanical modeling, image registration, motion correction, and rigorous methods of evaluation. We present a review of the current status of these task-based image analysis methods, which are being developed for the various image acquisition modalities of mammography, tomosynthesis, computed tomography, ultrasound, and magnetic resonance imaging. Depending on the task, image-based biomarkers from such quantitative image analysis may include morphological, textural, and kinetic characteristics and may depend on accurate modeling and registration of the breast images. We conclude with a discussion of future directions.

Assessing the combined performance of texture and morphological parameters in distinguishing breast tumors in ultrasound images

PURPOSE

This work aims to investigate the combination of morphological and texture parameters in distinguishing between malignant and benign breast tumors in ultrasound images.

METHODS

Linear discriminant analysis was applied to sets of up to five parameters, and then the performances were assessed using the area A(z) (± standard error) under the receiver operator characteristic curve, accuracy (Ac), sensitivity (Se), specificity (Sp), positive predictive value, and negative predictive value.

RESULTS

The most relevant individual parameter was the normalized residual value (nrv), calculated from the convex polygon technique. The best performance among all studied combinations was achieved by two morphological and three texture parameters (nrv, con, std, R, and asm(i)), which correctly distinguished nearly 85% of the breast tumors.

CONCLUSIONS

This result indicates that the combination of morphological and texture parameters may be useful to assist physicians in the diagnostic process, especially if it is associated with an automatic classification tool.

Breast ultrasound image classification based on multiple-instance learning

Breast ultrasound (BUS) image segmentation is a very difficult task due to poor image quality and speckle noise. In this paper, local features extracted from roughly segmented regions of interest (ROIs) are used to describe breast tumors. The roughly segmented ROI is viewed as a bag. And subregions of the ROI are considered as the instances of the bag. Multiple-instance learning (MIL) method is more suitable for classifying breast tumors using BUS images. However, due to the complexity of BUS images, traditional MIL method is not applicable. In this paper, a novel MIL method is proposed for solving such task. First, a self-organizing map is used to map the instance space to the concept space. Then, we use the distribution of the instances of each bag in the concept space to construct the bag feature vector. Finally, a support vector machine is employed for classifying the tumors. The experimental results show that the proposed method can achieve better performance: the accuracy is 0.9107 and the area under receiver operator characteristic curve is 0.96 (p < 0.005).

Ultrasound GLCM texture analysis of radiation-induced parotid-gland injury in head-and-neck cancer radiotherapy: an in vivo study of late toxicity

PURPOSE

Xerostomia (dry mouth), secondary to irradiation of the parotid glands, is one of the most common side effects of head-and-neck cancer radiotherapy. Diagnostic tools able to accurately and efficiently measure parotid gland injury have yet to be introduced into the clinic. This study's purpose is to investigate sonographic textural features as potential imaging signatures for quantitative assessment of parotid-gland injury after head-and-neck radiotherapy.

METHODS

The authors have investigated a series of sonographic features obtained from the gray level co-occurrence matrix (GLCM) - a second order statistical method of texture analysis. These GLCM textural features were selected based on empirical observations that the normal parotid gland exhibits homogeneous echotexture, whereas the postradiotherapy parotid gland often exhibits heterogeneous echotexture. We employed eight sonographic features: (1) angular second moment (ASM), (2) inverse differential moment (IDM), (3) contrast, (4) variance, (5) correlation, (6) entropy, (7) cluster shade, and (8) cluster prominence. Altogether, sonographic properties of the parotid glands were quantified by their degrees of homogeneity (ASM and IDM), heterogeneity (contrast and variance), smoothness (correlation), randomness (entropy), and symmetry (cluster shade and prominence). The sonographic features were tested in a pilot study of 12 postradiotherapy patients and 7 healthy volunteers. The mean follow-up time for the postradiotherapy patients was 17.2 months (range: 12.1-23.9 months) and the mean radiation dose to the parotid glands was 32.3 Gy (range: 11.0-63.4 Gy). Each participant underwent one ultrasound study in which longitudinal (vertical) ultrasound scans were performed on the bilateral parotids - a total of 24 postirradiation and 14 normal parotid glands were examined. The 14 normal parotid glands served as the control group. A radiologist contoured the parotid glands on the B-mode images and the sonographic features were computed from the contoured region-of-interest.

RESULTS

The authors observed significant differences (p < 0.05) in all sonographic features between the normal and postradiotherapy parotid glands. The sonographic findings were consistent with the clinical observations of the ultrasound images: normal parotid glands exhibited homogeneous texture, while the postradiotherapy parotid glands exhibited heterogeneous echotexture (e.g., hyperechoic lines and spots), which likely represents fibrosis.

CONCLUSIONS

The authors have demonstrated the feasibility of ultrasonic texture evaluation of parotid glands; and the sonographic features may serve as imaging signatures to assess radiation-induced parotid injury.

Analysis of co-occurrence texture statistics as a function of gray-level quantization for classifying breast ultrasound

In this paper, we investigated the behavior of 22 co-occurrence statistics combined to six gray-scale quantization levels to classify breast lesions on ultrasound (BUS) images. The database of 436 BUS images used in this investigation was formed by 217 carcinoma and 219 benign lesions images. The region delimited by a minimum bounding rectangle around the lesion was employed to calculate the gray-level co-occurrence matrix (GLCM). Next, 22 co-occurrence statistics were computed regarding six quantization levels (8, 16, 32, 64, 128, and 256), four orientations (0° , 45° , 90° , and 135°), and ten distances (1, 2,...,10 pixels). Also, to reduce feature space dimensionality, texture descriptors of the same distance were averaged over all orientations, which is a common practice in the literature. Thereafter, the feature space was ranked using mutual information technique with minimal-redundancy-maximal-relevance (mRMR) criterion. Fisher linear discriminant analysis (FLDA) was applied to assess the discrimination power of texture features, by adding the first m-ranked features to the classification procedure iteratively until all of them were considered. The area under ROC curve (AUC) was used as figure of merit to measure the performance of the classifier. It was observed that averaging texture descriptors of a same distance impacts negatively the classification performance, since the best AUC of 0.81 was achieved with 32 gray levels and 109 features. On the other hand, regarding the single texture features (i.e., without averaging procedure), the quantization level does not impact the discrimination power, since AUC = 0.87 was obtained for the six quantization levels. Moreover, the number of features was reduced (between 17 and 24 features). The texture descriptors that contributed notably to distinguish breast lesions were contrast and correlation computed from GLCMs with orientation of 90° and distance more than five pixels.