1
|
Prediction of Short-Term Breast Cancer Risk with Fusion of CC- and MLO-Based Risk Models in Four-View Mammograms. J Digit Imaging 2022; 35:910-922. [PMID: 35262841 PMCID: PMC9485387 DOI: 10.1007/s10278-019-00266-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022] Open
Abstract
This study performed and assessed a novel program to improve the accuracy of short-term breast cancer risk prediction by using information from craniocaudal (CC) and mediolateral-oblique (MLO) views of two breasts. An age-matched dataset of 556 patients with at least two sequential full-field digital mammography examinations was applied. In the second examination, 278 cases were diagnosed and pathologically verified as cancer, and 278 were negative, while all cases in the first examination were negative (not recalled). Two generalized linear-model-based risk prediction models were established with global- and local-based bilateral asymmetry features for CC and MLO views first. Then, a new fusion risk model was developed by fusing prediction results of the CC- and MLO-based risk models with an adaptive alpha-integration-based fusion method. The AUC of the fusion risk model was 0.72 ± 0.02, which was significantly higher than the AUC of CC- or MLO-based risk model (P < 0.05). The maximum odds ratio for CC- and MLO-based risk models were 8.09 and 5.25, respectively, and increased to 11.99 for the fusion risk model. For subgroups of patients aged 37-49 years, 50-65 years, and 66-87 years, the AUCs of 0.73, 0.71, and 0.75 for the fusion risk model were higher than AUC for CC- and MLO-based risk models. For the BIRADS 2 and 3 subgroups, the AUC values were 0.72 and 0.71 respectively for the fusion risk model which were higher than the AUC for the CC- and MLO-based risk models. This study demonstrated that the fusion risk model we established could effectively derive and integrate supplementary and useful information extracted from both CC and MLO view images and adaptively fuse them to increase the predictive power of the short-term breast cancer risk assessment model.
Collapse
|
2
|
Choi JY. A generalized multiple classifier system for improving computer-aided classification of breast masses in mammography. Biomed Eng Lett 2016. [DOI: 10.1007/s13534-015-0191-1] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022] Open
|
3
|
Pérez NP, Guevara López MA, Silva A, Ramos I. Improving the Mann-Whitney statistical test for feature selection: an approach in breast cancer diagnosis on mammography. Artif Intell Med 2014; 63:19-31. [PMID: 25555756 DOI: 10.1016/j.artmed.2014.12.004] [Citation(s) in RCA: 32] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2014] [Revised: 11/21/2014] [Accepted: 12/04/2014] [Indexed: 12/18/2022]
Abstract
OBJECTIVE This work addresses the theoretical description and experimental evaluation of a new feature selection method (named uFilter). The uFilter improves the Mann-Whitney U-test for reducing dimensionality and ranking features in binary classification problems. Also, it presented a practical uFilter application on breast cancer computer-aided diagnosis (CADx). MATERIALS AND METHODS A total of 720 datasets (ranked subsets of features) were formed by the application of the chi-square (CHI2) discretization, information-gain (IG), one-rule (1Rule), Relief, uFilter and its theoretical basis method (named U-test). Each produced dataset was used for training feed-forward backpropagation neural network, support vector machine, linear discriminant analysis and naive Bayes machine learning algorithms to produce classification scores for further statistical comparisons. RESULTS A head-to-head comparison based on the mean of area under receiver operating characteristics curve scores against the U-test method showed that the uFilter method significantly outperformed the U-test method for almost all classification schemes (p<0.05); it was superior in 50%; tied in a 37.5% and lost in a 12.5% of the 24 comparative scenarios. Also, the performance of the uFilter method, when compared with CHI2 discretization, IG, 1Rule and Relief methods, was superior or at least statistically similar on the explored datasets while requiring less number of features. CONCLUSIONS The experimental results indicated that uFilter method statistically outperformed the U-test method and it demonstrated similar, but not superior, performance than traditional feature selection methods (CHI2 discretization, IG, 1Rule and Relief). The uFilter method revealed competitive and appealing cost-effectiveness results on selecting relevant features, as a support tool for breast cancer CADx methods especially in unbalanced datasets contexts. Finally, the redundancy analysis as a complementary step to the uFilter method provided us an effective way for finding optimal subsets of features without decreasing the classification performances.
Collapse
Affiliation(s)
- Noel Pérez Pérez
- Institute of Mechanical Engineering and Industrial Management (INEGI), Campus da FEUP, Rua Dr. Roberto Frias, 400, 4200-465 Porto, Portugal.
| | - Miguel A Guevara López
- Institute of Electronics and Telematics Engineering of Aveiro, Campus Universitário de Santiago, 3810-193 Aveiro, Portugal; Institute of Mechanical Engineering and Industrial Management (INEGI), Campus da FEUP, Rua Dr. Roberto Frias, 400, 4200-465 Porto, Portugal
| | - Augusto Silva
- Institute of Electronics and Telematics Engineering of Aveiro, Campus Universitário de Santiago, 3810-193 Aveiro, Portugal
| | - Isabel Ramos
- Faculty of Medicine - Centro Hospitalar São Joao, Al. Prof. Hernâni Monteiro, 4200-319 Porto, Portugal
| |
Collapse
|
4
|
Choi JY, Kim DH, Plataniotis KN, Ro YM. Computer-aided detection (CAD) of breast masses in mammography: combined detection and ensemble classification. Phys Med Biol 2014; 59:3697-719. [DOI: 10.1088/0031-9155/59/14/3697] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
5
|
Rawashdeh MA, Bourne RM, Ryan EA, Lee WB, Pietrzyk MW, Reed WM, Borecky N, Brennan PC. Quantitative measures confirm the inverse relationship between lesion spiculation and detection of breast masses. Acad Radiol 2013; 20:576-80. [PMID: 23477828 DOI: 10.1016/j.acra.2012.12.010] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2012] [Revised: 11/08/2012] [Accepted: 12/07/2012] [Indexed: 11/25/2022]
Abstract
OBJECTIVE To identify specific mammographic appearances that reduce the mammographic detection of breast cancer. MATERIALS AND METHODS This study received institutional board review approval and all readers gave informed consent. A set of 60 mammograms each consisting of craniocaudal and mediolateral oblique projections were presented to 129 mammogram Breastscreen readers. The images consisted of 20 positive cases with single and multicentric masses in 16 and 4 cases, respectively (resulting in a total of 24 cancers), and readers were asked to identify and locate the lesions. Each lesion was then ranked according to a detectability rating (ie, the number of observers who correctly located the lesion divided by the total number of observers), and this was correlated with breast density, lesion size, and various descriptors of lesion shape and texture. RESULTS Negative and positive correlations between lesion detection and density (r = -0.64, P = .007) and size (r = 0.65, P = .005), respectively, were demonstrated. In terms of lesion size and shape, there were significant correlations between the probability of detection and area (r = 0.43, P = .04), perimeter (r = 0.66, P = .0004), lesion elongation (r = 0.49, P = .02), and lesion nonspiculation (r = 0.78, P < .0001). CONCLUSIONS The results of this study have identified specific lesion characteristics associated with shape that may contribute to reduced cancer detection. Mammographic sensitivity may be adversely affected without appropriate attention to spiculation.
Collapse
|
6
|
Breast mass segmentation using region-based and edge-based methods in a 4-stage multiscale system. Biomed Signal Process Control 2013. [DOI: 10.1016/j.bspc.2012.08.003] [Citation(s) in RCA: 34] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
7
|
Choi JY, Ro YM. Multiresolution local binary pattern texture analysis combined with variable selection for application to false-positive reduction in computer-aided detection of breast masses on mammograms. Phys Med Biol 2012; 57:7029-52. [DOI: 10.1088/0031-9155/57/21/7029] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
|
8
|
Rahmati P, Adler A, Hamarneh G. Mammography segmentation with maximum likelihood active contours. Med Image Anal 2012; 16:1167-86. [DOI: 10.1016/j.media.2012.05.005] [Citation(s) in RCA: 32] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2010] [Revised: 04/16/2012] [Accepted: 05/02/2012] [Indexed: 10/28/2022]
|
9
|
Liu H, Lan Y, Xu X, Song E, Hung CC. Fissures segmentation using surface features: content-based retrieval for mammographic mass using ensemble classifier. Acad Radiol 2011; 18:1475-84. [PMID: 22055794 DOI: 10.1016/j.acra.2011.08.012] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2011] [Revised: 08/20/2011] [Accepted: 08/23/2011] [Indexed: 10/15/2022]
Abstract
RATIONALE AND OBJECTIVES Accurate classification is critical in mammography computer-aided diagnosis using content-based image retrieval approaches (CBIR CAD). The objectives of this study were to: 1) develop an accurate ensemble classifier based on domain knowledge and a robust feature selection method for CBIR CAD; 2) propose three new features; and 3) assess the performance of the proposed method and new features by using a relatively large imaging data set. MATERIALS AND METHODS The data set used in this study consisted of 2114 regions of interest (ROI) extracted from a publicly available image database. The proposed ensemble classifier method we called E-DGA-KNN included four steps. In the first step, 804 ROIs depict masses were divided into five classes according to their boundary types. Then, each class of ROI with an equal number of negative ROIs were put together to create a sub-database. Second, a dual-stage genetic algorithm, which was called DGA, was applied on those five sub-databases for feature selection and weights determination respectively. In the third step, five base K-nearest neighbor (KNN) classifiers were created by using the results of the second step on 2114 ROIs, and five detection scores for a given queried ROI were obtained. Finally, these classifiers are combined to yield a final classification. The performances of the proposed methods were evaluated by using receiver operating characteristic (ROC) analysis. A comparison with eight different methods on the data set was provided which include the stepwise linear discriminative analysis algorithm (SLDA) and particle swarm optimization (PSO) algorithm with KNN classifier. RESULTS When four hybrid feature selection methods were applied with single KNN classifier (ie, DGA-KNN, SLDA-WGA-KNN, SLDA-PSO-KNN, GA-PSO-KNN) and the proposed E-DGA-KNN method to the data set, the computed areas under the ROC curve (Az) were 0.8782 ± 0.0080, 0.8675 ± 0.0081, 0.8623 ± 0.0083, 0.8725 ± 0.0079, and 0.8927 ± 0.0073, respectively. If all features and single KNN classifier were used, the Az value was 0.8478 ± 0.0088. Az values were 0.8592 ± 0.0083 and 0.8632 ± 0.0081 when SLDA or GA algorithm used alone. CONCLUSIONS In this study, an ensemble classifier based on domain knowledge and a dual-stage feature selection method was proposed. Evaluation results indicated that the proposed method achieved largest value of ROC compared to other algorithms. The proposed method shows better performance and has the potential to improve the performance of CBIR CAD in interpreting and analyzing mammograms.
Collapse
|
10
|
Mazurowski MA, Lo JY, Harrawood BP, Tourassi GD. Mutual information-based template matching scheme for detection of breast masses: from mammography to digital breast tomosynthesis. J Biomed Inform 2011; 44:815-23. [PMID: 21554985 DOI: 10.1016/j.jbi.2011.04.008] [Citation(s) in RCA: 24] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2010] [Revised: 04/21/2011] [Accepted: 04/22/2011] [Indexed: 10/18/2022]
Abstract
Development of a computational decision aid for a new medical imaging modality typically is a long and complicated process. It consists of collecting data in the form of images and annotations, development of image processing and pattern recognition algorithms for analysis of the new images and finally testing of the resulting system. Since new imaging modalities are developed more rapidly than ever before, any effort for decreasing the time and cost of this development process could result in maximizing the benefit of the new imaging modality to patients by making the computer aids quickly available to radiologists that interpret the images. In this paper, we make a step in this direction and investigate the possibility of translating the knowledge about the detection problem from one imaging modality to another. Specifically, we present a computer-aided detection (CAD) system for mammographic masses that uses a mutual information-based template matching scheme with intelligently selected templates. We presented principles of template matching with mutual information for mammography before. In this paper, we present an implementation of those principles in a complete computer-aided detection system. The proposed system, through an automatic optimization process, chooses the most useful templates (mammographic regions of interest) using a large database of previously collected and annotated mammograms. Through this process, the knowledge about the task of detecting masses in mammograms is incorporated in the system. Then, we evaluate whether our system developed for screen-film mammograms can be successfully applied not only to other mammograms but also to digital breast tomosynthesis (DBT) reconstructed slices without adding any DBT cases for training. Our rationale is that since mutual information is known to be a robust inter-modality image similarity measure, it has high potential of transferring knowledge between modalities in the context of the mass detection task. Experimental evaluation of the system on mammograms showed competitive performance compared to other mammography CAD systems recently published in the literature. When the system was applied "as-is" to DBT, its performance was notably worse than that for mammograms. However, with a simple additional preprocessing step, the performance of the system reached levels similar to that obtained for mammograms. In conclusion, the presented CAD system not only performed competitively on screen-film mammograms but it also performed robustly on DBT showing that direct transfer of knowledge across breast imaging modalities for mass detection is in fact possible.
Collapse
Affiliation(s)
- Maciej A Mazurowski
- Department of Radiology, Duke University Medical Center, 2424 Erwin Rd., Suite 302, Durham, NC 27705, USA.
| | | | | | | |
Collapse
|
11
|
Needs assessment for next generation computer-aided mammography reference image databases and evaluation studies. Int J Comput Assist Radiol Surg 2011; 6:749-67. [DOI: 10.1007/s11548-011-0553-9] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2010] [Accepted: 03/01/2011] [Indexed: 10/18/2022]
|
12
|
|
13
|
Song E, Jiang L, Jin R, Zhang L, Yuan Y, Li Q. Breast mass segmentation in mammography using plane fitting and dynamic programming. Acad Radiol 2009; 16:826-35. [PMID: 19362024 DOI: 10.1016/j.acra.2008.11.014] [Citation(s) in RCA: 32] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2008] [Revised: 11/25/2008] [Accepted: 11/25/2008] [Indexed: 11/18/2022]
Abstract
RATIONALE AND OBJECTIVES Segmentation is an important and challenging task in a computer-aided diagnosis (CAD) system. Accurate segmentation could improve the accuracy in lesion detection and characterization. The objective of this study is to develop and test a new segmentation method that aims at improving the performance level of breast mass segmentation in mammography, which could be used to provide accurate features for classification. MATERIALS AND METHODS This automated segmentation method consists of two main steps and combines the edge gradient, the pixel intensity, as well as the shape characteristics of the lesions to achieve good segmentation results. First, a plane fitting method was applied to a background-trend corrected region-of-interest (ROI) of a mass to obtain the edge candidate points. Second, dynamic programming technique was used to find the "optimal" contour of the mass from the edge candidate points. Area-based similarity measures based on the radiologist's manually marked annotation and the segmented region were employed as criteria to evaluate the performance level of the segmentation method. With the evaluation criteria, the new method was compared with 1) the dynamic programming method developed by Timp and Karssemeijer, and 2) the normalized cut segmentation method, based on 337 ROIs extracted from a publicly available image database. RESULTS The experimental results indicate that our segmentation method can achieve a higher performance level than the other two methods, and the improvements in segmentation performance level were statistically significant. For instance, the mean overlap percentage for the new algorithm was 0.71, whereas those for Timp's dynamic programming method and the normalized cut segmentation method were 0.63 (P < .001) and 0.61 (P < .001), respectively. CONCLUSIONS We developed a new segmentation method by use of plane fitting and dynamic programming, which achieved a relatively high performance level. The new segmentation method would be useful for improving the accuracy of computerized detection and classification of breast cancer in mammography.
Collapse
Affiliation(s)
- Enmin Song
- Center for Biomedical Imaging and Bioinformatics, School of Computer Science and Technology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430074, China.
| | | | | | | | | | | |
Collapse
|
14
|
GPCALMA: Implementation in Italian hospitals of a computer aided detection system for breast lesions by mammography examination. Phys Med 2009; 25:58-72. [DOI: 10.1016/j.ejmp.2008.05.002] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/03/2008] [Revised: 03/31/2008] [Accepted: 05/02/2008] [Indexed: 11/18/2022] Open
|
15
|
Elter M, Horsch A. CADx of mammographic masses and clustered microcalcifications: A review. Med Phys 2009; 36:2052-68. [PMID: 19610294 DOI: 10.1118/1.3121511] [Citation(s) in RCA: 141] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Affiliation(s)
- Matthias Elter
- Fraunhofer Institute for Integrated Circuits, Am Wolfsmantel 33, 91058 Erlangen, Germany.
| | | |
Collapse
|
16
|
Giger ML, Chan HP, Boone J. Anniversary paper: History and status of CAD and quantitative image analysis: the role of Medical Physics and AAPM. Med Phys 2009; 35:5799-820. [PMID: 19175137 PMCID: PMC2673617 DOI: 10.1118/1.3013555] [Citation(s) in RCA: 167] [Impact Index Per Article: 10.4] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023] Open
Abstract
The roles of physicists in medical imaging have expanded over the years, from the study of imaging systems (sources and detectors) and dose to the assessment of image quality and perception, the development of image processing techniques, and the development of image analysis methods to assist in detection and diagnosis. The latter is a natural extension of medical physicists' goals in developing imaging techniques to help physicians acquire diagnostic information and improve clinical decisions. Studies indicate that radiologists do not detect all abnormalities on images that are visible on retrospective review, and they do not always correctly characterize abnormalities that are found. Since the 1950s, the potential use of computers had been considered for analysis of radiographic abnormalities. In the mid-1980s, however, medical physicists and radiologists began major research efforts for computer-aided detection or computer-aided diagnosis (CAD), that is, using the computer output as an aid to radiologists-as opposed to a completely automatic computer interpretation-focusing initially on methods for the detection of lesions on chest radiographs and mammograms. Since then, extensive investigations of computerized image analysis for detection or diagnosis of abnormalities in a variety of 2D and 3D medical images have been conducted. The growth of CAD over the past 20 years has been tremendous-from the early days of time-consuming film digitization and CPU-intensive computations on a limited number of cases to its current status in which developed CAD approaches are evaluated rigorously on large clinically relevant databases. CAD research by medical physicists includes many aspects-collecting relevant normal and pathological cases; developing computer algorithms appropriate for the medical interpretation task including those for segmentation, feature extraction, and classifier design; developing methodology for assessing CAD performance; validating the algorithms using appropriate cases to measure performance and robustness; conducting observer studies with which to evaluate radiologists in the diagnostic task without and with the use of the computer aid; and ultimately assessing performance with a clinical trial. Medical physicists also have an important role in quantitative imaging, by validating the quantitative integrity of scanners and developing imaging techniques, and image analysis tools that extract quantitative data in a more accurate and automated fashion. As imaging systems become more complex and the need for better quantitative information from images grows, the future includes the combined research efforts from physicists working in CAD with those working on quantitative imaging systems to readily yield information on morphology, function, molecular structure, and more-from animal imaging research to clinical patient care. A historical review of CAD and a discussion of challenges for the future are presented here, along with the extension to quantitative image analysis.
Collapse
Affiliation(s)
- Maryellen L Giger
- Department of Radiology, University of Chicago, Chicago, Illinois 60637, USA.
| | | | | |
Collapse
|
17
|
Jiang L, Song E, Xu X, Ma G, Zheng B. Automated detection of breast mass spiculation levels and evaluation of scheme performance. Acad Radiol 2008; 15:1534-44. [PMID: 19000870 DOI: 10.1016/j.acra.2008.07.015] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2008] [Revised: 07/11/2008] [Accepted: 07/11/2008] [Indexed: 11/18/2022]
Abstract
RATIONALE AND OBJECTIVES Although the spiculation levels of breast mass boundaries are a primary sign of malignancy for masses detected on mammography, developing an automated computerized method to detect spiculation levels and quantitatively evaluating the performance of such a method is a difficult task. The objectives of this study were to (1) develop and test a new method to improve mass segmentation and detect mass boundary spiculation levels and (2) assess the performance of this method using a relatively large imaging data set. MATERIALS AND METHODS The fully automated method developed for this study includes three image-processing steps. In the first step, the principle of maximum entropy is applied in the selected region of interest (ROI) after correcting the background trend to enhance the initial outlines of a mass. In the second step, an active-contour model is used to refine the initial outlines. In the third step, spiculated lines connected to the mass boundary are detected and identified using a special line detector. A quantitative spiculation index is computed to assess the degree of spiculation. To develop and evaluate this automated method, 211 ROIs depicting masses were extracted from a publicly available image database. Among these ROIs, 106 depicted circumscribed mass regions and 105 involved spiculated mass regions. The performance of the method was evaluated using receiver-operating characteristic (ROC) analysis. RESULTS The computed area under the ROC curve, when applying the method to the data set, was 0.701 +/- 0.027. By setting up a threshold at a spiculation index of 5.0, the method achieved an overall classification accuracy of 66.4%, with 54.3% sensitivity and 78.3% specificity. CONCLUSIONS In this study, a new computerized method with a number of unique characteristics was developed to detect spiculated mass regions, and a simple spiculation index was applied to quantify mass spiculation levels. Although this quantitative index can be used to distinguish between spiculated and circumscribed masses, the results also suggest that the automated detection of mass spiculation levels remains a technical challenge.
Collapse
Affiliation(s)
- Luan Jiang
- Center for Biomedical Imaging and Bioinformatics, School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan 430074, China
| | | | | | | | | |
Collapse
|
18
|
Singh S, Tourassi GD, Baker JA, Samei E, Lo JY. Automated breast mass detection in 3D reconstructed tomosynthesis volumes: a featureless approach. Med Phys 2008; 35:3626-36. [PMID: 18777923 DOI: 10.1118/1.2953562] [Citation(s) in RCA: 36] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023] Open
Abstract
The purpose of this study was to propose and implement a computer aided detection (CADe) tool for breast tomosynthesis. This task was accomplished in two stages-a highly sensitive mass detector followed by a false positive (FP) reduction stage. Breast tomosynthesis data from 100 human subject cases were used, of which 25 subjects had one or more mass lesions and the rest were normal. For stage 1, filter parameters were optimized via a grid search. The CADe identified suspicious locations were reconstructed to yield 3D CADe volumes of interest. The first stage yielded a maximum sensitivity of 93% with 7.7 FPs/breast volume. Unlike traditional CADe algorithms in which the second stage FP reduction is done via feature extraction and analysis, instead information theory principles were used with mutual information as a similarity metric. Three schemes were proposed, all using leave-one-case-out cross validation sampling. The three schemes, A, B, and C, differed in the composition of their knowledge base of regions of interest (ROIs). Scheme A's knowledge base was comprised of all the mass and FP ROIs generated by the first stage of the algorithm. Scheme B had a knowledge base that contained information from mass ROIs and randomly extracted normal ROIs. Scheme C had information from three sources of information-masses, FPs, and normal ROIs. Also, performance was assessed as a function of the composition of the knowledge base in terms of the number of FP or normal ROIs needed by the system to reach optimal performance. The results indicated that the knowledge base needed no more than 20 times as many FPs and 30 times as many normal ROIs as masses to attain maximal performance. The best overall system performance was 85% sensitivity with 2.4 FPs per breast volume for scheme A, 3.6 FPs per breast volume for scheme B, and 3 FPs per breast volume for scheme C.
Collapse
Affiliation(s)
- Swatee Singh
- Department of Radiology, Duke University Medical Center, Durham, North Carolina 27705, USA.
| | | | | | | | | |
Collapse
|
19
|
Mazurowski MA, Zurada JM, Tourassi GD. Selection of examples in case-based computer-aided decision systems. Phys Med Biol 2008; 53:6079-96. [PMID: 18854606 DOI: 10.1088/0031-9155/53/21/013] [Citation(s) in RCA: 14] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Case-based computer-aided decision (CB-CAD) systems rely on a database of previously stored, known examples when classifying new, incoming queries. Such systems can be particularly useful since they do not need retraining every time a new example is deposited in the case base. The adaptive nature of case-based systems is well suited to the current trend of continuously expanding digital databases in the medical domain. To maintain efficiency, however, such systems need sophisticated strategies to effectively manage the available evidence database. In this paper, we discuss the general problem of building an evidence database by selecting the most useful examples to store while satisfying existing storage requirements. We evaluate three intelligent techniques for this purpose: genetic algorithm-based selection, greedy selection and random mutation hill climbing. These techniques are compared to a random selection strategy used as the baseline. The study is performed with a previously presented CB-CAD system applied for false positive reduction in screening mammograms. The experimental evaluation shows that when the development goal is to maximize the system's diagnostic performance, the intelligent techniques are able to reduce the size of the evidence database to 37% of the original database by eliminating superfluous and/or detrimental examples while at the same time significantly improving the CAD system's performance. Furthermore, if the case-base size is a main concern, the total number of examples stored in the system can be reduced to only 2-4% of the original database without a decrease in the diagnostic performance. Comparison of the techniques shows that random mutation hill climbing provides the best balance between the diagnostic performance and computational efficiency when building the evidence database of the CB-CAD system.
Collapse
Affiliation(s)
- Maciej A Mazurowski
- Department of Electrical and Computer Engineering, University of Louisville, Lutz Hall, Room 407, Louisville, KY 40292, USA.
| | | | | |
Collapse
|
20
|
Sampat MP, Bovik AC, Whitman GJ, Markey MK. A model-based framework for the detection of spiculated masses on mammography. Med Phys 2008; 35:2110-23. [PMID: 18561687 DOI: 10.1118/1.2890080] [Citation(s) in RCA: 46] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/11/2023] Open
Abstract
The detection of lesions on mammography is a repetitive and fatiguing task. Thus, computer-aided detection systems have been developed to aid radiologists. The detection accuracy of current systems is much higher for clusters of microcalcifications than for spiculated masses. In this article, the authors present a new model-based framework for the detection of spiculated masses. The authors have invented a new class of linear filters, spiculated lesion filters, for the detection of converging lines or spiculations. These filters are highly specific narrowband filters, which are designed to match the expected structures of spiculated masses. As a part of this algorithm, the authors have also invented a novel technique to enhance spicules on mammograms. This entails filtering in the radon domain. They have also developed models to reduce the false positives due to normal linear structures. A key contribution of this work is that the parameters of the detection algorithm are based on measurements of physical properties of spiculated masses. The results of the detection algorithm are presented in the form of free-response receiver operating characteristic curves on images from the Mammographic Image Analysis Society and Digital Database for Screening Mammography databases.
Collapse
Affiliation(s)
- Mehul P Sampat
- Department of Biomedical Engineering, The University of Texas, Austin, Texas 78712, USA
| | | | | | | |
Collapse
|
21
|
Abstract
PURPOSE OF REVIEW Computer-aided diagnosis (CAD) is a technology used for the detection and characterization of cancer. Although CAD is not limited to a single type of cancer, a large number of CAD systems to date have been designed and used for breast cancer. The aim of this review is to discuss the current state of the CAD systems for breast-cancer diagnosis, their application as a second reader in clinical practice, and studies that have evaluated the effect of CAD on radiologists' performance. RECENT FINDINGS A large number of CAD applications are being developed for different imaging modalities. Owing to commercially available Food and Drug Administration (FDA) approved systems, the main clinical use of CAD to date is for screen-film mammography. Many studies have shown that CAD improves radiologists' performance. A large number of academic institutions have devoted a substantial research effort to developing CAD methods. SUMMARY CAD systems will play an increasingly important role in the clinic as a second reader. Clinical trials have shown that CAD can improve the accuracy of breast-cancer detection. Preclinical studies have demonstrated the potential of CAD to improve the classification of malignant and benign lesions. An increased number of CAD systems are being developed for different breast-imaging modalities.
Collapse
Affiliation(s)
- Lubomir Hadjiiski
- Department of Radiology, University of Michigan, Ann Arbor, Michigan 48109-0904, USA.
| | | | | |
Collapse
|
22
|
Tourassi GD, Ike R, Singh S, Harrawood B. Evaluating the effect of image preprocessing on an information-theoretic CAD system in mammography. Acad Radiol 2008; 15:626-34. [PMID: 18423320 DOI: 10.1016/j.acra.2007.12.013] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2007] [Revised: 12/12/2007] [Accepted: 12/12/2007] [Indexed: 11/28/2022]
Abstract
RATIONALE AND OBJECTIVES In our earlier studies, we reported an evidence-based computer-assisted decision (CAD) system for location-specific interrogation of mammograms. A content-based image retrieval framework with information theoretic (IT) similarity measures serves as the foundation for this system. Specifically, the normalized mutual information (NMI) was shown to be the most effective similarity measure for reduction of false-positive marks generated by other prescreening mass detection schemes. The objective of this work was to investigate the importance of image filtering as a possible preprocessing step in our IT-CAD system. MATERIALS AND METHODS Different filters were applied, each one aiming to compensate for known limitations of the NMI similarity measure. The study was based on a region-of-interest database that included true masses and false-positive regions from digitized mammograms. RESULTS Receiver-operating characteristics (ROC) analysis showed that IT-CAD is affected slightly by image filtering. Modest, yet statistically significant, performance gain was observed with median filtering (overall ROC area index A(z) improved from 0.78 to 0.82). However, Gabor filtering improved performance for the high-sensitivity portion of the ROC curve where a typical false-positive reduction scheme should operate (partial ROC area index (0.90)A(z) improved from 0.33 to 0.37). Fusion of IT-CAD decisions from different filtering schemes markedly improved performance (A(z) = 0.90 and (0.90)A(z) = 0.55). At 95% sensitivity, the system's specificity improved by 36.6%. CONCLUSIONS Additional improvement in false-positive reduction can be achieved by incorporating image filtering as a preprocessing step in our IT-CAD system.
Collapse
Affiliation(s)
- Georgia D Tourassi
- Digital Advanced Imaging Laboratories, Department of Radiology, Duke University Medical Center, 2424 Erwin Road, Hock Plaza, Suite 302, Durham, NC 27710, USA.
| | | | | | | |
Collapse
|
23
|
Li Q. Reliable evaluation of performance level for computer-aided diagnostic scheme. Acad Radiol 2007; 14:985-91. [PMID: 17659245 PMCID: PMC2039704 DOI: 10.1016/j.acra.2007.04.015] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2006] [Revised: 04/09/2007] [Accepted: 04/29/2007] [Indexed: 10/23/2022]
Abstract
RATIONALE AND OBJECTIVES Computer-aided diagnostic (CAD) schemes have been developed for assisting radiologists in the detection of various lesions in medical images. The reliable evaluation of CAD schemes is an important task in the field of CAD research. MATERIALS AND METHODS Many evaluation approaches have been proposed for evaluating the performance of various CAD schemes in the past. However, some important issues in the evaluation of CAD schemes have not been systematically analyzed. The first important issue is the analysis and comparison of various evaluation methods in terms of certain characteristics. The second includes the analysis of pitfalls in the incorrect use of various evaluation methods and the effective approaches to the reduction of the bias and variance caused by these pitfalls. We attempt to address the first important issue in details in this article by conducting Monte Carlo simulation experiments, and to discuss the second issue in the Discussion section. RESULTS No single evaluation method is universally superior to the others; different situations of CAD applications require different evaluation methods, as recommended in this article. Bias and variance in the estimated performance levels caused by various pitfalls can be reduced considerably by the correct use of good evaluation methods. CONCLUSIONS This article would be useful to researchers in the field of CAD research for selecting appropriate evaluation methods and for improving the reliability of the estimated performance of their CAD schemes.
Collapse
Affiliation(s)
- Qiang Li
- Department of Radiology, University of Chicago, Chicago, IL 60637, USA.
| |
Collapse
|
24
|
Tourassi GD, Harrawood B, Singh S, Lo JY. Information-theoretic CAD system in mammography: Entropy-based indexing for computational efficiency and robust performance. Med Phys 2007; 34:3193-204. [PMID: 17879782 DOI: 10.1118/1.2751075] [Citation(s) in RCA: 28] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
We have previously presented a knowledge-based computer-assisted detection (KB-CADe) system for the detection of mammographic masses. The system is designed to compare a query mammographic region with mammographic templates of known ground truth. The templates are stored in an adaptive knowledge database. Image similarity is assessed with information theoretic measures (e.g., mutual information) derived directly from the image histograms. A previous study suggested that the diagnostic performance of the system steadily improves as the knowledge database is initially enriched with more templates. However, as the database increases in size, an exhaustive comparison of the query case with each stored template becomes computationally burdensome. Furthermore, blind storing of new templates may result in redundancies that do not necessarily improve diagnostic performance. To address these concerns we investigated an entropy-based indexing scheme for improving the speed of analysis and for satisfying database storage restrictions without compromising the overall diagnostic performance of our KB-CADe system. The indexing scheme was evaluated on two different datasets as (i) a search mechanism to sort through the knowledge database, and (ii) a selection mechanism to build a smaller, concise knowledge database that is easier to maintain but still effective. There were two important findings in the study. First, entropy-based indexing is an effective strategy to identify fast a subset of templates that are most relevant to a given query. Only this subset could be analyzed in more detail using mutual information for optimized decision making regarding the query. Second, a selective entropy-based deposit strategy may be preferable where only high entropy cases are maintained in the knowledge database. Overall, the proposed entropy-based indexing scheme was shown to reduce the computational cost of our KB-CADe system by 55% to 80% while maintaining the system's diagnostic performance.
Collapse
Affiliation(s)
- Georgia D Tourassi
- Digital Advanced Imaging Laboratories, Department of Radiology, Duke University Medical Center, Durham, North Carolina 27705, USA.
| | | | | | | |
Collapse
|
25
|
Eltonsy NH, Tourassi GD, Elmaghraby AS. A concentric morphology model for the detection of masses in mammography. IEEE TRANSACTIONS ON MEDICAL IMAGING 2007; 26:880-9. [PMID: 17679338 DOI: 10.1109/tmi.2007.895460] [Citation(s) in RCA: 49] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2023]
Abstract
We propose a technique for the automated detection of malignant masses in screening mammography. The technique is based on the presence of concentric layers surrounding a focal area with suspicious morphological characteristics and low relative incidence in the breast region. Mammographic locations with high concentration of concentric layers with progressively lower average intensity are considered suspicious deviations from normal parenchyma. The multiple concentric layers (MCLs) technique was trained and tested using the craniocaudal views of 270 mammographic cases with biopsy proven malignant masses from the digital database of screening mammography. One-half of the available cases were used for optimizing the parameters of the detection algorithm. The remaining cases were used for testing. During testing, malignant masses were detected with 92%, 88%, and 81% sensitivity at 5.4, 2.4, and 0.6 false positive marks per image. Testing on 82 normal screening mammograms showed a false positive rate of 5.0, 1.7, and 0.2 marks per image at the previously reported operating points. Furthermore, additional evaluation on 135 benign cases produced a significantly lower detection rate for benign masses (61.6%, 58.3%, and 43.7% at 5.1, 2.8, and 1.2 false positives per image, respectively). Overall, MCL is a promising computer-assisted detection strategy for screening mammograms to identify malignant masses while maintaining the detection rate of benign masses considerably lower.
Collapse
Affiliation(s)
- Nevine H Eltonsy
- Computer Engineering and Computer Science Department, Speed Scientific School, University of Louisville, Eastern Parkway Street, Louisville, KY 40292, USA.
| | | | | |
Collapse
|
26
|
Baydush AH, Catarious DM, Lo JY, Floyd CE. Incorporation of a Laguerre-Gauss channelized Hotelling observer for false-positive reduction in a mammographic mass CAD system. J Digit Imaging 2007; 20:196-202. [PMID: 17505872 PMCID: PMC3043903 DOI: 10.1007/s10278-007-9009-8] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2007] [Revised: 01/15/2007] [Accepted: 01/15/2007] [Indexed: 10/23/2022] Open
Abstract
Previously, we developed a simple Laguerre-Gauss (LG) channelized Hotelling observer (CHO) for incorporation into our mass computer-aided detection (CAD) system. This LG-CHO was trained using initial detection suspicious region data and was empirically optimized for free parameters. For the study presented in this paper, we wish to create a more optimal mass detection observer based on a novel combination of LG channels. A large set of LG channels with differing free parameters was created. Each of these channels was applied to the suspicious regions, and an output test statistic was determined. A stepwise feature selection algorithm was used to determine which LG channels would combine best to detect masses. These channels were combined using a HO to create a single template for the mass CAD system. Results from free-response receiver operating characteristic curves demonstrated that the incorporation of the novel LG-CHO into the CAD system slightly improved performance in high-sensitivity regions.
Collapse
Affiliation(s)
- Alan H Baydush
- Department of Radiation Oncology, Wake Forest University School of Medicine, Medical Center Blvd., Winston-Salem, NC 27157, USA.
| | | | | | | |
Collapse
|
27
|
Catarious DM, Baydush AH, Floyd CE. Characterization of difference of Gaussian filters in the detection of mammographic regions. Med Phys 2007; 33:4104-14. [PMID: 17153390 DOI: 10.1118/1.2358326] [Citation(s) in RCA: 27] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
In this article, we present a characterization of the effect of difference of Gaussians (DoG) filters in the detection of mammographic regions. DoG filters have been used previously in mammographic mass computer-aided detection (CAD) systems. As DoG filters are constructed from the subtraction of two bivariate Gaussian distributions, they require the specification of three parameters: the size of the filter template and the standard deviations of the constituent Gaussians. The influence of these three parameters in the detection of mammographic masses has not been characterized. In this work, we aim to determine how the parameters affect (1) the physical descriptors of the detected regions, (2) the true and false positive rates, and (3) the classification performance of the individual descriptors. To this end, 30 DoG filters are created from the combination of three template sizes and four values for each of the Gaussians' standard deviations. The filters are used to detect regions in a study database of 181 craniocaudal-view mammograms extracted from the Digital Database for Screening Mammography. To describe the physical characteristics of the identified regions, morphological and textural features are extracted from each of the detected regions. Differences in the mean values of the features caused by altering the DoG parameters are examined through statistical and empirical comparisons. The parameters' effects on the true and false positive rate are determined by examining the mean malignant sensitivities and false positives per image (FPpI). Finally, the effect on the classification performance is described by examining the variation in FPpI at the point where 81% of the malignant masses in the study database are detected. Overall, the findings of the study indicate that increasing the standard deviations of the Gaussians used to construct a DoG filter results in a dramatic decrease in the number of regions identified at the expense of missing a small number of malignancies. The sharp reduction in the number of identified regions allowed the identification of textural differences between large and small mammographic regions. We find that the classification performances of the features that achieve the lowest average FPpI are influenced by all three of the parameters.
Collapse
Affiliation(s)
- David M Catarious
- Department of Biomedical Engineering, Duke University, Durham, North Carolina 27710, USA.
| | | | | |
Collapse
|
28
|
Tourassi GD, Harrawood B, Singh S, Lo JY, Floyd CE. Evaluation of information-theoretic similarity measures for content-based retrieval and detection of masses in mammograms. Med Phys 2006; 34:140-50. [PMID: 17278499 DOI: 10.1118/1.2401667] [Citation(s) in RCA: 94] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
The purpose of this study was to evaluate image similarity measures employed in an information-theoretic computer-assisted detection (IT-CAD) scheme. The scheme was developed for content-based retrieval and detection of masses in screening mammograms. The study is aimed toward an interactive clinical paradigm where physicians query the proposed IT-CAD scheme on mammographic locations that are either visually suspicious or indicated as suspicious by other cuing CAD systems. The IT-CAD scheme provides an evidence-based, second opinion for query mammographic locations using a knowledge database of mass and normal cases. In this study, eight entropy-based similarity measures were compared with respect to retrieval precision and detection accuracy using a database of 1820 mammographic regions of interest. The IT-CAD scheme was then validated on a separate database for false positive reduction of progressively more challenging visual cues generated by an existing, in-house mass detection system. The study showed that the image similarity measures fall into one of two categories; one category is better suited to the retrieval of semantically similar cases while the second is more effective with knowledge-based decisions regarding the presence of a true mass in the query location. In addition, the IT-CAD scheme yielded a substantial reduction in false-positive detections while maintaining high detection rate for malignant masses.
Collapse
Affiliation(s)
- Georgia D Tourassi
- Digital Advanced Imaging Laboratories, Department of Radiology, Duke University Medical Center, Durham, North Carolina 27705, USA.
| | | | | | | | | |
Collapse
|
29
|
Bellotti R, De Carlo F, Tangaro S, Gargano G, Maggipinto G, Castellano M, Massafra R, Cascio D, Fauci F, Magro R, Raso G, Lauria A, Forni G, Bagnasco S, Cerello P, Zanon E, Cheran SC, Lopez Torres E, Bottigli U, Masala GL, Oliva P, Retico A, Fantacci ME, Cataldo R, De Mitri I, De Nunzio G. A completely automated CAD system for mass detection in a large mammographic database. Med Phys 2006; 33:3066-75. [PMID: 16964885 DOI: 10.1118/1.2214177] [Citation(s) in RCA: 78] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
Mass localization plays a crucial role in computer-aided detection (CAD) systems for the classification of suspicious regions in mammograms. In this article we present a completely automated classification system for the detection of masses in digitized mammographic images. The tool system we discuss consists in three processing levels: (a) Image segmentation for the localization of regions of interest (ROIs). This step relies on an iterative dynamical threshold algorithm able to select iso-intensity closed contours around gray level maxima of the mammogram. (b) ROI characterization by means of textural features computed from the gray tone spatial dependence matrix (GTSDM), containing second-order spatial statistics information on the pixel gray level intensity. As the images under study were recorded in different centers and with different machine settings, eight GTSDM features were selected so as to be invariant under monotonic transformation. In this way, the images do not need to be normalized, as the adopted features depend on the texture only, rather than on the gray tone levels, too. (c) ROI classification by means of a neural network, with supervision provided by the radiologist's diagnosis. The CAD system was evaluated on a large database of 3369 mammographic images [2307 negative, 1062 pathological (or positive), containing at least one confirmed mass, as diagnosed by an expert radiologist]. To assess the performance of the system, receiver operating characteristic (ROC) and free-response ROC analysis were employed. The area under the ROC curve was found to be Az = 0.783 +/- 0.008 for the ROI-based classification. When evaluating the accuracy of the CAD against the radiologist-drawn boundaries, 4.23 false positives per image are found at 80% of mass sensitivity.
Collapse
Affiliation(s)
- R Bellotti
- Dipartimento di Fisica, Università di Bari, Sezione INFN di Bari, Italy
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
30
|
Reiser I, Nishikawa RM, Giger ML, Wu T, Rafferty EA, Moore R, Kopans DB. Computerized mass detection for digital breast tomosynthesis directly from the projection images. Med Phys 2006; 33:482-91. [PMID: 16532956 DOI: 10.1118/1.2163390] [Citation(s) in RCA: 60] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
Digital breast tomosynthesis (DBT) has recently emerged as a new and promising three-dimensional modality in breast imaging. In DBT, the breast volume is reconstructed from 11 projection images, taken at source angles equally spaced over an arc of 50 degrees. Reconstruction algorithms for this modality are not fully optimized yet. Because computerized lesion detection in the reconstructed breast volume will be affected by the reconstruction technique, we are developing a novel mass detection algorithm that operates instead on the set of raw projection images. Mass detection is done in three stages. First, lesion candidates are obtained for each projection image separately, using a mass detection algorithm that was initially developed for screen-film mammography. Second, the locations of a lesion candidate are backprojected into the breast volume. In this feature volume, voxel intensities are a combined measure of detection frequency (e.g., the number of projections in which a given lesion candidate was detected), and a measure of the angular range over which a given lesion was detected. Third, features are extracted after reprojecting the three-dimensional (3-D) locations of lesion candidates into projection images. Features are combined using linear discriminant analysis. The database used to test the algorithm consisted of 21 mass cases (13 malignant, 8 benign) and 15 cases without mass lesions. Based on this database, the algorithm yielded a sensitivity of 90% at 1.5 false positives per breast volume. Algorithm performance is positively biased because this dataset was used for development, training, and testing, and because the number of algorithm parameters was approximately the same as the number.of patient cases. Our results indicate that computerized mass detection in the sequence of projection images for DBT may be effective despite the higher noise level in those images.
Collapse
Affiliation(s)
- I Reiser
- Department of Radiology, The University of Chicago, Chicago, Illinois 60637, USA
| | | | | | | | | | | | | |
Collapse
|
31
|
Li Q, Doi K. Reduction of bias and variance for evaluation of computer-aided diagnostic schemes. Med Phys 2006; 33:868-75. [PMID: 16696462 DOI: 10.1118/1.2179750] [Citation(s) in RCA: 58] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
Computer-aided diagnostic (CAD) schemes have been developed to assist radiologists in detecting various lesions in medical images. In addition to the development, an equally important problem is the reliable evaluation of the performance levels of various CAD schemes. It is good to see that more and more investigators are employing more reliable evaluation methods such as leave-one-out and cross validation, instead of less reliable methods such as resubstitution, for assessing their CAD schemes. However, the common applications of leave-one-out and cross-validation evaluation methods do not necessarily imply that the estimated performance levels are accurate and precise. Pitfalls often occur in the use of leave-one-out and cross-validation evaluation methods, and they lead to unreliable estimation of performance levels. In this study, we first identified a number of typical pitfalls for the evaluation of CAD schemes, and conducted a Monte Carlo simulation experiment for each of the pitfalls to demonstrate quantitatively the extent of bias and/or variance caused by the pitfall. Our experimental results indicate that considerable bias and variance may exist in the estimated performance levels of CAD schemes if one employs various flawed leave-one-out and cross-validation evaluation methods. In addition, for promoting and utilizing a high standard for reliable evaluation of CAD schemes, we attempt to make recommendations, whenever possible, for overcoming these pitfalls. We believe that, with the recommended evaluation methods, we can considerably reduce the bias and variance in the estimated performance levels of CAD schemes.
Collapse
Affiliation(s)
- Qiang Li
- Department of Radiology, The University of Chicago, Chicago, Illinois 60637, USA.
| | | |
Collapse
|
32
|
Chen W, Giger ML, Bick U. A fuzzy c-means (FCM)-based approach for computerized segmentation of breast lesions in dynamic contrast-enhanced MR images. Acad Radiol 2006; 13:63-72. [PMID: 16399033 DOI: 10.1016/j.acra.2005.08.035] [Citation(s) in RCA: 174] [Impact Index Per Article: 9.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2005] [Revised: 08/25/2005] [Accepted: 08/27/2005] [Indexed: 11/21/2022]
Abstract
RATIONALE AND OBJECTIVES Accurate quantification of the shape and extent of breast tumors has a vital role in nearly all applications of breast magnetic resonance (MR) imaging (MRI). Specifically, tumor segmentation is a key component in the computerized assessment of likelihood of malignancy. However, manual delineation of lesions in four-dimensional MR images is labor intensive and subject to interobserver and intraobserver variations. We developed a computerized lesion segmentation method that has the advantage of being automatic, efficient, and objective. MATERIALS AND METHODS We present a fuzzy c-means (FCM) clustering-based method for the segmentation of breast lesions in three dimensions from contrast-enhanced MR images. The proposed lesion segmentation algorithm consists of six consecutive stages: region of interest (ROI) selection by a human operator, lesion enhancement within the selected ROI, application of FCM on the enhanced ROI, binarization of the lesion membership map, connected-component labeling and object selection, and hole-filling on the selected object. We applied the algorithm to a clinical MR database consisting of 121 primary mass lesions. Manual segmentation of the lesions by an expert MR radiologist served as a reference in the evaluation of the computerized segmentation method. We also compared the proposed algorithm with a previously developed volume-growing (VG) method. RESULTS For the 121 mass lesions in our database, 97% of lesions were segmented correctly by means of the proposed FCM-based method at an overlap threshold of 0.4, whereas 84% of lesions were correctly segmented by means of the VG method. CONCLUSION Our proposed algorithm for breast-lesion segmentation in dynamic contrast-enhanced MRI was shown to be effective and efficient.
Collapse
Affiliation(s)
- Weijie Chen
- University of Chicago, Radiology, 584 South Maryland, MC Chicago, IL , USA.
| | | | | |
Collapse
|
33
|
Das SK, Baydush AH, Zhou S, Miften M, Yu X, Craciunescu O, Oldham M, Light K, Wong T, Blazing M, Borges-Neto S, Dewhirst MW, Marks LB. Predicting radiotherapy-induced cardiac perfusion defects. Med Phys 2004; 32:19-27. [PMID: 15719950 DOI: 10.1118/1.1823571] [Citation(s) in RCA: 27] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
The purpose of this work is to compare the efficacy of mathematical models in predicting the occurrence of radiotherapy-induced left ventricular perfusion defects assessed using single-photon emission computed tomography (SPECT). The basis of this study is data from 73 left-sided breast/ chestwall patients treated with tangential photon fields. The mathematical models compared were three commonly used parametric models [Lyman normal tissue complication probability (LNTCP), relative serialty (RS), generalized equivalent uniform dose (gEUD)] and a nonparametric model (Linear discriminant analysis--LDA). Data used by the models were the left ventricular dose--volume histograms, or SPECT-based dose-function histograms, and the presence/absence of SPECT perfusion defects 6 months postradiation therapy (21 patients developed defects). For the parametric models, maximum likelihood estimation and F-tests were used to fit the model parameters. The nonparametric LDA model step-wise selected features (volumes/function above dose levels) using a method based on receiver operating characteristics (ROC) analysis to best separate the groups with and without defects. Optimistic (upper bound) and pessimistic (lower bound) estimates of each model's predictive capability were generated using ROC curves. A higher area under the ROC curve indicates a more accurate model (a model that is always accurate has area = 1). The areas under these curves for different models were used to statistically test for differences between them. Pessimistic estimates of areas under the ROC curve using dose-volume histogram/ dose-function histogram inputs, in order of increasing prediction accuracy, were LNTCP (0.79/0.75), RS (0.80/0.77), gEUD (0.81/0.78), and LDA (0.84/0.86). Only the LDA model benefited from SPECT-based regional functional information. In general, the LDA model was statistically superior to the parametric models. The LDA model selected as features the left ventricular volumes above approximately 23 Gy (V23), essentially volume in field, and 33 Gy (V33), as best separating the groups with and without defects. In conclusion, the nonparametric LDA model appears to be a more accurate predictor of radiotherapy-induced left ventricular perfusion defects than commonly used parametric models.
Collapse
Affiliation(s)
- Shiva K Das
- Department of Radiation Oncology, Duke University Medical Center, Durham, North Carolina 27710, USA.
| | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|