1
|
Lee SH, Park H, Ko ES. Radiomics in Breast Imaging from Techniques to Clinical Applications: A Review. Korean J Radiol 2020; 21:779-792. [PMID: 32524780 PMCID: PMC7289696 DOI: 10.3348/kjr.2019.0855] [Citation(s) in RCA: 49] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2019] [Revised: 01/31/2020] [Accepted: 02/28/2020] [Indexed: 02/06/2023] Open
Abstract
Recent advances in computer technology have generated a new area of research known as radiomics. Radiomics is defined as the high throughput extraction and analysis of quantitative features from imaging data. Radiomic features provide information on the gray-scale patterns, inter-pixel relationships, as well as shape and spectral properties of radiological images. Moreover, these features can be used to develop computational models that may serve as a tool for personalized diagnosis and treatment guidance. Although radiomics is becoming popular and widely used in oncology, many problems such as overfitting and reproducibility issues remain unresolved. In this review, we will outline the steps of radiomics used for oncology, specifically addressing applications for breast cancer patients and focusing on technical issues.
Collapse
Affiliation(s)
- Seung Hak Lee
- Department of Electrical and Computer Engineering, Sungkyunkwan University, Suwon, Korea.,Center for Neuroscience Imaging Research, Institute for Basic Science (IBS), Suwon, Korea
| | - Hyunjin Park
- Center for Neuroscience Imaging Research, Institute for Basic Science (IBS), Suwon, Korea.,School of Electronic and Electrical Engineering, Sungkyunkwan University, Suwon, Korea
| | - Eun Sook Ko
- Department of Radiology, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Korea.
| |
Collapse
|
2
|
Rehman SU, Tu S, Waqas M, Huang Y, Rehman OU, Ahmad B, Ahmad S. Unsupervised pre-trained filter learning approach for efficient convolution neural network. Neurocomputing 2019. [DOI: 10.1016/j.neucom.2019.06.084] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2023]
|
3
|
Application of Gabor wavelet and Locality Sensitive Discriminant Analysis for automated identification of breast cancer using digitized mammogram images. Appl Soft Comput 2016. [DOI: 10.1016/j.asoc.2016.04.036] [Citation(s) in RCA: 43] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
4
|
Parekh V, Jacobs MA. Radiomics: a new application from established techniques. EXPERT REVIEW OF PRECISION MEDICINE AND DRUG DEVELOPMENT 2016; 1:207-226. [PMID: 28042608 PMCID: PMC5193485 DOI: 10.1080/23808993.2016.1164013] [Citation(s) in RCA: 217] [Impact Index Per Article: 27.1] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
Abstract
The increasing use of biomarkers in cancer have led to the concept of personalized medicine for patients. Personalized medicine provides better diagnosis and treatment options available to clinicians. Radiological imaging techniques provide an opportunity to deliver unique data on different types of tissue. However, obtaining useful information from all radiological data is challenging in the era of "big data". Recent advances in computational power and the use of genomics have generated a new area of research termed Radiomics. Radiomics is defined as the high throughput extraction of quantitative imaging features or texture (radiomics) from imaging to decode tissue pathology and creating a high dimensional data set for feature extraction. Radiomic features provide information about the gray-scale patterns, inter-pixel relationships. In addition, shape and spectral properties can be extracted within the same regions of interest on radiological images. Moreover, these features can be further used to develop computational models using advanced machine learning algorithms that may serve as a tool for personalized diagnosis and treatment guidance.
Collapse
Affiliation(s)
- Vishwa Parekh
- The Russell H. Morgan Department of Radiology and Radiological Science, Division of Cancer Imaging, The Johns Hopkins University School of Medicine, Baltimore, MD 21205
- Department of Computer Science, The Johns Hopkins University School of Medicine, Baltimore, MD 21205
| | - Michael A. Jacobs
- The Russell H. Morgan Department of Radiology and Radiological Science, Division of Cancer Imaging, The Johns Hopkins University School of Medicine, Baltimore, MD 21205
- Sidney Kimmel Comprehensive Cancer Center, The Johns Hopkins University School of Medicine, Baltimore, MD 21205
| |
Collapse
|
5
|
Choi JY. A generalized multiple classifier system for improving computer-aided classification of breast masses in mammography. Biomed Eng Lett 2016. [DOI: 10.1007/s13534-015-0191-1] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022] Open
|
6
|
Kim DH, Choi JY, Ro YM. Region based stellate features combined with variable selection using AdaBoost learning in mammographic computer-aided detection. Comput Biol Med 2015; 63:238-50. [DOI: 10.1016/j.compbiomed.2014.09.006] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2014] [Revised: 09/12/2014] [Accepted: 09/16/2014] [Indexed: 11/28/2022]
|
7
|
Beura S, Majhi B, Dash R. Mammogram classification using two dimensional discrete wavelet transform and gray-level co-occurrence matrix for detection of breast cancer. Neurocomputing 2015. [DOI: 10.1016/j.neucom.2014.12.032] [Citation(s) in RCA: 91] [Impact Index Per Article: 10.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
8
|
Zhang J, Silber JI, Mazurowski MA. Modeling false positive error making patterns in radiology trainees for improved mammography education. J Biomed Inform 2015; 54:50-7. [PMID: 25640462 DOI: 10.1016/j.jbi.2015.01.007] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2014] [Revised: 01/13/2015] [Accepted: 01/19/2015] [Indexed: 10/24/2022]
Abstract
INTRODUCTION While mammography notably contributes to earlier detection of breast cancer, it has its limitations, including a large number of false positive exams. Improved radiology education could potentially contribute to alleviating this issue. Toward this goal, in this paper we propose an algorithm for modeling of false positive error making among radiology trainees. Identifying troublesome locations for the trainees could focus their training and in turn improve their performance. METHODS The algorithm proposed in this paper predicts locations that are likely to result in a false positive error for each trainee based on the previous annotations made by the trainee. The algorithm consists of three steps. First, the suspicious false positive locations are identified in mammograms by Difference of Gaussian filter and suspicious regions are segmented by computer vision-based segmentation algorithms. Second, 133 features are extracted for each suspicious region to describe its distinctive characteristics. Third, a random forest classifier is applied to predict the likelihood of the trainee making a false positive error using the extracted features. The random forest classifier is trained using previous annotations made by the trainee. We evaluated the algorithm using data from a reader study in which 3 experts and 10 trainees interpreted 100 mammographic cases. RESULTS The algorithm was able to identify locations where the trainee will commit a false positive error with accuracy higher than an algorithm that selects such locations randomly. Specifically, our algorithm found false positive locations with 40% accuracy when only 1 location was selected for all cases for each trainee and 12% accuracy when 10 locations were selected. The accuracies for randomly identified locations were both 0% for these two scenarios. CONCLUSIONS In this first study on the topic, we were able to build computer models that were able to find locations for which a trainee will make a false positive error in images that were not previously seen by the trainee. Presenting the trainees with such locations rather than randomly selected ones may improve their educational outcomes.
Collapse
Affiliation(s)
- Jing Zhang
- Department of Radiology, Duke University School of Medicine, Durham, NC, United States; Computer Science Department, Lamar University, Beaumont, TX, United States.
| | - James I Silber
- Department of Biomedical Engineering, Duke University Pratt School of Engineering, Durham, NC, United States
| | - Maciej A Mazurowski
- Department of Radiology, Duke University School of Medicine, Durham, NC, United States; Duke Cancer Institute, United States; Duke Medical Physics Program, United States
| |
Collapse
|
9
|
Kim ST, Kim DH, Ro YM. Breast mass detection using slice conspicuity in 3D reconstructed digital breast volumes. Phys Med Biol 2014; 59:5003-23. [PMID: 25119017 DOI: 10.1088/0031-9155/59/17/5003] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
In digital breast tomosynthesis, the three dimensional (3D) reconstructed volumes only provide quasi-3D structure information with limited resolution along the depth direction due to insufficient sampling in depth direction and the limited angular range. The limitation could seriously hamper the conventional 3D image analysis techniques for detecting masses because the limited number of projection views causes blurring in the out-of-focus planes. In this paper, we propose a novel mass detection approach using slice conspicuity in the 3D reconstructed digital breast volumes to overcome the above limitation. First, to overcome the limited resolution along the depth direction, we detect regions of interest (ROIs) on each reconstructed slice and separately utilize the depth directional information to combine the ROIs effectively. Furthermore, we measure the blurriness of each slice for resolving the degradation of performance caused by the blur in the out-of-focus plane. Finally, mass features are extracted from the selected in focus slices and analyzed by a support vector machine classifier to reduce the false positives. Comparative experiments have been conducted on a clinical data set. Experimental results demonstrate that the proposed approach outperforms the conventional 3D approach by achieving a high sensitivity with a small number of false positives.
Collapse
Affiliation(s)
- Seong Tae Kim
- Department of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST) 291, Daehak-ro, Yuseong-gu, Daejeon, 305-701, Republic of Korea
| | | | | |
Collapse
|
10
|
Choi JY, Kim DH, Plataniotis KN, Ro YM. Computer-aided detection (CAD) of breast masses in mammography: combined detection and ensemble classification. Phys Med Biol 2014; 59:3697-719. [DOI: 10.1088/0031-9155/59/14/3697] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
11
|
Choi JY, Ro YM. Multiresolution local binary pattern texture analysis combined with variable selection for application to false-positive reduction in computer-aided detection of breast masses on mammograms. Phys Med Biol 2012; 57:7029-52. [DOI: 10.1088/0031-9155/57/21/7029] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
|
12
|
Giger ML, Chan HP, Boone J. Anniversary paper: History and status of CAD and quantitative image analysis: the role of Medical Physics and AAPM. Med Phys 2009; 35:5799-820. [PMID: 19175137 PMCID: PMC2673617 DOI: 10.1118/1.3013555] [Citation(s) in RCA: 165] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023] Open
Abstract
The roles of physicists in medical imaging have expanded over the years, from the study of imaging systems (sources and detectors) and dose to the assessment of image quality and perception, the development of image processing techniques, and the development of image analysis methods to assist in detection and diagnosis. The latter is a natural extension of medical physicists' goals in developing imaging techniques to help physicians acquire diagnostic information and improve clinical decisions. Studies indicate that radiologists do not detect all abnormalities on images that are visible on retrospective review, and they do not always correctly characterize abnormalities that are found. Since the 1950s, the potential use of computers had been considered for analysis of radiographic abnormalities. In the mid-1980s, however, medical physicists and radiologists began major research efforts for computer-aided detection or computer-aided diagnosis (CAD), that is, using the computer output as an aid to radiologists-as opposed to a completely automatic computer interpretation-focusing initially on methods for the detection of lesions on chest radiographs and mammograms. Since then, extensive investigations of computerized image analysis for detection or diagnosis of abnormalities in a variety of 2D and 3D medical images have been conducted. The growth of CAD over the past 20 years has been tremendous-from the early days of time-consuming film digitization and CPU-intensive computations on a limited number of cases to its current status in which developed CAD approaches are evaluated rigorously on large clinically relevant databases. CAD research by medical physicists includes many aspects-collecting relevant normal and pathological cases; developing computer algorithms appropriate for the medical interpretation task including those for segmentation, feature extraction, and classifier design; developing methodology for assessing CAD performance; validating the algorithms using appropriate cases to measure performance and robustness; conducting observer studies with which to evaluate radiologists in the diagnostic task without and with the use of the computer aid; and ultimately assessing performance with a clinical trial. Medical physicists also have an important role in quantitative imaging, by validating the quantitative integrity of scanners and developing imaging techniques, and image analysis tools that extract quantitative data in a more accurate and automated fashion. As imaging systems become more complex and the need for better quantitative information from images grows, the future includes the combined research efforts from physicists working in CAD with those working on quantitative imaging systems to readily yield information on morphology, function, molecular structure, and more-from animal imaging research to clinical patient care. A historical review of CAD and a discussion of challenges for the future are presented here, along with the extension to quantitative image analysis.
Collapse
Affiliation(s)
- Maryellen L Giger
- Department of Radiology, University of Chicago, Chicago, Illinois 60637, USA.
| | | | | |
Collapse
|
13
|
Chan HP, Wei J, Zhang Y, Helvie MA, Moore RH, Sahiner B, Hadjiiski L, Kopans DB. Computer-aided detection of masses in digital tomosynthesis mammography: comparison of three approaches. Med Phys 2008; 35:4087-95. [PMID: 18841861 DOI: 10.1118/1.2968098] [Citation(s) in RCA: 74] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
The authors are developing a computer-aided detection (CAD) system for masses on digital breast tomosynthesis mammograms (DBT). Three approaches were evaluated in this study. In the first approach, mass candidate identification and feature analysis are performed in the reconstructed three-dimensional (3D) DBT volume. A mass likelihood score is estimated for each mass candidate using a linear discriminant analysis (LDA) classifier. Mass detection is determined by a decision threshold applied to the mass likelihood score. A free response receiver operating characteristic (FROC) curve that describes the detection sensitivity as a function of the number of false positives (FPs) per breast is generated by varying the decision threshold over a range. In the second approach, prescreening of mass candidate and feature analysis are first performed on the individual two-dimensional (2D) projection view (PV) images. A mass likelihood score is estimated for each mass candidate using an LDA classifier trained for the 2D features. The mass likelihood images derived from the PVs are backprojected to the breast volume to estimate the 3D spatial distribution of the mass likelihood scores. The FROC curve for mass detection can again be generated by varying the decision threshold on the 3D mass likelihood scores merged by backprojection. In the third approach, the mass likelihood scores estimated by the 3D and 2D approaches, described above, at the corresponding 3D location are combined and evaluated using FROC analysis. A data set of 100 DBT cases acquired with a GE prototype system at the Breast Imaging Laboratory in the Massachusetts General Hospital was used for comparison of the three approaches. The LDA classifiers with stepwise feature selection were designed with leave-one-case-out resampling. In FROC analysis, the CAD system for detection in the DBT volume alone achieved test sensitivities of 80% and 90% at average FP rates of 1.94 and 3.40 per breast, respectively. With the 2D detection approach, the FP rates were 2.86 and 4.05 per breast, respectively, at the corresponding sensitivities. In comparison, the average FP rates of the system combining the 3D and 2D information were 1.23 and 2.04 per breast, respectively, at 80% and 90% sensitivities. The difference in the detection performances between the 2D and the 3D approach, and that between the 3D and the combined approach were both statistically significant (p = 0.02 and 0.01, respectively) as estimated by alternative FROC analysis. The combined system is a promising approach to improving automated mass detection on DBTs.
Collapse
Affiliation(s)
- Heang-Ping Chan
- Department of Radiology, University of Michigan, Ann Arbor, Michigan 48109-5842, USA.
| | | | | | | | | | | | | | | |
Collapse
|
14
|
Wei J, Hadjiiski LM, Sahiner B, Chan HP, Ge J, Roubidoux MA, Helvie MA, Zhou C, Wu YT, Paramagul C, Zhang Y. Computer-aided detection systems for breast masses: comparison of performances on full-field digital mammograms and digitized screen-film mammograms. Acad Radiol 2007; 14:659-69. [PMID: 17502255 PMCID: PMC2040166 DOI: 10.1016/j.acra.2007.02.017] [Citation(s) in RCA: 16] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2006] [Revised: 02/12/2007] [Accepted: 02/13/2007] [Indexed: 10/23/2022]
Abstract
RATIONALE AND OBJECTIVES To compare the performance of computer aided detection (CAD) systems on pairs of full-field digital mammogram (FFDM) and screen-film mammogram (SFM) obtained from the same patients. MATERIALS AND METHODS Our CAD systems on both modalities have similar architectures that consist of five steps. For FFDMs, the input raw image is first log-transformed and enhanced by a multiresolution preprocessing scheme. For digitized SFMs, the input image is smoothed and subsampled to a pixel size of 100 microm x 100 microm. For both CAD systems, the mammogram after preprocessing undergoes a gradient field analysis followed by clustering-based region growing to identify suspicious breast structures. Each of these structures is refined in a local segmentation process. Morphologic and texture features are then extracted from each detected structure, and trained rule-based and linear discriminant analysis classifiers are used to differentiate masses from normal tissues. Two datasets, one with masses and the other without masses, were collected. The mass dataset contained 131 cases with 131 biopsy proven masses, of which 27 were malignant and 104 benign. The true locations of the masses were identified by an experienced Mammography Quality Standards Act (MQSA) radiologist. The no-mass data set contained 98 cases. The time interval between the FFDM and the corresponding SFM was 0 to 118 days. RESULTS Our CAD system achieved case-based sensitivities of 70%, 80%, and 90% at 0.9, 1.5, and 2.6 false positive (FP) marks/image, respectively, on FFDMs, and the same sensitivities at 1.0, 1.4, and 2.6 FP marks/image, respectively, on SFMs. CONCLUSIONS The difference in the performances of our FFDM and SFM CAD systems did not achieve statistical significance.
Collapse
Affiliation(s)
- Jun Wei
- Department of Radiology, University of Michigan, Ann Arbor, MI 48109, USA.
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
15
|
Sahiner B, Chan HP, Hadjiiski LM, Helvie MA, Paramagul C, Ge J, Wei J, Zhou C. Joint two-view information for computerized detection of microcalcifications on mammograms. Med Phys 2006; 33:2574-85. [PMID: 16898462 PMCID: PMC3026322 DOI: 10.1118/1.2208919] [Citation(s) in RCA: 29] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
We are developing new techniques to improve the accuracy of computerized microcalcification detection by using the joint two-view information on craniocaudal (CC) and mediolateral-oblique (MLO) views. After cluster candidates were detected using a single-view detection technique, candidates on CC and MLO views were paired using their radial distances from the nipple. Candidate pairs were classified with a similarity classifier that used the joint information from both views. Each cluster candidate was also characterized by its single-view features. The outputs of the similarity classifier and the single-view classifier were fused and the cluster candidate was classified as a true microcalcification cluster or a false-positive (FP) using the fused two-view information. A data set of 116 pairs of mammograms containing microcalcification clusters and 203 pairs of normal images from the University of South Florida (USF) public database was used for training the two-view detection algorithm. The trained method was tested on an independent test set of 167 pairs of mammograms, which contained 71 normal pairs and 96 pairs with microcalcification clusters collected at the University of Michigan (UM). The similarity classifier had a very low FP rate for the test set at low and medium levels of sensitivity. However, the highest mammogram-based sensitivity that could be reached by the similarity classifier was 69%. The single-view classifier had a higher FP rate compared to the similarity classifier, but it could reach a maximum mammogram-based sensitivity of 93%. The fusion method combined the scores of these two classifiers so that the number of FPs was substantially reduced at relatively low and medium sensitivities, and a relatively high maximum sensitivity was maintained. For the malignant microcalcification clusters, at a mammogram-based sensitivity of 80%, the FP rates were 0.18 and 0.35 with the two-view fusion and single-view detection methods, respectively. When the training and test sets were switched, a similar improvement was obtained, except that both the fusion and single-view detection methods had superior test performances on the USF data set than those on the UM data set. Our results indicate that correspondence of cluster candidates on two different views provides valuable additional information for distinguishing FPs from true microcalcification clusters.
Collapse
Affiliation(s)
- Berkman Sahiner
- Department of Radiology, University of Michigan, Ann Arbor 48109-0904, USA.
| | | | | | | | | | | | | | | |
Collapse
|
16
|
Wei J, Chan HP, Sahiner B, Hadjiiski LM, Helvie MA, Roubidoux MA, Zhou C, Ge J. Dual system approach to computer-aided detection of breast masses on mammograms. Med Phys 2006; 33:4157-68. [PMID: 17153394 PMCID: PMC2742210 DOI: 10.1118/1.2357838] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
In this study, our purpose was to improve the performance of our mass detection system by using a new dual system approach which combines a computer-added detection (CAD) system optimized with "average" masses with another CAD system optimized with "subtle" masses. The two single CAD systems have similar image processing steps, which include prescreening, object segmentation, morphological and texture feature extraction, and false positive (FP) reduction by rule-based and linear discriminant analysis (LDA) classifiers. A feed-forward backpropagation artificial neural network was trained to merge the scores from the LDA classifiers in the two single CAD systems and differentiate true masses from normal tissue. For an unknown test mammogram, the two single CAD systems are applied to the image in parallel to detect suspicious objects. A total of three data sets were used for training and testing the systems. The first data set of 230 current mammograms, referred to as the average mass set, was collected from 115 patients. We also collected 264 mammograms, referred to as the subtle mass set, which were one to two years prior to the current exam from these patients. Both the average and the subtle mass sets were partitioned into two independent data sets in a cross validation training and testing scheme. A third data set containing 65 cases with 260 normal mammograms was used to estimate the FP marker rates during testing. When the single CAD system trained on the average mass set was applied to the test set with average masses, the FP marker rates were 2.2, 1.8, and 1.5 per image at the case-based sensitivities of 90%, 85%, and 80%, respectively. With the dual CAD system, the FP marker rates were reduced to 1.2, 0.9, and 0.7 per image, respectively, at the same case-based sensitivities. Statistically significant (p < 0.05) improvements on the free response receiver operating characteristic curves were observed when the dual system and the single system were compared using the test sets with either average masses or subtle masses.
Collapse
Affiliation(s)
- Jun Wei
- Department of Radiology, University of Michigan, Ann Arbor Michigan 48109, USA.
| | | | | | | | | | | | | | | |
Collapse
|
17
|
Bellotti R, De Carlo F, Tangaro S, Gargano G, Maggipinto G, Castellano M, Massafra R, Cascio D, Fauci F, Magro R, Raso G, Lauria A, Forni G, Bagnasco S, Cerello P, Zanon E, Cheran SC, Lopez Torres E, Bottigli U, Masala GL, Oliva P, Retico A, Fantacci ME, Cataldo R, De Mitri I, De Nunzio G. A completely automated CAD system for mass detection in a large mammographic database. Med Phys 2006; 33:3066-75. [PMID: 16964885 DOI: 10.1118/1.2214177] [Citation(s) in RCA: 78] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
Mass localization plays a crucial role in computer-aided detection (CAD) systems for the classification of suspicious regions in mammograms. In this article we present a completely automated classification system for the detection of masses in digitized mammographic images. The tool system we discuss consists in three processing levels: (a) Image segmentation for the localization of regions of interest (ROIs). This step relies on an iterative dynamical threshold algorithm able to select iso-intensity closed contours around gray level maxima of the mammogram. (b) ROI characterization by means of textural features computed from the gray tone spatial dependence matrix (GTSDM), containing second-order spatial statistics information on the pixel gray level intensity. As the images under study were recorded in different centers and with different machine settings, eight GTSDM features were selected so as to be invariant under monotonic transformation. In this way, the images do not need to be normalized, as the adopted features depend on the texture only, rather than on the gray tone levels, too. (c) ROI classification by means of a neural network, with supervision provided by the radiologist's diagnosis. The CAD system was evaluated on a large database of 3369 mammographic images [2307 negative, 1062 pathological (or positive), containing at least one confirmed mass, as diagnosed by an expert radiologist]. To assess the performance of the system, receiver operating characteristic (ROC) and free-response ROC analysis were employed. The area under the ROC curve was found to be Az = 0.783 +/- 0.008 for the ROI-based classification. When evaluating the accuracy of the CAD against the radiologist-drawn boundaries, 4.23 false positives per image are found at 80% of mass sensitivity.
Collapse
Affiliation(s)
- R Bellotti
- Dipartimento di Fisica, Università di Bari, Sezione INFN di Bari, Italy
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
18
|
Wei J, Sahiner B, Hadjiiski LM, Chan HP, Petrick N, Helvie MA, Roubidoux MA, Ge J, Zhou C. Computer-aided detection of breast masses on full field digital mammograms. Med Phys 2006; 32:2827-38. [PMID: 16266097 PMCID: PMC2742215 DOI: 10.1118/1.1997327] [Citation(s) in RCA: 80] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
We are developing a computer-aided detection (CAD) system for breast masses on full field digital mammographic (FFDM) images. To develop a CAD system that is independent of the FFDM manufacturer's proprietary preprocessing methods, we used the raw FFDM image as input and developed a multiresolution preprocessing scheme for image enhancement. A two-stage prescreening method that combines gradient field analysis with gray level information was developed to identify mass candidates on the processed images. The suspicious structure in each identified region was extracted by clustering-based region growing. Morphological and spatial gray-level dependence texture features were extracted for each suspicious object. Stepwise linear discriminant analysis (LDA) with simplex optimization was used to select the most useful features. Finally, rule-based and LDA classifiers were designed to differentiate masses from normal tissues. Two data sets were collected: a mass data set containing 110 cases of two-view mammograms with a total of 220 images, and a no-mass data set containing 90 cases of two-view mammograms with a total of 180 images. All cases were acquired with a GE Senographe 2000D FFDM system. The true locations of the masses were identified by an experienced radiologist. Free-response receiver operating characteristic analysis was used to evaluate the performance of the CAD system. It was found that our CAD system achieved a case-based sensitivity of 70%, 80%, and 90% at 0.72, 1.08, and 1.82 false positive (FP) marks/image on the mass data set. The FP rates on the no-mass data set were 0.85, 1.31, and 2.14 FP marks/image, respectively, at the corresponding sensitivities. This study demonstrated the usefulness of our CAD techniques for automated detection of masses on FFDM images.
Collapse
Affiliation(s)
- Jun Wei
- Department of Radiology, University of Michigan, Ann Arbor, Michigan 48109, USA.
| | | | | | | | | | | | | | | | | |
Collapse
|
19
|
Characterization of Breast Abnormality Patterns in Digital Mammograms Using Auto-associator Neural Network. ACTA ACUST UNITED AC 2006. [DOI: 10.1007/11893295_15] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register]
|
20
|
Abstract
It is well established that radiologists are better able to interpret mammograms when two mammographic views are available. Consequently, two mammographic projections are standard: mediolateral oblique (MLO) and craniocaudal (CC). Computer-aided diagnosis algorithms have been investigated for assisting in the detection and diagnosis of breast lesions in digitized/digital mammograms. A few previous studies suggest that computer-aided systems may also benefit from combining evidence from the two views. Intuitively, we expect that there would only be value in merging data from two views if they provide complementary information. A measure of the similarity of information is the correlation coefficient between corresponding features from the MLO and CC views. The purpose of this study was to investigate the correspondence in Haralick's texture features between the MLO and CC mammographic views of breast lesions. Features were ranked on the basis of correlation values and the two-view correlation of features for subgroups of data including masses versus calcification and benign versus malignant lesions were compared. All experiments were performed on a subset of mammography cases from the Digital Database for Screening Mammography (DDSM). It was observed that the texture features from the MLO and CC views were less strongly correlated for calcification lesions than for mass lesions. Similarly, texture features from the two views were less strongly correlated for benign lesions than for malignant lesions. These differences were statistically significant. The results suggest that the inclusion of texture features from multiple mammographic views in a CADx algorithm may impact the accuracy of diagnosis of calcification lesions and benign lesions.
Collapse
Affiliation(s)
- Shalini Gupta
- Department of Electrical and Computer Engineering, The University of Texas at Austin, Austin, Texas 78712-0240, USA
| | | |
Collapse
|
21
|
Singh S, Bovis K. An Evaluation of Contrast Enhancement Techniques for Mammographic Breast Masses. ACTA ACUST UNITED AC 2005; 9:109-19. [PMID: 15787013 DOI: 10.1109/titb.2004.837851] [Citation(s) in RCA: 73] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The main aim of this paper is to propose a novel set of metrics that measure the quality of the image enhancement of mammographic images in a computer-aided detection framework aimed at automatically finding masses using machine learning techniques. Our methodology includes a novel mechanism for the combination of the metrics proposed into a single quantitative measure. We have evaluated our methodology on 200 images from the publicly available digital database for screening mammograms. We show that the quantitative measures help us select the best suited image enhancement on a per mammogram basis, which improves the quality of subsequent image segmentation much better than using the same enhancement method for all mammograms.
Collapse
Affiliation(s)
- Sameer Singh
- Autonomous Technologies Research, Department of Computer Science, University of Exeter, Exeter EX4 4QF, UK.
| | | |
Collapse
|
22
|
|
23
|
Zheng B, Chang YH, Good WF, Gur D. Performance gain in computer-assisted detection schemes by averaging scores generated from artificial neural networks with adaptive filtering. Med Phys 2001; 28:2302-8. [PMID: 11764037 DOI: 10.1118/1.1412240] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
The authors investigated a new method to optimize artificial neural networks (ANNs) with adaptive filtering used in computer-assisted detection schemes in digitized mammograms and to assess performance changes when averaging classification scores from three sets of optimized schemes. Two independent training and testing image databases involving 978 and 830 digitized mammograms, respectively, were used in this study. In the training data set, initial filtering and subtraction resulted in the identification of 592 mass regions and 3790 suspicious, but actually negative regions. These regions (including both true-positive and negative regions) were segmented into three subsets three times based on the calculation of the values of three features as segmentation indices. The indices were "mass" size multiplied by their digital value contrast, conspicuity, and circularity. Nine ANN-based classifiers were separately optimized using a genetic algorithm for each subset of regions. Each region was assigned three classification scores after applying the three adaptive ANNs. The performance gain of the CAD scheme after averaging the three scores for each suspicious region was tested using an independent data set and a ROC methodology. The experimental results showed that the areas under ROC curves (Az) for the testing database using three sets of optimized ANNs individually were 0.84+/-0.01, 0.83+/-0.01, and 0.84+/-0.01, respectively. The between-index correlations of three A values were 0.013, -0.007, and 0.086. Similar to averaging diagnostic ratings from independent observers, by averaging three ANN-generated scores for each testing region, the performance of the CAD scheme was significantly improved (p<0.001) with Az value of 0.95+/-0.01.
Collapse
Affiliation(s)
- B Zheng
- Department of Radiology, University of Pittsburgh, Pittsburgh, Pennsylvania 15213, USA.
| | | | | | | |
Collapse
|
24
|
Vedantham S, Karellas A, Suryanarayanan S, D'Orsi CJ, Hendrick RE. Breast imaging using an amorphous silicon-based full-field digital mammographic system: stability of a clinical prototype. J Digit Imaging 2000; 13:191-9. [PMID: 11110258 PMCID: PMC3453066 DOI: 10.1007/bf03168394] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022] Open
Abstract
An amorphous silicon-based full-breast imager for digital mammography was evaluated for detector stability over a period of 1 year. This imager uses a structured CsI:TI scintillator coupled to an amorphous silicon layer with a 100-micron pixel pitch and read out by special purpose electronics. The stability of the system was characterized using the following quantifiable metrics: conversion factor (mean number of electrons generated per incident x-ray), presampling modulation transfer function (MTF), detector linearity and sensitivity, detector signal-to-noise ratio (SNR), and American College of Radiology (ACR) accreditation phantom scores. Qualitative metrics such as flat field uniformity, geometric distortion, and Society of Motion Picture and Television Engineers (SMPTE) test pattern image quality were also used to study the stability of the system. Observations made over this 1-year period indicated that the maximum variation from the average of the measurements were less than 0.5% for conversion factor, 3% for presampling MTF over all spatial frequencies, 5% for signal response, linearity and sensitivity, 12% for SNR over seven locations for all 3 target-filter combinations, and 0% for ACR accreditation phantom scores. ACR mammographic accreditation phantom images indicated the ability to resolve 5 fibers, 4 speck groups, and 5 masses at a mean glandular dose of 1.23 mGy. The SMPTE pattern image quality test for the display monitors used for image viewing indicated ability to discern all contrast steps and ability to distinguish line-pair images at the center and corners of the image. No bleeding effects were observed in the image. Flat field uniformity for all 3 target-filter combinations displayed no artifacts such as gridlines, bad detector rows or columns, horizontal or vertical streaks, or bad pixels. Wire mesh screen images indicated uniform resolution and no geometric distortion.
Collapse
Affiliation(s)
- S Vedantham
- Department of Radiology, UMass Memorial Health Care, University of Massachusetts Medical School, Worcester 01655, USA
| | | | | | | | | |
Collapse
|
25
|
Rangayyan RM, Mudigonda NR, Desautels JE. Boundary modelling and shape analysis methods for classification of mammographic masses. Med Biol Eng Comput 2000; 38:487-96. [PMID: 11094803 DOI: 10.1007/bf02345742] [Citation(s) in RCA: 77] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Abstract
The problem of computer-aided classification of benign and malignant breast masses using shape features is addressed. The aim of the study is to look at the exceptions in shapes of masses such as circumscribed malignant tumours and spiculated benign masses which are difficult to classify correctly using common shape analysis methods. The proposed methods of shape analysis treat the object's boundary in terms of local details. The boundaries of masses analysed using the proposed methods were manually drawn on mammographic images by an expert radiologist (JELD). A boundary segmentation method is used to separate major portions of the boundary and to label them as concave or convex segments. To analyse the shape information localised in each segment, features are computed through an iterative procedure for polygonal modelling of the mass boundaries. Features are based on the concavity fraction of a mass boundary and the degree of narrowness of spicules as characterised by a spiculation index. Two features comprising spiculation index (SI) and fractional concavity (fcc) developed in the present study when used in combination with the global shape feature of compactness resulted in a benign/malignant classification accuracy of 82%, with an area (Az) of 0.79 under the receiver operating characteristics (ROC) curve with a database of the boundaries of 28 benign masses and 26 malignant tumours. SI alone resulted in a classification accuracy of 80% with Az of 0.82. The combination of all the three features achieved 91% accuracy of circumscribed versus spiculated classification of masses based on shape.
Collapse
Affiliation(s)
- R M Rangayyan
- Department of Electrical and Computer Engineering, University of Calgary, Canada.
| | | | | |
Collapse
|
26
|
Vedantham S, Karellas A, Suryanarayanan S, Levis I, Sayag M, Kleehammer R, Heidsieck R, D’Orsi CJ. Mammographic imaging with a small format CCD-based digital cassette: physical characteristics of a clinical system. Med Phys 2000; 27:1832-40. [PMID: 10984230 PMCID: PMC4280185 DOI: 10.1118/1.1286720] [Citation(s) in RCA: 42] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
The physical characteristics of a clinical charge coupled device (CCD)-based imager (Senovision, GE Medical Systems, Milwaukee, WI) for small-field digital mammography have been investigated. The imager employs a MinR 2000 (Eastman Kodak Company, Rochester, NY) scintillator coupled by a 1:1 optical fiber to a front-illuminated 61 x 61 mm CCD operating at a pixel pitch of 30 microns. Objective criteria such as modulation transfer function (MTF), noise power spectrum (NPS), detective quantum efficiency (DQE), and noise equivalent quanta (NEQ) were employed for this evaluation. The results demonstrated a limiting spatial resolution (10% MTF) of 10 cy/mm. The measured DQE of the current prototype utilizing a 28 kVp, Mo-Mo spectrum beam hardened with 4.5 cm Lucite is approximately 40% at close to zero spatial frequency at an exposure of 8.2 mR, and decreases to approximately 28% at a low exposure of 1.1 mR. Detector element nonuniformity and electronic gain variations were not significant after appropriate calibration and software corrections. The response of the imager was linear and did not exhibit signal saturation under tested exposure conditions.
Collapse
Affiliation(s)
- Srinivasan Vedantham
- Department of Radiology, UMass Memorial Health Care, University of Massachusetts Medical School, Worcester, Massachusetts 01655
| | - Andrew Karellas
- Author to whom correspondence should be addressed. Electronic mail:
| | - Sankararaman Suryanarayanan
- Department of Radiology, UMass Memorial Health Care, University of Massachusetts Medical School, Worcester, Massachusetts 01655
| | - Ilias Levis
- Department of Radiology, UMass Memorial Health Care, University of Massachusetts Medical School, Worcester, Massachusetts 01655
| | - Michel Sayag
- Lockheed Martin Fairchild Systems, Milpitas, California 95035
| | | | | | - Carl J. D’Orsi
- Department of Radiology, UMass Memorial Health Care, University of Massachusetts Medical School, Worcester, Massachusetts 01655
| |
Collapse
|
27
|
Vedantham S, Karellas A, Suryanarayanan S. Full breast digital mammography with an amorphous silicon-based flat panel detector: physical characteristics of a clinical prototype. Med Phys 2000; 27:558-67. [PMID: 10757607 PMCID: PMC4280189 DOI: 10.1118/1.598895] [Citation(s) in RCA: 207] [Impact Index Per Article: 8.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
The physical characteristics of a clinical prototype amorphous silicon-based flat panel imager for full-breast digital mammography have been investigated. The imager employs a thin thallium doped CsI scintillator on an amorphous silicon matrix of detector elements with a pixel pitch of 100 microm. Objective criteria such as modulation transfer function (MTF), noise power spectrum, detective quantum efficiency (DQE), and noise equivalent quanta were employed for this evaluation. The presampling MTF was found to be 0.73, 0.42, and 0.28 at 2, 4, and 5 cycles/mm, respectively. The measured DQE of the current prototype utilizing a 28 kVp, Mo-Mo spectrum beam hardened with 4.5 cm Lucite is approximately 55% at close to zero spatial frequency at an exposure of 32.8 mR, and decreases to approximately 40% at a low exposure of 1.3 mR. Detector element nonuniformity and electronic gain variations were not significant after appropriate calibration and software corrections. The response of the imager was linear and did not exhibit signal saturation under tested exposure conditions.
Collapse
Affiliation(s)
| | - Andrew Karellas
- Author to whom correspondence should be addressed; electronic mail:
| | | |
Collapse
|
28
|
Petrick N, Chan HP, Sahiner B, Helvie MA. Combined adaptive enhancement and region-growing segmentation of breast masses on digitized mammograms. Med Phys 1999; 26:1642-54. [PMID: 10501064 DOI: 10.1118/1.598658] [Citation(s) in RCA: 83] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
As an ongoing effort to develop a computer aid for detection of masses on mammograms, we recently designed an object-based region-growing technique to improve mass segmentation. This segmentation method utilizes the density-weighted contrast enhancement (DWCE) filter as a pre-processing step. The DWCE filter adaptively enhances the contrast between the breast structures and the background. Object-based region growing was then applied to each of the identified structures. The region-growing technique uses gray-scale and gradient information to adjust the initial object borders and to reduce merging between adjacent or overlapping structures. Each object is then classified as a breast mass or normal tissue based on extracted morphological and texture features. In this study we evaluated the sensitivity of this combined segmentation scheme and its ability to reduce false positive (FP) detections on a data set of 253 digitized mammograms, each of which contained a biopsy-proven breast mass. It was found that the segmentation scheme detected 98% of the 253 biopsy-proven breast masses in our data set. After final FP reduction, the detection resulted in 4.2 FP per image at a 90% true positive (TP) fraction and 2.0 FPs per image at an 80% TP fraction. The combined DWCE and object-based region growing technique increased the initial detection sensitivity, reduced merging between neighboring structures, and reduced the number of FP detections in our automated breast mass detection scheme.
Collapse
Affiliation(s)
- N Petrick
- The University of Michigan, Department of Radiology, Ann Arbor 48109-0904, USA
| | | | | | | |
Collapse
|
29
|
Lo JY, Baker JA, Kornguth PJ, Floyd CE. Effect of patient history data on the prediction of breast cancer from mammographic findings with artificial neural networks. Acad Radiol 1999; 6:10-5. [PMID: 9891147 DOI: 10.1016/s1076-6332(99)80056-7] [Citation(s) in RCA: 38] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
RATIONALE AND OBJECTIVES The authors evaluated the contribution of medical history data to the prediction of breast cancer with artificial neural network (ANN) models based on mammographic findings. MATERIALS AND METHODS Three ANNs were developed: The first used 10 Breast Imaging Reporting and Data System (BI-RADS) variables; the second, the BI-RADS variables plus patient age; the third, the BI-RADS variables, patient age, and seven other history variables, for a total of 18 inputs. Performance of the ANNs and the original radiologist's impression were evaluated with five metrics: receiver operating characteristic area index (Az); specificity at given sensitivities of 100%, 98%, and 95%; and positive predictive value. RESULTS All three ANNs consistently outperformed the radiologist's impression over all five performance metrics. The patient-age variable was particularly valuable. Adding the age variable to the basic ANN model, which used only the BI-RADS findings, significantly improved Az (P = .028). In fact, replacing all history data with just the age variable resulted in virtually no changes for Az or specificity at 98% sensitivity (P = .324 and P = .410, respectively). CONCLUSION Patient age was an important variable for the prediction of breast cancer from mammographic findings with the ANNs. For this data set, all history data could be replaced with age alone.
Collapse
Affiliation(s)
- J Y Lo
- Department of Radiology, Duke University Medical Center, Durham, NC 27710, USA
| | | | | | | |
Collapse
|