1
|
Loizidou K, Elia R, Pitris C. Computer-aided breast cancer detection and classification in mammography: A comprehensive review. Comput Biol Med 2023; 153:106554. [PMID: 36646021 DOI: 10.1016/j.compbiomed.2023.106554] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2022] [Revised: 12/13/2022] [Accepted: 01/11/2023] [Indexed: 01/15/2023]
Abstract
Cancer is the second cause of mortality worldwide and it has been identified as a perilous disease. Breast cancer accounts for ∼20% of all new cancer cases worldwide, making it a major cause of morbidity and mortality. Mammography is an effective screening tool for the early detection and management of breast cancer. However, the identification and interpretation of breast lesions is challenging even for expert radiologists. For that reason, several Computer-Aided Diagnosis (CAD) systems are being developed to assist radiologists to accurately detect and/or classify breast cancer. This review examines the recent literature on the automatic detection and/or classification of breast cancer in mammograms, using both conventional feature-based machine learning and deep learning algorithms. The review begins with a comparison of algorithms developed specifically for the detection and/or classification of two types of breast abnormalities, micro-calcifications and masses, followed by the use of sequential mammograms for improving the performance of the algorithms. The available Food and Drug Administration (FDA) approved CAD systems related to triage and diagnosis of breast cancer in mammograms are subsequently presented. Finally, a description of the open access mammography datasets is provided and the potential opportunities for future work in this field are highlighted. The comprehensive review provided here can serve both as a thorough introduction to the field but also provide indicative directions to guide future applications.
Collapse
Affiliation(s)
- Kosmia Loizidou
- KIOS Research and Innovation Center of Excellence, Department of Electrical and Computer Engineering, University of Cyprus, Nicosia, Cyprus.
| | - Rafaella Elia
- KIOS Research and Innovation Center of Excellence, Department of Electrical and Computer Engineering, University of Cyprus, Nicosia, Cyprus.
| | - Costas Pitris
- KIOS Research and Innovation Center of Excellence, Department of Electrical and Computer Engineering, University of Cyprus, Nicosia, Cyprus.
| |
Collapse
|
2
|
Loizidou K, Skouroumouni G, Nikolaou C, Pitris C. A Review of Computer-Aided Breast Cancer Diagnosis Using Sequential Mammograms. Tomography 2022; 8:2874-2892. [PMID: 36548533 PMCID: PMC9785714 DOI: 10.3390/tomography8060241] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2022] [Revised: 11/18/2022] [Accepted: 12/02/2022] [Indexed: 12/12/2022] Open
Abstract
Radiologists assess the results of mammography, the key screening tool for the detection of breast cancer, to determine the presence of malignancy. They, routinely, compare recent and prior mammographic views to identify changes between the screenings. In case a new lesion appears in a mammogram, or a region is changing rapidly, it is more likely to be suspicious, compared to a lesion that remains unchanged and it is usually benign. However, visual evaluation of mammograms is challenging even for expert radiologists. For this reason, various Computer-Aided Diagnosis (CAD) algorithms are being developed to assist in the diagnosis of abnormal breast findings using mammograms. Most of the current CAD systems do so using only the most recent mammogram. This paper provides a review of the development of methods to emulate the radiological approach and perform automatic segmentation and/or classification of breast abnormalities using sequential mammogram pairs. It begins with demonstrating the importance of utilizing prior views in mammography, through the review of studies where the performance of expert and less-trained radiologists was compared. Following, image registration techniques and their application to mammography are presented. Subsequently, studies that implemented temporal analysis or subtraction of temporally sequential mammograms are summarized. Finally, a description of the open access mammography datasets is provided. This comprehensive review can serve as a thorough introduction to the use of prior information in breast cancer CAD systems but also provides indicative directions to guide future applications.
Collapse
Affiliation(s)
- Kosmia Loizidou
- KIOS Research and Innovation Center of Excellence, Department of Electrical and Computer Engineering, University of Cyprus, Nicosia 2109, Cyprus
| | | | - Christos Nikolaou
- Radiology Department, Limassol General Hospital, Limassol 3304, Cyprus
| | - Costas Pitris
- KIOS Research and Innovation Center of Excellence, Department of Electrical and Computer Engineering, University of Cyprus, Nicosia 2109, Cyprus
| |
Collapse
|
3
|
Pan X, Qi B, Yu H, Wei H, Kang Y. A new idea for visualization of lesions distribution in mammogram based on CPD registration method. Technol Health Care 2017; 25:459-467. [PMID: 28582934 DOI: 10.3233/thc-171349] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND Mammography is currently the most effective technique for breast cancer. Lesions distribution can provide support for clinical diagnosis and epidemiological studies. OBJECTIVE We presented a new idea to help radiologists study breast lesions distribution conveniently. We also developed an automatic tool based on this idea which could show visualization of lesions distribution in a standard mammogram. METHODS Firstly, establishing a lesion database to study; then, extracting breast contours and match different women's mammograms to a standard mammogram; finally, showing the lesion distribution in the standard mammogram, and providing the distribution statistics. The crucial process of developing this tool was matching different women's mammograms correctly. We used a hybrid breast contour extraction method combined with coherent point drift method to match different women's mammograms. RESULTS We tested our automatic tool by four mass datasets of 641 images. The distribution results shown by the tool were consistent with the results counted according to their reports and mammograms by manual. We also discussed the registration error that was less than 3.3 mm in average distance. CONCLUSIONS The new idea is effective and the automatic tool can provide lesions distribution results which are consistent with radiologists simply and conveniently.
Collapse
Affiliation(s)
- Xiaoguang Pan
- School of Computer and Communication Engineering, Liaoning Shihua University, Fushun, Liaoning, China
| | - Buer Qi
- Medical IT Division, NEUSOFT Corporation, Shenyang, Liaoning, China
| | - Hongfei Yu
- School of Computer and Communication Engineering, Liaoning Shihua University, Fushun, Liaoning, China
| | - Haiping Wei
- School of Computer and Communication Engineering, Liaoning Shihua University, Fushun, Liaoning, China
| | - Yan Kang
- Medical IT Division, NEUSOFT Corporation, Shenyang, Liaoning, China
| |
Collapse
|
4
|
Lee CY, Wang HJ, Lai JH, Chang YC, Huang CS. Automatic Marker-free Longitudinal Infrared Image Registration by Shape Context Based Matching and Competitive Winner-guided Optimal Corresponding. Sci Rep 2017; 7:39834. [PMID: 28145474 PMCID: PMC5286440 DOI: 10.1038/srep39834] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2016] [Accepted: 11/25/2016] [Indexed: 12/03/2022] Open
Abstract
Long-term comparisons of infrared image can facilitate the assessment of breast cancer tissue growth and early tumor detection, in which longitudinal infrared image registration is a necessary step. However, it is hard to keep markers attached on a body surface for weeks, and rather difficult to detect anatomic fiducial markers and match them in the infrared image during registration process. The proposed study, automatic longitudinal infrared registration algorithm, develops an automatic vascular intersection detection method and establishes feature descriptors by shape context to achieve robust matching, as well as to obtain control points for the deformation model. In addition, competitive winner-guided mechanism is developed for optimal corresponding. The proposed algorithm is evaluated in two ways. Results show that the algorithm can quickly lead to accurate image registration and that the effectiveness is superior to manual registration with a mean error being 0.91 pixels. These findings demonstrate that the proposed registration algorithm is reasonably accurate and provide a novel method of extracting a greater amount of useful data from infrared images.
Collapse
Affiliation(s)
- Chia-Yen Lee
- Department of Electrical Engineering, National United University, Taiwan
| | - Hao-Jen Wang
- Department of Electrical Engineering, National United University, Taiwan.,Institute of Biomedical Engineering, National Taiwan University, Taiwan
| | - Jhih-Hao Lai
- Department of Electrical Engineering, National United University, Taiwan
| | - Yeun-Chung Chang
- Department of Medical Imaging, National Taiwan University Hospital and National Taiwan University College of Medicine, Taiwan
| | - Chiun-Sheng Huang
- Department of Surgery, National Taiwan University Hospital and National Taiwan University College of Medicine, Taiwan
| |
Collapse
|
5
|
Giger ML, Karssemeijer N, Schnabel JA. Breast image analysis for risk assessment, detection, diagnosis, and treatment of cancer. Annu Rev Biomed Eng 2013; 15:327-57. [PMID: 23683087 DOI: 10.1146/annurev-bioeng-071812-152416] [Citation(s) in RCA: 118] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The role of breast image analysis in radiologists' interpretation tasks in cancer risk assessment, detection, diagnosis, and treatment continues to expand. Breast image analysis methods include segmentation, feature extraction techniques, classifier design, biomechanical modeling, image registration, motion correction, and rigorous methods of evaluation. We present a review of the current status of these task-based image analysis methods, which are being developed for the various image acquisition modalities of mammography, tomosynthesis, computed tomography, ultrasound, and magnetic resonance imaging. Depending on the task, image-based biomarkers from such quantitative image analysis may include morphological, textural, and kinetic characteristics and may depend on accurate modeling and registration of the breast images. We conclude with a discussion of future directions.
Collapse
Affiliation(s)
- Maryellen L Giger
- Department of Radiology, University of Chicago, Chicago, IL 60637, USA.
| | | | | |
Collapse
|
6
|
Samulski M, Karssemeijer N. Optimizing Case-based detection performance in a multiview CAD system for mammography. IEEE TRANSACTIONS ON MEDICAL IMAGING 2011; 30:1001-1009. [PMID: 21233045 DOI: 10.1109/tmi.2011.2105886] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/30/2023]
Abstract
When reading mammograms, radiologists combine information from multiple views to detect abnormalities. Most computer-aided detection (CAD) systems, however, use primitive methods for inclusion of multiview context or analyze each view independently. In previous research it was found that in mammography lesion-based detection performance of CAD systems can be improved when correspondences between MLO and CC views are taken into account. However, detection at case level detection did not improve. In this paper, we propose a new learning method for multiview CAD systems, which is aimed at optimizing case-based detection performance. The method builds on a single-view lesion detection system and a correspondence classifier. The latter provides class probabilities for the various types of region pairs and correspondence features. The correspondence classifier output is used to bias the selection of training patterns for a multiview CAD system. In this way training can be forced to focus on optimization of case-based detection performance. The method is applied to the problem of detecting malignant masses and architectural distortions. Experiments involve 454 mammograms consisting of four views with a malignant region visible in at least one of the views. To evaluate performance, five-fold cross validation and FROC analysis was performed. Bootstrapping was used for statistical analysis. A significant increase of case-based detection performance was found when the proposed method was used. Mean sensitivity increased by 4.7% in the range of 0.01-0.5 false positives per image.
Collapse
Affiliation(s)
- Maurice Samulski
- Department of Radiology, Radboud University Nijmegen Medical Centre, 6525 GA Nijmegen, The Netherlands.
| | | |
Collapse
|
7
|
|
8
|
Armato SG, Sensakovic WF, Passen SJ, Engelmann R, MacMahon H. Temporal subtraction in chest radiography: Mutual information as a measure of image quality. Med Phys 2009; 36:5675-82. [DOI: 10.1118/1.3259712] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022] Open
Affiliation(s)
- Samuel G. Armato
- Department of Radiology, The University of Chicago, 5841 South Maryland Avenue, Chicago, Illinois 60637
| | - William F. Sensakovic
- Department of Radiology, The University of Chicago, 5841 South Maryland Avenue, Chicago, Illinois 60637
| | - Samantha J. Passen
- Department of Radiology, The University of Chicago, 5841 South Maryland Avenue, Chicago, Illinois 60637
| | - Roger Engelmann
- Department of Radiology, The University of Chicago, 5841 South Maryland Avenue, Chicago, Illinois 60637
| | - Heber MacMahon
- Department of Radiology, The University of Chicago, 5841 South Maryland Avenue, Chicago, Illinois 60637
| |
Collapse
|
9
|
Elter M, Horsch A. CADx of mammographic masses and clustered microcalcifications: A review. Med Phys 2009; 36:2052-68. [PMID: 19610294 DOI: 10.1118/1.3121511] [Citation(s) in RCA: 141] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Affiliation(s)
- Matthias Elter
- Fraunhofer Institute for Integrated Circuits, Am Wolfsmantel 33, 91058 Erlangen, Germany.
| | | |
Collapse
|
10
|
Giger ML, Chan HP, Boone J. Anniversary paper: History and status of CAD and quantitative image analysis: the role of Medical Physics and AAPM. Med Phys 2009; 35:5799-820. [PMID: 19175137 PMCID: PMC2673617 DOI: 10.1118/1.3013555] [Citation(s) in RCA: 167] [Impact Index Per Article: 11.1] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023] Open
Abstract
The roles of physicists in medical imaging have expanded over the years, from the study of imaging systems (sources and detectors) and dose to the assessment of image quality and perception, the development of image processing techniques, and the development of image analysis methods to assist in detection and diagnosis. The latter is a natural extension of medical physicists' goals in developing imaging techniques to help physicians acquire diagnostic information and improve clinical decisions. Studies indicate that radiologists do not detect all abnormalities on images that are visible on retrospective review, and they do not always correctly characterize abnormalities that are found. Since the 1950s, the potential use of computers had been considered for analysis of radiographic abnormalities. In the mid-1980s, however, medical physicists and radiologists began major research efforts for computer-aided detection or computer-aided diagnosis (CAD), that is, using the computer output as an aid to radiologists-as opposed to a completely automatic computer interpretation-focusing initially on methods for the detection of lesions on chest radiographs and mammograms. Since then, extensive investigations of computerized image analysis for detection or diagnosis of abnormalities in a variety of 2D and 3D medical images have been conducted. The growth of CAD over the past 20 years has been tremendous-from the early days of time-consuming film digitization and CPU-intensive computations on a limited number of cases to its current status in which developed CAD approaches are evaluated rigorously on large clinically relevant databases. CAD research by medical physicists includes many aspects-collecting relevant normal and pathological cases; developing computer algorithms appropriate for the medical interpretation task including those for segmentation, feature extraction, and classifier design; developing methodology for assessing CAD performance; validating the algorithms using appropriate cases to measure performance and robustness; conducting observer studies with which to evaluate radiologists in the diagnostic task without and with the use of the computer aid; and ultimately assessing performance with a clinical trial. Medical physicists also have an important role in quantitative imaging, by validating the quantitative integrity of scanners and developing imaging techniques, and image analysis tools that extract quantitative data in a more accurate and automated fashion. As imaging systems become more complex and the need for better quantitative information from images grows, the future includes the combined research efforts from physicists working in CAD with those working on quantitative imaging systems to readily yield information on morphology, function, molecular structure, and more-from animal imaging research to clinical patient care. A historical review of CAD and a discussion of challenges for the future are presented here, along with the extension to quantitative image analysis.
Collapse
Affiliation(s)
- Maryellen L Giger
- Department of Radiology, University of Chicago, Chicago, Illinois 60637, USA.
| | | | | |
Collapse
|
11
|
Pu J, Zheng B, Leader JK, Gur D. An ellipse-fitting based method for efficient registration of breast masses on two mammographic views. Med Phys 2008; 35:487-94. [PMID: 18383669 PMCID: PMC2288654 DOI: 10.1118/1.2828188] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
When reading mammograms, radiologists routinely search for and compare suspicious breast lesions identified on two corresponding craniocaudal (CC) and mediolateral oblique (MLO) views. Automatically identifying and matching the same true-positive breast lesions depicted on two views is an important step for developing successful multiview based computer-aided detection (CAD) schemes. The authors developed a method to automatically register breast areas and detect matching strips of interest used to identify the matched mass regions depicted on CC and MLO views. The method uses an ellipse based model to fit the breast boundary contour (skin line) and set a local Cartesian coordinate system for each view. One intersection point between the major/minor axis and the fitted ellipse perimeter passed through breast boundary is selected as the origin and the majoraxis and the minoraxis of the ellipse are used as the two axis of the Cartesian coordinate system. When a mass is identified on one view, the scheme computes its position in the local coordinate system. Then, the distance is mapped onto the local coordinate of the other view. At the end of the mapped distance a registered centerline of the matching strip is created. The authors established an image database that includes 200 test examinations each depicting one verified mass visible on the two views. They tested whether the registered centerline identified on another view can be used to locate the matched mass region. The experiments show that the average distance between the mass region centers and the registered centerlines was +/- 8.3 mm and in 91% of testing cases the registered centerline actually passes through the matched mass regions. A matching strip width of 47 mm was required to achieve 100% sensitivity for the test database. The results demonstrate the feasibility of the proposed method to automatically identify masses depicted on CC and MLO views, which may improve future development of multiview based CAD schemes.
Collapse
Affiliation(s)
- Jiantao Pu
- Department of Radiology, University of Pittsburgh, 3362 Fifth Avenue, Pittsburgh, Pennsylvania 15213, USA.
| | | | | | | |
Collapse
|
12
|
Guo Y, Sivaramakrishna R, Lu CC, Suri JS, Laxminarayan S. Breast image registration techniques: a survey. Med Biol Eng Comput 2007; 44:15-26. [PMID: 16929917 DOI: 10.1007/s11517-005-0016-y] [Citation(s) in RCA: 68] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
Abstract
Breast cancer is the most common type of cancer in women worldwide. Image registration plays an important role in breast cancer detection. This paper gives an overview of the current state-of-the-art in the breast image registration techniques. For the intramodality registration techniques, X-ray, MRI, and ultrasound are the primary focuses of interest. Intermodality techniques will cover the combination of different modalities. Validation of breast registration methods is also discussed.
Collapse
Affiliation(s)
- Yujun Guo
- Department of Computer Science, Kent State University, Kent, OH 44242, USA.
| | | | | | | | | |
Collapse
|
13
|
Guo Y, Suri J, Sivaramakrishna R. Image registration for breast imaging: a review. CONFERENCE PROCEEDINGS : ... ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL CONFERENCE 2007; 2005:3379-82. [PMID: 17280947 DOI: 10.1109/iembs.2005.1617202] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
Breast cancer is the most common type of cancer in women worldwide. About ten percent of women are confronted with breast cancer in their lives. Breast Cancer can be most efficiently treated if detected at an early sage. Imaging of the breast can be accomplished using several modalities such as: X-ray, MRI, CT, Ultrasound, and now Molecular Imaging. Image registration plays a critical role in breast imaging. It provides aid to better visualization of lesions on bilateral or temporal X-ray mammograms, or in the fusion of different modalities acquired using different principles of physics. The non-rigid, inhomogeneous, anisotropic and temporally changing nature of breast tissue make breast image registration a challenging task. This paper presents an overview of the current state-of-the-art in the breast image registration techniques. Methods are classified according to the modalities involved in the registration process. Intra-modality registration techniques focus on X-ray mammogram registration, while inter-modality techniques will cover the registration of X-ray with other modality. Validation of breast registration methods is also discussed.
Collapse
Affiliation(s)
- Yujun Guo
- Department of Computer Science, Kent State University, Kent, Ohio 44242 USA
| | | | | |
Collapse
|
14
|
van Engeland S, Timp S, Karssemeijer N. Finding corresponding regions of interest in mediolateral oblique and craniocaudal mammographic views. Med Phys 2006; 33:3203-12. [PMID: 17022213 DOI: 10.1118/1.2230359] [Citation(s) in RCA: 46] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
In this paper we present a method to link potentially suspicious mass regions detected by a Computer-Aided Detection (CAD) scheme in mediolateral oblique (MLO) and craniocaudal (CC) mammographic views of the breast. For all possible combinations of mass candidate regions, a number of features are determined. These features include the difference in the radial distance from the candidate regions to the nipple, the gray scale correlation between both regions, and the mass likelihood of the regions determined by the single view CAD scheme. Linear Discriminant Analysis (LDA) is used to discriminate between correct and incorrect links. The method was tested on a set of 412 cancer cases. In each case a malignant mass, architectural distortion, or asymmetry was annotated. In 92% of these cases the candidate mass detections by CAD included the cancer regions in both views. It was found that in 82% of the cases a correct link between the true positive regions in both views could be established by our method. Possible applications of the method may be found in multiple view analysis to improve CAD results, and for the presentation of CAD results to the radiologist on a mammography workstation.
Collapse
Affiliation(s)
- Saskia van Engeland
- Department of Radiology, Radboud University Medical Centre, Nijmegen, The Netherlands
| | | | | |
Collapse
|
15
|
Timp S, Karssemeijer N. Interval change analysis to improve computer aided detection in mammography. Med Image Anal 2006; 10:82-95. [PMID: 15996893 DOI: 10.1016/j.media.2005.03.007] [Citation(s) in RCA: 32] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2004] [Revised: 12/29/2004] [Accepted: 03/22/2005] [Indexed: 11/19/2022]
Abstract
We are developing computer aided diagnosis (CAD) techniques to study interval changes between two consecutive mammographic screening rounds. We have previously developed methods for the detection of malignant masses based on features extracted from single mammographic views. The goal of the present work was to improve our detection method by including temporal information in the CAD program. Toward this goal, we have developed a regional registration technique. This technique links a suspicious location on the current mammogram with a corresponding location on the prior mammogram. The novelty of our method is that the search for correspondence is done in feature space. This has the advantage that very small lesions and architectural distortions may be found as well. Following the linking process several features are calculated for the current and prior region. Temporal features are obtained by combining the feature values from both regions. We evaluated the detection performance with and without the use of temporal features on a data set containing 2873 temporal film pairs from 938 patients. There were 589 cases in which the current mammogram contained exactly one malignant mass. Cross validation was used to partition the data set into a train set and a test set. The train set was used for feature selection and classifier training, the test set for classifier evaluation. FROC (free response operating characteristic) analysis showed an improvement in detection performance with the use of temporal features.
Collapse
Affiliation(s)
- Sheila Timp
- Department of Radiology, University Medical Center, Radboud University Hospital, Geert Grooteplein Zuid 18, 6525 GA Nijmegen, The Netherlands.
| | | |
Collapse
|
16
|
Timp S, van Engeland S, Karssemeijer N. A regional registration method to find corresponding mass lesions in temporal mammogram pairs. Med Phys 2005; 32:2629-38. [PMID: 16193793 DOI: 10.1118/1.1984323] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
In this paper we develop an automatic regional registration method to find corresponding masses on prior and current mammograms. The method contains three steps. In the first, we globally align both images. Then, for each mass lesion on the current view, we define a search area on the prior view, which is likely to contain the same mass lesion. Third, at each location in this search area we calculate a registration measure to quantify how well this location matches the mass lesion on the current view. Finally we select the best location. To determine the performance of our method we compare it to several other registration methods. On a dataset of 389 temporal mass pairs our method correctly links 82% of prior and current mass lesions, whereas other methods achieve at most 72%.
Collapse
Affiliation(s)
- Sheila Timp
- Department of Radiology, Radboud University Medical Centre, Nijmegen, 6525 GA, The Netherlands.
| | | | | |
Collapse
|
17
|
Hopfe J, Herrmann KH, Lucht R, Bellemann ME, Kaiser WA, Reichenbach JR. [Validation of an entropy-based algorithm for registration of serial 3D MR mammography data]. Z Med Phys 2005; 15:107-14. [PMID: 16008080 DOI: 10.1078/0939-3889-00256] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
The aim of this study was to develop and implement an algorithm for the co-registration of 3D breast MRI sets acquired at two slightly different patient positions (repetitive examination). Combined translation and rotation with locally varying parameters were applied for the purpose of coordinate transformation. A phantom allowing selective changes of the volume of the glandular tissue model was developed, in order to prove the robustness of the proposed matcher against local changes. Serial 3D data sets of phantoms and volunteers were acquired to validate the routines. Co-registration was performed using mutual information (MI) as a similarity measure of the matching of the acquired images. In the phantom study, the phantom was deliberately shifted and rotated around horizontal and vertical axes. Starting the registration with global translations using a rigid matcher, the horizontal (phi) and vertical (theta) rotation angles were optimized in an iteration loop for each slice. This method was then applied to the breast data sets. Application of the algorithm on serial 3D MR data sets improved the co-registration especially in consideration of varying local tissue volumes. The algorithm represents a compromise between a pure rigid and an elastic 3D matcher.
Collapse
Affiliation(s)
- Jens Hopfe
- Institut für Diagnostische und Interventionelle Radiologie, AG Medizinische Physik, Friedrich-Schiller-Universität Jena
| | | | | | | | | | | |
Collapse
|
18
|
Filev P, Hadjiiski L, Sahiner B, Chan HP, Helvie MA. Comparison of similarity measures for the task of template matching of masses on serial mammograms. Med Phys 2005; 32:515-29. [PMID: 15789598 DOI: 10.1118/1.1851892] [Citation(s) in RCA: 37] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
We conducted a study to evaluate the effectiveness of twelve different similarity measures in matching the corresponding masses on temporal pairs of current and prior mammograms. To perform this comparison we implemented each of the twelve similarity measures in the final stage of our multistage registration technique for automated registration of breast lesions in serial mammograms. The multistage technique consists of three stages. In the first stage an initial fan-shape search region was estimated on the prior mammogram based on the geometrical position of the mass on the current mammogram. In the second stage, the location of the fan-shape region was refined by warping, based on an affine transformation and simplex optimization. A new refined search region was defined on the prior mammogram. In the third stage, a search for the best match between the lesion template from the current mammogram and a structure on the prior mammogram was carried out within the search region. Our data set consisted of 318 temporal pairs. We performed three experiments, using a different subset of the 318 temporal pairs for each experiment. In each experiment we further tested how the performance of the similarity measures varied as the size of the search region increased or decreased. We evaluated the twelve similarity measures based on four criteria. The first criterion was the mean Euclidean distance, which was the average distance of the true location of the mass to the location detected by the similarity measure. The second criterion was the percentage of temporal pairs that were aligned so that 50% or more of the lesion area overlapped. The third criterion was the percentage of pairs that were aligned so that 75% or more of the lesion area overlapped. The fourth and final criterion was the robustness of the similarity measure. Our results showed that three of the similarity measures, Pearson's correlation, the cosine coefficient, and Goodman and Kruskal's Gamma coefficient, provide significantly higher accuracy (p < 0.05) in the task of matching the corresponding masses on serial mammograms than the other nine similarity measures.
Collapse
Affiliation(s)
- Peter Filev
- Department of Radiology, The University of Michigan, Ann Arbor, Michigan 48109-0904, USA
| | | | | | | | | |
Collapse
|
19
|
Pluim JPW, Maintz JBA, Viergever MA. Mutual-information-based registration of medical images: a survey. IEEE TRANSACTIONS ON MEDICAL IMAGING 2003; 22:986-1004. [PMID: 12906253 DOI: 10.1109/tmi.2003.815867] [Citation(s) in RCA: 1065] [Impact Index Per Article: 50.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/19/2023]
Abstract
An overview is presented of the medical image processing literature on mutual-information-based registration. The aim of the survey is threefold: an introduction for those new to the field, an overview for those working in the field, and a reference for those searching for literature on a specific application. Methods are classified according to the different aspects of mutual-information-based registration. The main division is in aspects of the methodology and of the application. The part on methodology describes choices made on facets such as preprocessing of images, gray value interpolation, optimization, adaptations to the mutual information measure, and different types of geometrical transformations. The part on applications is a reference of the literature available on different modalities, on interpatient registration and on different anatomical objects. Comparison studies including mutual information are also considered. The paper starts with a description of entropy and mutual information and it closes with a discussion on past achievements and some future challenges.
Collapse
Affiliation(s)
- Josien P W Pluim
- University Medical Center Utrecht, Image Sciences Institute, Room E01.335, Heidelberglaan 100, 3584 CX Utrecht, The Netherlands.
| | | | | |
Collapse
|
20
|
Chang YH, Good WF, Leader JK, Wang XH, Zheng B, Hardesty LA, Hakim CM, Gur D. Integrated density of a lesion: a quantitative, mammographically derived, invariable measure. Med Phys 2003; 30:1805-11. [PMID: 12906198 DOI: 10.1118/1.1582571] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
A method for quantitatively estimating lesion "size" from mammographic images was developed and evaluated. The main idea behind the measure, termed "integrated density" (ID), is that the total x-ray attenuation attributable to an object is theoretically invariant with respect to the projected view and object deformation. Because it is possible to estimate x-ray attenuation of a lesion from relative film densities, after appropriate corrections for background, the invariant property of the measure is expected to result in an objective method for evaluating the "sizes" of breast lesions. ID was calculated as the integral of the estimated image density attributable to a lesion, relative to surrounding background, over the area of the lesion and after corrections for the nonlinearity of the film characteristic curve. This effectively provides a measure proportional to lesion volume. We computed ID and more traditional measures of size (such as "mass diameter" and "effective size") for 100 pairs of ipsilateral mammographic views, each containing a lesion that was relatively visible in both views. The correlation between values calculated for each measure from corresponding pairs of ipsilateral views were computed and compared. All three size-related measures (mass diameter, effective size, and ID) exhibited reasonable linear relationship between paired views (r2>0.7, P<0.001). Specifically, the ID measures for the 100 masses were found to be highly correlated (r2=0.9, P<0.001) between ipsilateral views of the same mass. The correlation increased substantially (r2=0.95), when a measure with linear dimensions of length was defined as the cube root of ID. There is a high degree of correlation between ID-based measures obtained from different views of the same mass. ID-based measures showed a higher degree of invariance than mass diameter or effective size.
Collapse
Affiliation(s)
- Yuan-Hsiang Chang
- Department of Radiology, University of Pittsburgh and Magee-Womens Hospital, Pittsburgh, Pennsylvania 15213, USA.
| | | | | | | | | | | | | | | |
Collapse
|
21
|
Brock KM, Balter JM, Dawson LA, Kessler ML, Meyer CR. Automated generation of a four-dimensional model of the liver using warping and mutual information. Med Phys 2003; 30:1128-33. [PMID: 12852537 DOI: 10.1118/1.1576781] [Citation(s) in RCA: 62] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
The use of mutual information (MI) based alignment to map changes in liver shape and position from exhale to inhale was investigated. Inhale and exhale CT scans were obtained with intravenous contrast for six patients. MI based alignment using thin-plate spine (TPS) warping was performed between each inhale and exhale image set. An expert radiation oncologist identified corresponding vessel bifurcations on the exhale and inhale CT image and the transformation for identified points was determined. This transformation was then used to determine the accuracy of the MI based alignment. The reproducibility of the vessel bifurcation identification was measured through repeat blinded vessel bifurcation identification. Reproducibility [standard deviation (SD)] in the L/R, A/P, and I/S directions was 0.11, 0.09, and 0.14 cm, respectively. The average absolute difference between the transformation obtained using MI based alignment and the vessel bifurcation in the L/R, A/P, and I/S directions was 0.13 cm (SD=0.10 cm), 0.15 cm (SD=0.12 cm), and 0.15 cm (SD-0.14 cm), respectively. These values are comparable to the reproducibility of bifurcation identification, indicating that MI based alignment using TPS warping is accurate to within measurement error and is a reliable tool to aid in describing deformation that the liver undergoes from the exhale to inhale state.
Collapse
Affiliation(s)
- K M Brock
- Department of Radiation Oncology, University of Michigan Health Systems, Ann Arbor, Michigan 48109, USA.
| | | | | | | | | |
Collapse
|
22
|
Meeson S, Young KC, Wallis MG, Cooke J, Cummin A, Ramsdale ML. Image features of true positive and false negative cancers in screening mammograms. Br J Radiol 2003; 76:13-21. [PMID: 12595320 DOI: 10.1259/bjr/80482243] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022] Open
Abstract
The location, tissue background and imaging characteristics of true positive and false negative screens of breast cancers have been studied. This data can aid decisions in optimizing the display of mammographic information with the objective of minimizing false negative screens. Screening mammograms for four groups of women were digitized; those with screen detected cancers, those with false negative interval cancers, and matched normals for both groups. The optical density (OD) distribution in the main breast region of each mammogram was determined. The OD in three regions of interest around the cancers was also measured. Cancer locations were mapped and warped onto a typical image to show their spatial distribution. Where a cancer was detectable by calcifications alone it had a relatively low probability of being a false negative interval cancer. The mean OD differences between the cancer and the cancer background region (excluding calcifications) were approximately a factor of two lower in dense breasts compared with other breast types. Poorly defined masses that became interval cancers had mean OD differences that were approximately a factor of 0.1 OD lower than those that were detectable by screening. 22% of false negative cancers were located near the chest wall edge of the mammograms compared with 10% of the true positives. The results indicate the importance of effectively displaying information in the lighter areas of the mammogram, corresponding to glandular tissues, with sufficient contrast for suspicious mammographic details to be detected. Where the mean OD differences between the cancer and its background region are low, as measured for some poorly defined masses, there is an increased risk of a false negative interval cancer. Particular attention should be given to the chest wall area of the film, especially in the lower retroglandular region, during routine screening.
Collapse
Affiliation(s)
- S Meeson
- National Co-ordinating Centre for the Physics of Mammography, Department of Medical Physics, St. Luke's Wing, Royal Surrey County Hospital, Guildford GU2 7XX, UK
| | | | | | | | | | | |
Collapse
|
23
|
Paquerault S, Petrick N, Chan HP, Sahiner B, Helvie MA. Improvement of computerized mass detection on mammograms: fusion of two-view information. Med Phys 2002; 29:238-47. [PMID: 11865995 DOI: 10.1118/1.1446098] [Citation(s) in RCA: 89] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
Recent clinical studies have proved that computer-aided diagnosis (CAD) systems are helpful for improving lesion detection by radiologists in mammography. However, these systems would be more useful if the false-positive rate is reduced. Current CAD systems generally detect and characterize suspicious abnormal structures in individual mammographic images. Clinical experiences by radiologists indicate that screening with two mammographic views improves the detection accuracy of abnormalities in the breast. It is expected that the fusion of information from different mammographic views will improve the performance of CAD systems. We are developing a two-view matching method that utilizes the geometric locations, and morphological and textural features to correlate objects detected in two different views using a prescreening program. First, a geometrical model is used to predict the search region for an object in a second view from its location in the first view. The distance between the object and the nipple is used to define the search area. After pairing the objects in two views, textural and morphological characteristics of the paired objects are merged and similarity measures are defined. Linear discriminant analysis is then employed to classify each object pair as a true or false mass pair. The resulting object correspondence score is combined with its one-view detection score using a fusion scheme. The fusion information was found to improve the lesion detectability and reduce the number of FPs. In a preliminary study, we used a data set of 169 pairs of cranio-caudal (CC) and mediolateral oblique (MLO) view mammograms. For the detection of malignant masses on current mammograms, the film-based detection sensitivity was found to improve from 62% with a one-view detection scheme to 73% with the new two-view scheme, at a false-positive rate of 1 FP/image. The corresponding cased-based detection sensitivity improved from 77% to 91%.
Collapse
Affiliation(s)
- Sophie Paquerault
- Department of Radiology, University of Michigan, Ann Arbor 48109-0030, USA.
| | | | | | | | | |
Collapse
|
24
|
Tourassi GD, Frederick ED, Markey MK, Floyd CE. Application of the mutual information criterion for feature selection in computer-aided diagnosis. Med Phys 2001; 28:2394-402. [PMID: 11797941 DOI: 10.1118/1.1418724] [Citation(s) in RCA: 161] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
The purpose of this study was to investigate an information theoretic approach to feature selection for computer-aided diagnosis (CAD). The approach is based on the mutual information (MI) concept. MI measures the general dependence of random variables without making any assumptions about the nature of their underlying relationships. Consequently, MI can potentially offer some advantages over feature selection techniques that focus only on the linear relationships of variables. This study was based on a database of statistical texture features extracted from perfusion lung scans. The ultimate goal was to select the optimal subset of features for the computer-aided diagnosis of acute pulmonary embolism (PE). Initially, the study addressed issues regarding the approximation of MI in a limited dataset as it is often the case in CAD applications. The MI selected features were compared to those features selected using stepwise linear discriminant analysis and genetic algorithms for the same PE database. Linear and nonlinear decision models were implemented to merge the selected features into a final diagnosis. Results showed that the MI is an effective feature selection criterion for nonlinear CAD models overcoming some of the well-known limitations and computational complexities of other popular feature selection techniques in the field.
Collapse
Affiliation(s)
- G D Tourassi
- Department of Radiology, Duke University Medical Center, Durham, North Carolina 27710, USA.
| | | | | | | |
Collapse
|
25
|
Hadjiiski L, Sahiner B, Chan HP, Petrick N, Helvie MA, Gurcan M. Analysis of temporal changes of mammographic features: computer-aided classification of malignant and benign breast masses. Med Phys 2001; 28:2309-17. [PMID: 11764038 DOI: 10.1118/1.1412242] [Citation(s) in RCA: 55] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022] Open
Abstract
A new classification scheme was developed to classify mammographic masses as malignant and benign by using interval change information. The masses on both the current and the prior mammograms were automatically segmented using an active contour method. From each mass, 20 run length statistics (RLS) texture features, 3 speculation features, and 12 morphological features were extracted. Additionally, 20 difference RLS features were obtained by subtracting the prior RLS features from the corresponding current RLS features. The feature space consisted of the current RLS features, the difference RLS features, the current and prior speculation features, and the current and prior mass sizes. Stepwise feature selection and linear discriminant analysis classification were used to select and merge the most useful features. A leave-one-case-out resampling scheme was used to train and test the classifier using 140 temporal image pairs (85 malignant, 55 benign) obtained from 57 biopsy-proven masses (33 malignant, 24 benign) in 56 patients. An average of 10 features were selected from the 56 training subsets: 4 difference RLS features, 4 RLS features, and 1 speculation feature from the current image, and 1 speculation feature from the prior, were most often chosen. The classifier achieved an average training Az of 0.92 and a test Az of 0.88. For comparison, a classifier was trained and tested using features extracted from the 120 current single images. This classifier achieved an average training Az of 0.90 and a test Az of 0.82. The information on the prior image significantly (p = 0.015) improved the accuracy for classification of the masses.
Collapse
Affiliation(s)
- L Hadjiiski
- Department of Radiology, The University of Michigan, Ann Arbor, Michigan 48109-0904, USA.
| | | | | | | | | | | |
Collapse
|
26
|
Hadjiiski L, Chan HP, Sahiner B, Petrick N, Helvie MA. Automated registration of breast lesions in temporal pairs of mammograms for interval change analysis--local affine transformation for improved localization. Med Phys 2001; 28:1070-9. [PMID: 11439476 DOI: 10.1118/1.1376134] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
Analysis of interval change is important for mammographic interpretation. The aim of this study is to evaluate the use of an automated registration technique for computer-aided interval change analysis in mammography. Previously we developed a regional registration technique for identifying masses on temporal pairs of mammograms. In the current study, we improved lesion registration by including a local alignment step. Initially, the lesion position on the prior mammogram was estimated based on the breast geometry. An initial fan-shaped search region was then defined on the prior mammogram. In the second stage, the location of the fan-shaped region on the prior mammogram was refined by warping, based on an affine transformation and simplex optimization in a local region. In the third stage, a search for the best match between the lesion template from the current mammogram and a structure on the prior mammogram was carried out within the search region. This technique was evaluated on 124 temporal pairs of mammograms containing biopsyproven masses. Eighty-seven percent of the estimated lesion locations resulted in an area overlap of at least 50% with the true lesion locations and an average distance of 2.4 +/- 2.1 mm between their centroids. The average distance between the estimated and the true centroid of the lesions on the prior mammogram over all 124 temporal pairs was 4.2 +/- 5.7 mm. The registration accuracy was improved in comparison with our previous study that used a data set of 74 temporal pairs of mammograms. This improvement in accuracy resulted from the improved geometry estimation and the local affine transformation.
Collapse
Affiliation(s)
- L Hadjiiski
- Department of Radiology, University of Michigan, Ann Arbor, Michigan 48109,
| | | | | | | | | |
Collapse
|
27
|
Lou SL, Lin HD, Lin KP, Hoogstrate D. Automatic breast region extraction from digital mammograms for PACS and telemammography applications. Comput Med Imaging Graph 2000; 24:205-20. [PMID: 10842045 DOI: 10.1016/s0895-6111(00)00009-4] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
High spatial resolution results in very large digital mammogram file sizes. For telemammography, and picture archiving and communication systems, the large file issue introduces technical difficulties in image transmission, storage, and display. We propose extracting the breast region from the mammogram to reduce the image file size. The challenge is on how to faithfully extract breast regions from digital mammograms generated from different types of acquisition systems that contain various imaged compositions. We report an algorithm to automatically identify the orientation of breast region and extract the breast region from mammograms. Breast regions extracted from full-field digital mammograms reduce file sizes by three to five folds.
Collapse
Affiliation(s)
- S L Lou
- Laboratory for Radiological Informatics, Department of Radiology, University of California, San Francisco, 530 Parnassus Avenue, San Francisco, CA 94143-0628, USA.
| | | | | | | |
Collapse
|