1
|
Study of novel deformable image registration in myocardial perfusion single-photon emission computed tomography. Nucl Med Commun 2020; 41:196-205. [DOI: 10.1097/mnm.0000000000001140] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
2
|
Wang Z, Xin J, Huang Y, Li C, Xu L, Li Y, Zhang H, Gu H, Qian W. A similarity measure method combining location feature for mammogram retrieval. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2018; 26:553-571. [PMID: 29865106 DOI: 10.3233/xst-18374] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
BACKGROUND Breast cancer, the most common malignancy among women, has a high mortality rate in clinical practice. Early detection, diagnosis and treatment can reduce the mortalities of breast cancer greatly. The method of mammogram retrieval can help doctors to find the early breast lesions effectively and determine a reasonable feature set for image similarity measure. This will improve the accuracy effectively for mammogram retrieval. METHODS This paper proposes a similarity measure method combining location feature for mammogram retrieval. Firstly, the images are pre-processed, the regions of interest are detected and the lesions are segmented in order to get the center point and radius of the lesions. Then, the method, namely Coherent Point Drift, is used for image registration with the pre-defined standard image. The center point and radius of the lesions after registration are obtained and the standard location feature of the image is constructed. This standard location feature can help figure out the location similarity between the image pair from the query image to each dataset image in the database. Next, the content feature of the image is extracted, including the Histogram of Oriented Gradients, the Edge Direction Histogram, the Local Binary Pattern and the Gray Level Histogram, and the image pair content similarity can be calculated using the Earth Mover's Distance. Finally, the location similarity and content similarity are fused to form the image fusion similarity, and the specified number of the most similar images can be returned according to it. RESULTS In the experiment, 440 mammograms, which are from Chinese women in Northeast China, are used as the database. When fusing 40% lesion location feature similarity and 60% content feature similarity, the results have obvious advantages. At this time, precision is 0.83, recall is 0.76, comprehensive indicator is 0.79, satisfaction is 96.0%, mean is 4.2 and variance is 17.7. CONCLUSIONS The results show that the precision and recall of this method have obvious advantage, compared with the content-based image retrieval.
Collapse
Affiliation(s)
- Zhiqiong Wang
- Sino-Dutch Biomedical and Information Engineering School, Northeastern University, China
| | - Junchang Xin
- School of Computer Science and Engineering, Key Laboratory of Big Data Management and Analytics (Liaoning Province), Northeastern University, China
| | - Yukun Huang
- Sino-Dutch Biomedical and Information Engineering School, Northeastern University, China
| | - Chen Li
- Sino-Dutch Biomedical and Information Engineering School, Northeastern University, China
| | - Ling Xu
- Sino-Dutch Biomedical and Information Engineering School, Northeastern University, China
| | - Yang Li
- Sino-Dutch Biomedical and Information Engineering School, Northeastern University, China
| | - Hao Zhang
- Breast Disease and Reconstruction Center, Breast Cancer Key Lab of Dalian, the Second Hospital of Dalian Medical University, China
| | - Huizi Gu
- Department of Internal Neurology, the Second Hospital of Dalian Medical University, China
| | - Wei Qian
- College of Engineering, University of Texas at El Paso, USA
| |
Collapse
|
3
|
Brock KK, Mutic S, McNutt TR, Li H, Kessler ML. Use of image registration and fusion algorithms and techniques in radiotherapy: Report of the AAPM Radiation Therapy Committee Task Group No. 132. Med Phys 2017; 44:e43-e76. [PMID: 28376237 DOI: 10.1002/mp.12256] [Citation(s) in RCA: 530] [Impact Index Per Article: 75.7] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2016] [Revised: 02/13/2017] [Accepted: 02/19/2017] [Indexed: 11/07/2022] Open
Abstract
Image registration and fusion algorithms exist in almost every software system that creates or uses images in radiotherapy. Most treatment planning systems support some form of image registration and fusion to allow the use of multimodality and time-series image data and even anatomical atlases to assist in target volume and normal tissue delineation. Treatment delivery systems perform registration and fusion between the planning images and the in-room images acquired during the treatment to assist patient positioning. Advanced applications are beginning to support daily dose assessment and enable adaptive radiotherapy using image registration and fusion to propagate contours and accumulate dose between image data taken over the course of therapy to provide up-to-date estimates of anatomical changes and delivered dose. This information aids in the detection of anatomical and functional changes that might elicit changes in the treatment plan or prescription. As the output of the image registration process is always used as the input of another process for planning or delivery, it is important to understand and communicate the uncertainty associated with the software in general and the result of a specific registration. Unfortunately, there is no standard mathematical formalism to perform this for real-world situations where noise, distortion, and complex anatomical variations can occur. Validation of the software systems performance is also complicated by the lack of documentation available from commercial systems leading to use of these systems in undesirable 'black-box' fashion. In view of this situation and the central role that image registration and fusion play in treatment planning and delivery, the Therapy Physics Committee of the American Association of Physicists in Medicine commissioned Task Group 132 to review current approaches and solutions for image registration (both rigid and deformable) in radiotherapy and to provide recommendations for quality assurance and quality control of these clinical processes.
Collapse
Affiliation(s)
- Kristy K Brock
- Department of Imaging Physics, The University of Texas MD Anderson Cancer Center, 1400 Pressler St, FCT 14.6048, Houston, TX, 77030, USA
| | - Sasa Mutic
- Department of Radiation Oncology, Washington University School of Medicine, St. Louis, MO, USA
| | - Todd R McNutt
- Department of Radiation Oncology, Johns Hopkins Medical Institute, Baltimore, MD, USA
| | - Hua Li
- Department of Radiation Oncology, Washington University School of Medicine, St. Louis, MO, USA
| | - Marc L Kessler
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI, USA
| |
Collapse
|
4
|
Giger ML, Karssemeijer N, Schnabel JA. Breast image analysis for risk assessment, detection, diagnosis, and treatment of cancer. Annu Rev Biomed Eng 2013; 15:327-57. [PMID: 23683087 DOI: 10.1146/annurev-bioeng-071812-152416] [Citation(s) in RCA: 118] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The role of breast image analysis in radiologists' interpretation tasks in cancer risk assessment, detection, diagnosis, and treatment continues to expand. Breast image analysis methods include segmentation, feature extraction techniques, classifier design, biomechanical modeling, image registration, motion correction, and rigorous methods of evaluation. We present a review of the current status of these task-based image analysis methods, which are being developed for the various image acquisition modalities of mammography, tomosynthesis, computed tomography, ultrasound, and magnetic resonance imaging. Depending on the task, image-based biomarkers from such quantitative image analysis may include morphological, textural, and kinetic characteristics and may depend on accurate modeling and registration of the breast images. We conclude with a discussion of future directions.
Collapse
Affiliation(s)
- Maryellen L Giger
- Department of Radiology, University of Chicago, Chicago, IL 60637, USA.
| | | | | |
Collapse
|
5
|
Zhou C, Wei J, Chan HP, Paramagul C, Hadjiiski LM, Sahiner B, Douglas JA. Computerized image analysis: texture-field orientation method for pectoral muscle identification on MLO-view mammograms. Med Phys 2010; 37:2289-99. [PMID: 20527563 DOI: 10.1118/1.3395576] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
PURPOSE To develop a new texture-field orientation (TFO) method that combines a priori knowledge, local and global information for the automated identification of pectoral muscle on mammograms. METHODS The authors designed a gradient-based directional kernel (GDK) filter to enhance the linear texture structures, and a gradient-based texture analysis to extract a texture orientation image that represented the dominant texture orientation at each pixel. The texture orientation image was enhanced by a second GDK filter for ridge point extraction. The extracted ridge points were validated and the ridges that were less likely to lie on the pectoral boundary were removed automatically. A shortest-path finding method was used to generate a probability image that represented the likelihood that each remaining ridge point lay on the true pectoral boundary. Finally, the pectoral boundary was tracked by searching for the ridge points with the highest probability lying on the pectoral boundary. A data set of 130 MLO-view digitized film mammograms (DFMs) from 65 patients was used to train the TFO algorithm. An independent data set of 637 MLO-view DFMs from 562 patients was used to evaluate its performance. Another independent data set of 92 MLO-view full field digital mammograms (FFDMs) from 92 patients was used to assess the adaptability of the TFO algorithm to FFDMs. The pectoral boundary detection accuracy of the TFO method was quantified by comparison with an experienced radiologist's manually drawn pectoral boundary using three performance metrics: The percent overlap area (POA), the Hausdorff distance (Hdist), and the average distance (AvgDist). RESULTS The mean and standard deviation of POA, Hdist, and AvgDist were 95.0 +/- 3.6%, 3.45 +/- 2.16 mm, and 1.12 +/- 0.82 mm, respectively. For the POA measure, 91.5%, 97.3%, and 98.9% of the computer detected pectoral muscles had POA larger than 90%, 85%, and 80%, respectively. For the distance measures, 85.4% and 98.0% of the computer detected pectoral boundaries had Hdist within 5 and 10 mm, respectively, and 99.4% of computer detected pectoral muscle boundaries had AvgDist within 5 mm from the radiologist's manually drawn boundaries. CONCLUSIONS The pectoral muscle on DFMs can be detected accurately by the automated TFO method. The preliminary study of applying the same pectoral muscle identification algorithm to FFDMs without retraining demonstrates that the TFO method is reasonably robust against the differences in the image properties between the digitized and digital mammograms.
Collapse
Affiliation(s)
- Chuan Zhou
- Department of Radiology, University of Michigan, Ann Arbor, Michigan 48109-5842, USA.
| | | | | | | | | | | | | |
Collapse
|
6
|
Wu YT, Zhou C, Chan HP, Paramagul C, Hadjiiski LM, Daly CP, Douglas JA, Zhang Y, Sahiner B, Shi J, Wei J. Dynamic multiple thresholding breast boundary detection algorithm for mammograms. Med Phys 2010; 37:391-401. [PMID: 20175501 DOI: 10.1118/1.3273062] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
PURPOSE Automated detection of breast boundary is one of the fundamental steps for computer-aided analysis of mammograms. In this study, the authors developed a new dynamic multiple thresholding based breast boundary (MTBB) detection method for digitized mammograms. METHODS A large data set of 716 screen-film mammograms (442 CC view and 274 MLO view) obtained from consecutive cases of an Institutional Review Board approved project were used. An experienced breast radiologist manually traced the breast boundary on each digitized image using a graphical interface to provide a reference standard. The initial breast boundary (MTBB-Initial) was obtained by dynamically adapting the threshold to the gray level range in local regions of the breast periphery. The initial breast boundary was then refined by using gradient information from horizontal and vertical Sobel filtering to obtain the final breast boundary (MTBB-Final). The accuracy of the breast boundary detection algorithm was evaluated by comparison with the reference standard using three performance metrics: The Hausdorff distance (HDist), the average minimum Euclidean distance (AMinDist), and the area overlap measure (AOM). RESULTS In comparison with the authors' previously developed gradient-based breast boundary (GBB) algorithm, it was found that 68%, 85%, and 94% of images had HDist errors less than 6 pixels (4.8 mm) for GBB, MTBB-Initial, and MTBB-Final, respectively. 89%, 90%, and 96% of images had AMinDist errors less than 1.5 pixels (1.2 mm) for GBB, MTBB-Initial, and MTBB-Final, respectively. 96%, 98%, and 99% of images had AOM values larger than 0.9 for GBB, MTBB-Initial, and MTBB-Final, respectively. The improvement by the MTBB-Final method was statistically significant for all the evaluation measures by the Wilcoxon signed rank test (p < 0.0001). CONCLUSIONS The MTBB approach that combined dynamic multiple thresholding and gradient information provided better performance than the breast boundary detection algorithm that mainly used gradient information.
Collapse
Affiliation(s)
- Yi-Ta Wu
- Department of Radiology, University of Michigan, Ann Arbor Michigan 48109, USA.
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
7
|
Filev P, Hadjiiski L, Chan HP, Sahiner B, Ge J, Helvie MA, Roubidoux M, Zhou C. Automated regional registration and characterization of corresponding microcalcification clusters on temporal pairs of mammograms for interval change analysis. Med Phys 2009; 35:5340-50. [PMID: 19175093 DOI: 10.1118/1.3002311] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
A computerized regional registration and characterization system for analysis of microcalcification clusters on serial mammograms is being developed in our laboratory. The system consists of two stages. In the first stage, based on the location of a detected cluster on the current mammogram, a regional registration procedure identifies the local area on the prior that may contain the corresponding cluster. A search program is used to detect cluster candidates within the local area. The detected cluster on the current image is then paired with the cluster candidates on the prior image to form true (TP-TP) or false (TP-FP) pairs. Automatically extracted features were used in a newly designed correspondence classifier to reduce the number of false pairs. In the second stage, a temporal classifier, based on both current and prior information, is used if a cluster has been detected on the prior image, and a current classifier, based on current information alone, is used if no prior cluster has been detected. The data set used in this study consisted of 261 serial pairs containing biopsy-proven calcification clusters. An MQSA radiologist identified the corresponding clusters on the mammograms. On the priors, the radiologist rated the subtlety of 30 clusters (out of the 261 clusters) as 9 or 10 on a scale of 1 (very obvious) to 10 (very subtle). Leave-one-case-out resampling was used for feature selection and classification in both the correspondence and malignant/benign classification schemes. The search program detected 91.2% (238/261) of the clusters on the priors with an average of 0.42 FPs/image. The correspondence classifier identified 86.6% (226/261) of the TP-TP pairs with 20 false matches (0.08 FPs/image) relative to the entire set of 261 image pairs. In the malignant/benign classification stage the temporal classifier achieved a test A(z) of 0.81 for the 246 pairs which contained a detection on the prior. In addition, a classifier was designed by using the clusters on the current mammograms only. It achieved a test A(z) of 0.72 in classifying the clusters as malignant and benign. The difference between the performance of the temporal classifier and the current classifier was statistically significant (p=0.0014). Our interval change analysis system can detect the corresponding cluster on the prior mammogram with high sensitivity, and classify them with a satisfactory accuracy.
Collapse
Affiliation(s)
- Peter Filev
- Department of Radiology, The University of Michigan, Ann Arbor, Michigan 48109-0904, USA
| | | | | | | | | | | | | | | |
Collapse
|
8
|
Giger ML, Chan HP, Boone J. Anniversary paper: History and status of CAD and quantitative image analysis: the role of Medical Physics and AAPM. Med Phys 2009; 35:5799-820. [PMID: 19175137 PMCID: PMC2673617 DOI: 10.1118/1.3013555] [Citation(s) in RCA: 167] [Impact Index Per Article: 11.1] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023] Open
Abstract
The roles of physicists in medical imaging have expanded over the years, from the study of imaging systems (sources and detectors) and dose to the assessment of image quality and perception, the development of image processing techniques, and the development of image analysis methods to assist in detection and diagnosis. The latter is a natural extension of medical physicists' goals in developing imaging techniques to help physicians acquire diagnostic information and improve clinical decisions. Studies indicate that radiologists do not detect all abnormalities on images that are visible on retrospective review, and they do not always correctly characterize abnormalities that are found. Since the 1950s, the potential use of computers had been considered for analysis of radiographic abnormalities. In the mid-1980s, however, medical physicists and radiologists began major research efforts for computer-aided detection or computer-aided diagnosis (CAD), that is, using the computer output as an aid to radiologists-as opposed to a completely automatic computer interpretation-focusing initially on methods for the detection of lesions on chest radiographs and mammograms. Since then, extensive investigations of computerized image analysis for detection or diagnosis of abnormalities in a variety of 2D and 3D medical images have been conducted. The growth of CAD over the past 20 years has been tremendous-from the early days of time-consuming film digitization and CPU-intensive computations on a limited number of cases to its current status in which developed CAD approaches are evaluated rigorously on large clinically relevant databases. CAD research by medical physicists includes many aspects-collecting relevant normal and pathological cases; developing computer algorithms appropriate for the medical interpretation task including those for segmentation, feature extraction, and classifier design; developing methodology for assessing CAD performance; validating the algorithms using appropriate cases to measure performance and robustness; conducting observer studies with which to evaluate radiologists in the diagnostic task without and with the use of the computer aid; and ultimately assessing performance with a clinical trial. Medical physicists also have an important role in quantitative imaging, by validating the quantitative integrity of scanners and developing imaging techniques, and image analysis tools that extract quantitative data in a more accurate and automated fashion. As imaging systems become more complex and the need for better quantitative information from images grows, the future includes the combined research efforts from physicists working in CAD with those working on quantitative imaging systems to readily yield information on morphology, function, molecular structure, and more-from animal imaging research to clinical patient care. A historical review of CAD and a discussion of challenges for the future are presented here, along with the extension to quantitative image analysis.
Collapse
Affiliation(s)
- Maryellen L Giger
- Department of Radiology, University of Chicago, Chicago, Illinois 60637, USA.
| | | | | |
Collapse
|
9
|
Armato SG, van Ginneken B. Anniversary Paper: Image processing and manipulation through the pages ofMedical Physics. Med Phys 2008; 35:4488-500. [DOI: 10.1118/1.2977537] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
|
10
|
Zheng B. Mass Detection Scheme for Digitized Mammography. Cancer Imaging 2008. [DOI: 10.1016/b978-012374212-4.50036-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022] Open
|
11
|
Guo Y, Sivaramakrishna R, Lu CC, Suri JS, Laxminarayan S. Breast image registration techniques: a survey. Med Biol Eng Comput 2007; 44:15-26. [PMID: 16929917 DOI: 10.1007/s11517-005-0016-y] [Citation(s) in RCA: 68] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
Abstract
Breast cancer is the most common type of cancer in women worldwide. Image registration plays an important role in breast cancer detection. This paper gives an overview of the current state-of-the-art in the breast image registration techniques. For the intramodality registration techniques, X-ray, MRI, and ultrasound are the primary focuses of interest. Intermodality techniques will cover the combination of different modalities. Validation of breast registration methods is also discussed.
Collapse
Affiliation(s)
- Yujun Guo
- Department of Computer Science, Kent State University, Kent, OH 44242, USA.
| | | | | | | | | |
Collapse
|
12
|
Guo Y, Suri J, Sivaramakrishna R. Image registration for breast imaging: a review. CONFERENCE PROCEEDINGS : ... ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL CONFERENCE 2007; 2005:3379-82. [PMID: 17280947 DOI: 10.1109/iembs.2005.1617202] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
Breast cancer is the most common type of cancer in women worldwide. About ten percent of women are confronted with breast cancer in their lives. Breast Cancer can be most efficiently treated if detected at an early sage. Imaging of the breast can be accomplished using several modalities such as: X-ray, MRI, CT, Ultrasound, and now Molecular Imaging. Image registration plays a critical role in breast imaging. It provides aid to better visualization of lesions on bilateral or temporal X-ray mammograms, or in the fusion of different modalities acquired using different principles of physics. The non-rigid, inhomogeneous, anisotropic and temporally changing nature of breast tissue make breast image registration a challenging task. This paper presents an overview of the current state-of-the-art in the breast image registration techniques. Methods are classified according to the modalities involved in the registration process. Intra-modality registration techniques focus on X-ray mammogram registration, while inter-modality techniques will cover the registration of X-ray with other modality. Validation of breast registration methods is also discussed.
Collapse
Affiliation(s)
- Yujun Guo
- Department of Computer Science, Kent State University, Kent, Ohio 44242 USA
| | | | | |
Collapse
|
13
|
Timp S, Karssemeijer N. Interval change analysis to improve computer aided detection in mammography. Med Image Anal 2006; 10:82-95. [PMID: 15996893 DOI: 10.1016/j.media.2005.03.007] [Citation(s) in RCA: 32] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2004] [Revised: 12/29/2004] [Accepted: 03/22/2005] [Indexed: 11/19/2022]
Abstract
We are developing computer aided diagnosis (CAD) techniques to study interval changes between two consecutive mammographic screening rounds. We have previously developed methods for the detection of malignant masses based on features extracted from single mammographic views. The goal of the present work was to improve our detection method by including temporal information in the CAD program. Toward this goal, we have developed a regional registration technique. This technique links a suspicious location on the current mammogram with a corresponding location on the prior mammogram. The novelty of our method is that the search for correspondence is done in feature space. This has the advantage that very small lesions and architectural distortions may be found as well. Following the linking process several features are calculated for the current and prior region. Temporal features are obtained by combining the feature values from both regions. We evaluated the detection performance with and without the use of temporal features on a data set containing 2873 temporal film pairs from 938 patients. There were 589 cases in which the current mammogram contained exactly one malignant mass. Cross validation was used to partition the data set into a train set and a test set. The train set was used for feature selection and classifier training, the test set for classifier evaluation. FROC (free response operating characteristic) analysis showed an improvement in detection performance with the use of temporal features.
Collapse
Affiliation(s)
- Sheila Timp
- Department of Radiology, University Medical Center, Radboud University Hospital, Geert Grooteplein Zuid 18, 6525 GA Nijmegen, The Netherlands.
| | | |
Collapse
|
14
|
Ge Z, Sahiner B, Chan HP, Hadjiiski LM, Cascade PN, Bogot N, Kazerooni EA, Wei J, Zhou C. Computer-aided detection of lung nodules: false positive reduction using a 3D gradient field method and 3D ellipsoid fitting. Med Phys 2005; 32:2443-54. [PMID: 16193773 PMCID: PMC2800987 DOI: 10.1118/1.1944667] [Citation(s) in RCA: 63] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
We are developing a computer-aided detection system to assist radiologists in the detection of lung nodules on thoracic computed tomography (CT) images. The purpose of this study was to improve the false-positive (FP) reduction stage of our algorithm by developing features that extract three-dimensional (3D) shape information from volumes of interest identified in the prescreening stage. We formulated 3D gradient field descriptors, and derived 19 gradient field features from their statistics. Six ellipsoid features were obtained by computing the lengths and the length ratios of the principal axes of an ellipsoid fitted to a segmented object. Both the gradient field features and the ellipsoid features were designed to distinguish spherical objects such as lung nodules from elongated objects such as vessels. The FP reduction performance in this new 25-dimensional feature space was compared to the performance in a 19-dimensional space that consisted of features extracted using previously developed methods. The performance in the 44-dimensional combined feature space was also evaluated. Linear discriminant analysis with stepwise feature selection was used for classification. The parameters used for feature selection were optimized using the simplex algorithm. Training and testing were performed using a leave-one-patient-out scheme. The FP reduction performances in different feature spaces were evaluated by using the area Az under the receiver operating characteristic curve and the number of FPs per CT section at a given sensitivity as accuracy measures. Our data set consisted of 82 CT scans (3551 axial sections) from 56 patients with section thickness ranging from 1.0 to 2.5 mm. Our prescreening algorithm detected 111 of the 116 solid nodules (nodule size: 3.0-30.6 mm) marked by experienced thoracic radiologists. The test Az values were 0.95 +/- 0.01, 0.88 +/- 0.02, and 0.94 +/- 0.01 in the new, previous, and combined feature spaces, respectively. The number of FPs per section at 80% sensitivity in these three feature spaces were 0.37, 1.61, and 0.34, respectively. The improvement in the test Az with the 25 new features was statistically significant (p<0.0001) compared to that with the previous 19 features alone.
Collapse
|
15
|
Timp S, van Engeland S, Karssemeijer N. A regional registration method to find corresponding mass lesions in temporal mammogram pairs. Med Phys 2005; 32:2629-38. [PMID: 16193793 DOI: 10.1118/1.1984323] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
In this paper we develop an automatic regional registration method to find corresponding masses on prior and current mammograms. The method contains three steps. In the first, we globally align both images. Then, for each mass lesion on the current view, we define a search area on the prior view, which is likely to contain the same mass lesion. Third, at each location in this search area we calculate a registration measure to quantify how well this location matches the mass lesion on the current view. Finally we select the best location. To determine the performance of our method we compare it to several other registration methods. On a dataset of 389 temporal mass pairs our method correctly links 82% of prior and current mass lesions, whereas other methods achieve at most 72%.
Collapse
Affiliation(s)
- Sheila Timp
- Department of Radiology, Radboud University Medical Centre, Nijmegen, 6525 GA, The Netherlands.
| | | | | |
Collapse
|
16
|
Marias K, Behrenbruch C, Parbhoo S, Seifalian A, Brady M. A registration framework for the comparison of mammogram sequences. IEEE TRANSACTIONS ON MEDICAL IMAGING 2005; 24:782-90. [PMID: 15957600 DOI: 10.1109/tmi.2005.848374] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/03/2023]
Abstract
In this paper, we present a two-stage algorithm for mammogram registration, the geometrical alignment of mammogram sequences. The rationale behind this paper stems from the intrinsic difficulties in comparing mammogram sequences. Mammogram comparison is a valuable tool in national breast screening programs as well as in frequent monitoring and hormone replacement therapy (HRT). The method presented in this paper aims to improve mammogram comparison by estimating the underlying geometric transformation for any mammogram sequence. It takes into consideration the various temporal changes that may occur between successive scans of the same woman and is designed to overcome the inconsistencies of mammogram image formation.
Collapse
Affiliation(s)
- Kostas Marias
- ICS-FORTH, Vassilika Vouton, P.O. Box 1385, GR 711 10 Heraklion, Greece.
| | | | | | | | | |
Collapse
|
17
|
Zhou C, Chan HP, Paramagul C, Roubidoux MA, Sahiner B, Hadjiiski LM, Petrick N. Computerized nipple identification for multiple image analysis in computer-aided diagnosis. Med Phys 2005; 31:2871-82. [PMID: 15543797 PMCID: PMC2898150 DOI: 10.1118/1.1800713] [Citation(s) in RCA: 31] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
Correlation of information from multiple-view mammograms (e.g., MLO and CC views, bilateral views, or current and prior mammograms) can improve the performance of breast cancer diagnosis by radiologists or by computer. The nipple is a reliable and stable landmark on mammograms for the registration of multiple mammograms. However, accurate identification of nipple location on mammograms is challenging because of the variations in image quality and in the nipple projections, resulting in some nipples being nearly invisible on the mammograms. In this study, we developed a computerized method to automatically identify the nipple location on digitized mammograms. First, the breast boundary was obtained using a gradient-based boundary tracking algorithm, and then the gray level profiles along the inside and outside of the boundary were identified. A geometric convergence analysis was used to limit the nipple search to a region of the breast boundary. A two-stage nipple detection method was developed to identify the nipple location using the gray level information around the nipple, the geometric characteristics of nipple shapes, and the texture features of glandular tissue or ducts which converge toward the nipple. At the first stage, a rule-based method was designed to identify the nipple location by detecting significant changes of intensity along the gray level profiles inside and outside the breast boundary and the changes in the boundary direction. At the second stage, a texture orientation-field analysis was developed to estimate the nipple location based on the convergence of the texture pattern of glandular tissue or ducts towards the nipple. The nipple location was finally determined from the detected nipple candidates by a rule-based confidence analysis. In this study, 377 and 367 randomly selected digitized mammograms were used for training and testing the nipple detection algorithm, respectively. Two experienced radiologists identified the nipple locations which were used as the gold standard. In the training data set, 301 nipples were positively identified and were referred to as visible nipples. Seventy six nipples could not be positively identified and were referred to as invisible nipples. The radiologists provided their estimation of the nipple locations in the latter group for comparison with the computer estimates. The computerized method could detect 89.37% (269/301) of the visible nipples and 69.74% (53/76) of the invisible nipples within 1 cm of the gold standard. In the test data set, 298 and 69 of the nipples were classified as visible and invisible, respectively. 92.28% (275/298) of the visible nipples and 53.62% (37/69) of the invisible nipples were identified within 1 cm of the gold standard. The results demonstrate that the nipple locations on digitized mammograms can be accurately detected if they are visible and can be reasonably estimated if they are invisible. Automated nipple detection will be an important step towards multiple image analysis for CAD.
Collapse
Affiliation(s)
- Chuan Zhou
- Department of Radiology, University of Michigan, Ann Arbor, Michigan 48109, USA.
| | | | | | | | | | | | | |
Collapse
|
18
|
Filev P, Hadjiiski L, Sahiner B, Chan HP, Helvie MA. Comparison of similarity measures for the task of template matching of masses on serial mammograms. Med Phys 2005; 32:515-29. [PMID: 15789598 DOI: 10.1118/1.1851892] [Citation(s) in RCA: 37] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
We conducted a study to evaluate the effectiveness of twelve different similarity measures in matching the corresponding masses on temporal pairs of current and prior mammograms. To perform this comparison we implemented each of the twelve similarity measures in the final stage of our multistage registration technique for automated registration of breast lesions in serial mammograms. The multistage technique consists of three stages. In the first stage an initial fan-shape search region was estimated on the prior mammogram based on the geometrical position of the mass on the current mammogram. In the second stage, the location of the fan-shape region was refined by warping, based on an affine transformation and simplex optimization. A new refined search region was defined on the prior mammogram. In the third stage, a search for the best match between the lesion template from the current mammogram and a structure on the prior mammogram was carried out within the search region. Our data set consisted of 318 temporal pairs. We performed three experiments, using a different subset of the 318 temporal pairs for each experiment. In each experiment we further tested how the performance of the similarity measures varied as the size of the search region increased or decreased. We evaluated the twelve similarity measures based on four criteria. The first criterion was the mean Euclidean distance, which was the average distance of the true location of the mass to the location detected by the similarity measure. The second criterion was the percentage of temporal pairs that were aligned so that 50% or more of the lesion area overlapped. The third criterion was the percentage of pairs that were aligned so that 75% or more of the lesion area overlapped. The fourth and final criterion was the robustness of the similarity measure. Our results showed that three of the similarity measures, Pearson's correlation, the cosine coefficient, and Goodman and Kruskal's Gamma coefficient, provide significantly higher accuracy (p < 0.05) in the task of matching the corresponding masses on serial mammograms than the other nine similarity measures.
Collapse
Affiliation(s)
- Peter Filev
- Department of Radiology, The University of Michigan, Ann Arbor, Michigan 48109-0904, USA
| | | | | | | | | |
Collapse
|
19
|
Méndez AJ, Souto M, Tahoces PG, Vidal JJ. Computer aided diagnosis for breast masses detection on a telemammography system. Comput Med Imaging Graph 2003; 27:497-502. [PMID: 14575784 DOI: 10.1016/s0895-6111(03)00035-1] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
A Computer-Aided Diagnosis (CAD) scheme for breast masses detection has been developed and integrated as a part of a telemammography system. This work derives from the close cooperation between the Laboratory for Radiologic Image Research of the University of Santiago de Compostela (Spain) and the company Intelsis Sistemas Inteligentes (Santiago de Compostela, Spain). This cooperation has been supported by funds from different projects, mainly from the European Union, the Spanish Health Administration, and the Galician Public Health's Service. As a result, a first prototype is ready to begin a demonstration project.
Collapse
|
20
|
van Engeland S, Snoeren P, Hendriks J, Karssemeijer N. A comparison of methods for mammogram registration. IEEE TRANSACTIONS ON MEDICAL IMAGING 2003; 22:1436-1444. [PMID: 14606677 DOI: 10.1109/tmi.2003.819273] [Citation(s) in RCA: 34] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
Mammogram registration is an important technique to optimize the display of cases on a digital viewing station, and to find corresponding regions in temporal pairs of mammograms for computer-aided diagnosis algorithms. Four methods for mammogram registration were tested and results were compared. The performance of all registration methods was measured by comparing the distance between annotations of abnormalities in the previous and current view before and after registration. Registration by mutual information outperformed alignment based on nipple location, alignment based on center of mass of breast tissue, and warping.
Collapse
Affiliation(s)
- Saskia van Engeland
- University Medical Center Nijmegen, Department of Radiology, Geert Grooteplein 18, 6525 GA Nijmegen, The Netherlands.
| | | | | | | |
Collapse
|
21
|
Paquerault S, Petrick N, Chan HP, Sahiner B, Helvie MA. Improvement of computerized mass detection on mammograms: fusion of two-view information. Med Phys 2002; 29:238-47. [PMID: 11865995 DOI: 10.1118/1.1446098] [Citation(s) in RCA: 89] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
Recent clinical studies have proved that computer-aided diagnosis (CAD) systems are helpful for improving lesion detection by radiologists in mammography. However, these systems would be more useful if the false-positive rate is reduced. Current CAD systems generally detect and characterize suspicious abnormal structures in individual mammographic images. Clinical experiences by radiologists indicate that screening with two mammographic views improves the detection accuracy of abnormalities in the breast. It is expected that the fusion of information from different mammographic views will improve the performance of CAD systems. We are developing a two-view matching method that utilizes the geometric locations, and morphological and textural features to correlate objects detected in two different views using a prescreening program. First, a geometrical model is used to predict the search region for an object in a second view from its location in the first view. The distance between the object and the nipple is used to define the search area. After pairing the objects in two views, textural and morphological characteristics of the paired objects are merged and similarity measures are defined. Linear discriminant analysis is then employed to classify each object pair as a true or false mass pair. The resulting object correspondence score is combined with its one-view detection score using a fusion scheme. The fusion information was found to improve the lesion detectability and reduce the number of FPs. In a preliminary study, we used a data set of 169 pairs of cranio-caudal (CC) and mediolateral oblique (MLO) view mammograms. For the detection of malignant masses on current mammograms, the film-based detection sensitivity was found to improve from 62% with a one-view detection scheme to 73% with the new two-view scheme, at a false-positive rate of 1 FP/image. The corresponding cased-based detection sensitivity improved from 77% to 91%.
Collapse
Affiliation(s)
- Sophie Paquerault
- Department of Radiology, University of Michigan, Ann Arbor 48109-0030, USA.
| | | | | | | | | |
Collapse
|
22
|
Hadjiiski L, Sahiner B, Chan HP, Petrick N, Helvie MA, Gurcan M. Analysis of temporal changes of mammographic features: computer-aided classification of malignant and benign breast masses. Med Phys 2001; 28:2309-17. [PMID: 11764038 DOI: 10.1118/1.1412242] [Citation(s) in RCA: 55] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022] Open
Abstract
A new classification scheme was developed to classify mammographic masses as malignant and benign by using interval change information. The masses on both the current and the prior mammograms were automatically segmented using an active contour method. From each mass, 20 run length statistics (RLS) texture features, 3 speculation features, and 12 morphological features were extracted. Additionally, 20 difference RLS features were obtained by subtracting the prior RLS features from the corresponding current RLS features. The feature space consisted of the current RLS features, the difference RLS features, the current and prior speculation features, and the current and prior mass sizes. Stepwise feature selection and linear discriminant analysis classification were used to select and merge the most useful features. A leave-one-case-out resampling scheme was used to train and test the classifier using 140 temporal image pairs (85 malignant, 55 benign) obtained from 57 biopsy-proven masses (33 malignant, 24 benign) in 56 patients. An average of 10 features were selected from the 56 training subsets: 4 difference RLS features, 4 RLS features, and 1 speculation feature from the current image, and 1 speculation feature from the prior, were most often chosen. The classifier achieved an average training Az of 0.92 and a test Az of 0.88. For comparison, a classifier was trained and tested using features extracted from the 120 current single images. This classifier achieved an average training Az of 0.90 and a test Az of 0.82. The information on the prior image significantly (p = 0.015) improved the accuracy for classification of the masses.
Collapse
Affiliation(s)
- L Hadjiiski
- Department of Radiology, The University of Michigan, Ann Arbor, Michigan 48109-0904, USA.
| | | | | | | | | | | |
Collapse
|