1
|
Munbodh R, Chen Z, Jaffray DA, Moseley DJ, Knisely JPS, Duncan JS. A frequency-based approach to locate common structure for 2D-3D intensity-based registration of setup images in prostate radiotherapy. Med Phys 2016; 34:3005-17. [PMID: 17822009 PMCID: PMC2796184 DOI: 10.1118/1.2745235] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
In many radiotherapy clinics, geometric uncertainties in the delivery of 3D conformal radiation therapy and intensity modulated radiation therapy of the prostate are reduced by aligning the patient's bony anatomy in the planning 3D CT to corresponding bony anatomy in 2D portal images acquired before every treatment fraction. In this paper, we seek to determine if there is a frequency band within the portal images and the digitally reconstructed radiographs (DRRs) of the planning CT in which bony anatomy predominates over non-bony anatomy such that portal images and DRRs can be suitably filtered to achieve high registration accuracy in an automated 2D-3D single portal intensity-based registration framework. Two similarity measures, mutual information and the Pearson correlation coefficient were tested on carefully collected gold-standard data consisting of a kilovoltage cone-beam CT (CBCT) and megavoltage portal images in the anterior-posterior (AP) view of an anthropomorphic phantom acquired under clinical conditions at known poses, and on patient data. It was found that filtering the portal images and DRRs during the registration considerably improved registration performance. Without filtering, the registration did not always converge while with filtering it always converged to an accurate solution. For the pose-determination experiments conducted on the anthropomorphic phantom with the correlation coefficient, the mean (and standard deviation) of the absolute errors in recovering each of the six transformation parameters were Theta(x):0.18(0.19) degrees, Theta(y):0.04(0.04) degrees, Theta(z):0.04(0.02) degrees, t(x):0.14(0.15) mm, t(y):0.09(0.05) mm, and t(z):0.49(0.40) mm. The mutual information-based registration with filtered images also resulted in similarly small errors. For the patient data, visual inspection of the superimposed registered images showed that they were correctly aligned in all instances. The results presented in this paper suggest that robust and accurate registration can be achieved with intensity-based methods by focusing on rigid bony structures in the images while diminishing the influence of artifacts with similar frequencies as soft tissue.
Collapse
Affiliation(s)
- Reshma Munbodh
- Department of Electrical Engineering, Yale University, New Haven, Connecticut 06520, USA.
| | | | | | | | | | | |
Collapse
|
2
|
Markelj P, Tomaževič D, Likar B, Pernuš F. A review of 3D/2D registration methods for image-guided interventions. Med Image Anal 2012; 16:642-61. [PMID: 20452269 DOI: 10.1016/j.media.2010.03.005] [Citation(s) in RCA: 336] [Impact Index Per Article: 28.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2009] [Revised: 02/22/2010] [Accepted: 03/30/2010] [Indexed: 02/07/2023]
|
3
|
Zhou J, Kim S, Jabbour S, Goyal S, Haffty B, Chen T, Levinson L, Metaxas D, Yue NJ. A 3D global-to-local deformable mesh model based registration and anatomy-constrained segmentation method for image guided prostate radiotherapy. Med Phys 2010; 37:1298-308. [DOI: 10.1118/1.3298374] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
|
4
|
Armato SG, Sensakovic WF, Passen SJ, Engelmann R, MacMahon H. Temporal subtraction in chest radiography: Mutual information as a measure of image quality. Med Phys 2009; 36:5675-82. [DOI: 10.1118/1.3259712] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022] Open
Affiliation(s)
- Samuel G. Armato
- Department of Radiology, The University of Chicago, 5841 South Maryland Avenue, Chicago, Illinois 60637
| | - William F. Sensakovic
- Department of Radiology, The University of Chicago, 5841 South Maryland Avenue, Chicago, Illinois 60637
| | - Samantha J. Passen
- Department of Radiology, The University of Chicago, 5841 South Maryland Avenue, Chicago, Illinois 60637
| | - Roger Engelmann
- Department of Radiology, The University of Chicago, 5841 South Maryland Avenue, Chicago, Illinois 60637
| | - Heber MacMahon
- Department of Radiology, The University of Chicago, 5841 South Maryland Avenue, Chicago, Illinois 60637
| |
Collapse
|
5
|
Munbodh R, Chen Z, Jaffray DA, Moseley DJ, Knisely JPS, Duncan JS. Automated 2D-3D registration of portal images and CT data using line-segment enhancement. Med Phys 2008; 35:4352-61. [PMID: 18975681 DOI: 10.1118/1.2975143] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
In prostate radiotherapy, setup errors with respect to the patient's bony anatomy can be reduced by aligning 2D megavoltage (MV) portal images acquired during treatment to a reference 3D kilovoltage (kV) CT acquired for treatment planning purposes. The purpose of this study was to evaluate a fully automated 2D-3D registration algorithm to quantify setup errors in 3D through the alignment of line-enhanced portal images and digitally reconstructed radiographs computed from the CT. The line-enhanced images were obtained by correlating the images with a filter bank of short line segments, or "sticks" at different orientations. The proposed methods were validated on (1) accurately collected gold-standard data consisting of a 3D kV cone-beam CT scan of an anthropomorphic phantom of the pelvis and 2D MV portal images in the anterior-posterior (AP) view acquired at 15 different poses and (2) a conventional 3D kV CT scan and weekly 2D MV AP portal images of a patient over 8 weeks. The mean (and standard deviation) of the absolute registration error for rotations around the right-lateral (RL), inferior-superior (IS), and posterior-anterior (PA) axes were 0.212 degree (0.214 degree), 0.055 degree (0.033 degree) and 0.041 degree (0.039 degree), respectively. The corresponding registration errors for translations along the RL, IS, and PA axes were 0.161 (0.131) mm, 0.096 (0.033) mm, and 0.612 (0.485) mm. The mean (and standard deviation) of the total registration error was 0.778 (0.543) mm. Registration on the patient images was successful in all eight cases as determined visually. The results indicate that it is feasible to automatically enhance features in MV portal images of the pelvis for use within a completely automated 2D-3D registration framework for the accurate determination of patient setup errors. They also indicate that it is feasible to estimate all six transformation parameters from a 3D CT of the pelvis and a single portal image in the AP view.
Collapse
Affiliation(s)
- Reshma Munbodh
- Department of Electrical Engineering, Yale University, New Haven, Connecticut 06520, USA.
| | | | | | | | | | | |
Collapse
|
6
|
Jiang CF, Lu TC, Sun SP. Interactive image registration tool for positioning verification in head and neck radiotherapy. Comput Biol Med 2008; 38:90-100. [PMID: 17825815 DOI: 10.1016/j.compbiomed.2007.07.005] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2006] [Revised: 07/04/2007] [Accepted: 07/06/2007] [Indexed: 11/26/2022]
Abstract
This paper presents the development of a computer-aided image management tool, named CAIMT, used for patient setup error measurement in radiation treatment planning. The CAIMT incorporates user interaction to facilitate contour detection from both portal film and simulation film. The detected contours were then used as features for image registration through application of the generalized Hough transform (GHT). Positioning error was measured when the optimal registration was achieved. The CAIMT has been applied to register the image pairs of a rando(TM) phantom and five real subjects, in order to evaluate its reliability and stability. The promising results suggest that the CAIMT can assist radiotherapists to align the simulation film and the portal film precisely and steadily and therefore adjust patient positioning to the optimum in a more efficient way.
Collapse
Affiliation(s)
- Ching-Fen Jiang
- Department of Biomedical Engineering, I-Shou University, Kaohsiung, Taiwan, Republic of China
| | | | | |
Collapse
|
7
|
Intensity-based registration of freehand 3D ultrasound and CT-scan images of the kidney. Int J Comput Assist Radiol Surg 2007. [DOI: 10.1007/s11548-007-0077-5] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
8
|
Munbodh R, Jaffray DA, Moseley DJ, Chen Z, Knisely JPS, Cathier P, Duncan JS. Automated 2D-3D registration of a radiograph and a cone beam CT using line-segment enhancement. Med Phys 2006; 33:1398-411. [PMID: 16752576 PMCID: PMC2796183 DOI: 10.1118/1.2192621] [Citation(s) in RCA: 27] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
The objective of this study was to develop a fully automated two-dimensional (2D)-three-dimensional (3D) registration framework to quantify setup deviations in prostate radiation therapy from cone beam CT (CBCT) data and a single AP radiograph. A kilovoltage CBCT image and kilovoltage AP radiograph of an anthropomorphic phantom of the pelvis were acquired at 14 accurately known positions. The shifts in the phantom position were subsequently estimated by registering digitally reconstructed radiographs (DRRs) from the 3D CBCT scan to the AP radiographs through the correlation of enhanced linear image features mainly representing bony ridges. Linear features were enhanced by filtering the images with "sticks," short line segments which are varied in orientation to achieve the maximum projection value at every pixel in the image. The mean (and standard deviations) of the absolute errors in estimating translations along the three orthogonal axes in millimeters were 0.134 (0.096) AP(out-of-plane), 0.021 (0.023) ML and 0.020 (0.020) SI. The corresponding errors for rotations in degrees were 0.011 (0.009) AP, 0.029 (0.016) ML (out-of-plane), and 0.030 (0.028) SI (out-of-plane). Preliminary results with megavoltage patient data have also been reported. The results suggest that it may be possible to enhance anatomic features that are common to DRRs from a CBCT image and a single AP radiography of the pelvis for use in a completely automated and accurate 2D-3D registration framework for setup verification in prostate radiotherapy. This technique is theoretically applicable to other rigid bony structures such as the cranial vault or skull base and piecewise rigid structures such as the spine.
Collapse
Affiliation(s)
- Reshma Munbodh
- Department of Electrical Engineering, Yale University, New Haven, Connecticut 06520, USA.
| | | | | | | | | | | | | |
Collapse
|
9
|
Chelikani S, Purushothaman K, Knisely J, Chen Z, Nath R, Bansal R, Duncan J. A gradient feature weighted Minimax algorithm for registration of multiple portal images to 3DCT volumes in prostate radiotherapy. Int J Radiat Oncol Biol Phys 2006; 65:535-47. [PMID: 16690436 PMCID: PMC2791048 DOI: 10.1016/j.ijrobp.2005.12.032] [Citation(s) in RCA: 13] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2004] [Revised: 12/28/2005] [Accepted: 12/28/2005] [Indexed: 11/28/2022]
Abstract
PURPOSE To develop an accurate, fast, and robust algorithm for registering portal and computed tomographic (CT) images for radiotherapy using a combination of sparse and dense field data that complement each other. METHODS AND MATERIALS Gradient Feature Weighted Minimax (GFW Minimax) method was developed to register multiple portal images to three-dimensional CT images. Its performance was compared with that of three others: Minimax, Mutual Information, and Gilhuijs' method. Phantom and prostate cancer patient images were used. Effects of registration errors on tumor control probability (TCP) and normal tissue complication probability (NTCP) were investigated as a relative measure. RESULTS Registration of four portals to CTs resulted in 30% lower error when compared with registration with two portals. Computation time increased by nearly 50%. GFW Minimax performed the best, followed by Gilhuijs' method, the Minimax method, and Mutual Information. CONCLUSIONS Using four portals instead of two lowered the registration error. Reduced fields of view images with full feature sets gave similar results in shorter times as full fields of view images. In clinical situations where soft tissue targets are of importance, GFW Minimax algorithm was significantly more accurate and robust. With registration errors lower than 1 mm, margins may be scaled down to 4 mm without adversely affecting TCP and NTCP.
Collapse
Affiliation(s)
- Sudhakar Chelikani
- Department of Diagnostic Radiology, Yale University School of Medicine, New Haven, CT
| | | | - Jonathan Knisely
- Department of Therapeutic Radiology, Yale University School of Medicine, New Haven, CT
| | - Zhe Chen
- Department of Therapeutic Radiology, Yale University School of Medicine, New Haven, CT
| | - Ravinder Nath
- Department of Therapeutic Radiology, Yale University School of Medicine, New Haven, CT
| | - Ravi Bansal
- Department of Clinical Psychology, Columbia University, New York, NY
| | - James Duncan
- Department of Diagnostic Radiology, Yale University School of Medicine, New Haven, CT
| |
Collapse
|
10
|
Fei B, Duerk JL, Sodee DB, Wilson DL. Semiautomatic nonrigid registration for the prostate and pelvic MR volumes. Acad Radiol 2005; 12:815-24. [PMID: 16039535 DOI: 10.1016/j.acra.2005.03.063] [Citation(s) in RCA: 34] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2004] [Revised: 03/14/2005] [Accepted: 03/15/2005] [Indexed: 11/22/2022]
Abstract
RATIONALE AND OBJECTIVES Three-dimensional (3D) nonrigid image registration for potential applications in prostate cancer treatment and interventional magnetic resonance (iMRI) imaging-guided therapies were investigated. MATERIALS AND METHODS An almost fully automated 3D nonrigid registration algorithm using mutual information and a thin plate spline (TPS) transformation for MR images of the prostate and pelvis were created and evaluated. In the first step, an automatic rigid body registration with special features was used to capture the global transformation. In the second step, local feature points (FPs) were registered using mutual information. An operator entered only five FPs located at the prostate center, left and right hip joints, and left and right distal femurs. The program automatically determined and optimized other FPs at the external pelvic skin surface and along the femurs. More than 600 control points were used to establish a TPS transformation for deformation of the pelvic region and prostate. Ten volume pairs were acquired from three volunteers in the diagnostic (supine) and treatment positions (supine with legs raised). RESULTS Various visualization techniques showed that warping rectified the significant pelvic misalignment by the rigid-body method. Gray-value measures of registration quality, including mutual information, correlation coefficient, and intensity difference, all improved with warping. The distance between prostate 3D centroids was 0.7 +/- 0.2 mm after warping compared with 4.9 +/- 3.4 mm with rigid-body registration. CONCLUSION Semiautomatic nonrigid registration works better than rigid-body registration when patient position is changed greatly between acquisitions. It could be a useful tool for many applications in the management of prostate.
Collapse
Affiliation(s)
- Baowei Fei
- Department of Radiology, Case Western Reserve University and University Hospitals of Cleveland, 11100 Euclid Avenue, Cleveland, OH 44106, USA.
| | | | | | | |
Collapse
|
11
|
Sensakovic WF, Armato SG, Starkey A, Ogarek JL. Automated matching of temporally sequential CT sections. Med Phys 2005; 31:3417-24. [PMID: 15651624 DOI: 10.1118/1.1812611] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
In the evaluation of patient response to therapy through measurements on thoracic computed tomography (CT) scans, the selection of anatomically equivalent sections in temporally sequential scans is required. We developed an automated method based on normalized mutual information (NMI) to expedite the selection of anatomically equivalent sections. The method requires as input two temporally sequential CT scans from the same patient. A specified section from the baseline scan is then compared with the sections of a follow-up scan. Each section in the follow-up scan is successively translated and rotated relative to the baseline section, and NMI is calculated. The section in the follow-up scan that yields the highest NMI with respect to the baseline section is selected as the matching section. The method was applied to a database of 22 pairs of temporally sequential CT scans from mesothelioma patients. Five observers manually selected their choice of the best anatomically matched section for each of three predetermined sections in the 22 baseline scans, and the range of selected sections was recorded. The automated method was applied to the same baseline sections to determine the computer-based anatomically matched sections in the corresponding follow-up scan. The automated process was performed using both original CT sections and sections automatically segmented so that only intrathoracic pixels contributed to NMI calculations. The accuracy of the automated method was quantified on a section-by-section basis by comparison with the range of sections selected by the observers. The automated method without segmentation selected equivalent sections within the observers' range for 54 of the 66 matching tasks (81.8%). An 11% improvement was achieved when thoracic segmentation was performed as a pre-processing step.
Collapse
Affiliation(s)
- William F Sensakovic
- Department of Radiology, The University of Chicago, Chicago, Illinois 60637, USA
| | | | | | | |
Collapse
|
12
|
Geometrical Transformation Approximation for 2D/3D Intensity-Based Registration of Portal Images and CT Scan. ACTA ACUST UNITED AC 2001. [DOI: 10.1007/3-540-45468-3_64] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register]
|