A protocol for evaluation of similarity measures for rigid registration

Motion estimation based on projective information disentanglement for 3D reconstruction of rotational coronary angiography

The 2D projection space-based motion compensation reconstruction (2D-MCR) is a kind of representative method for 3D reconstruction of rotational coronary angiography owing to its high efficiency. However, due to the lack of accurate motion estimation of the overlapping projection pixels, existing 2D-MCR methods may still have a certain level of under-sampling artifacts or lose accuracy for cases with strong cardiac motion. To overcome this, in this study, we proposed a motion estimation approach based on projective information disentanglement (PID-ME) for 3D reconstruction of rotational coronary angiography. The reconstruction method adopts the framework of 2D-MCR, which is referred to as 2D-PID-MCR. The PID-ME consists of two parts: generation of the reference projection sequence based on the fast simplified distance driven projector (FSDDP) algorithm, motion estimation and correction based on the projective average minimal distance measure (PAMD) model. The FSDDP algorithm generates the reference projection sequence faster and accelerates the whole reconstruction greatly. The PAMD model can disentangle the projection information effectively and estimate the motion of both overlapping and non-overlapping projection pixels accurately. The main contribution of this study is the construction of 2D-PID-MCR to overcome the inherent limitations of the existing 2D-MCR method. Simulated and clinical experiments show that the PID-ME, consisting of FSDDP and PAMD, can estimate the motion of the projection sequence data accurately and efficiently. Our 2D-PID-MCR method outperforms the state-of-the-art approaches in terms of accuracy and real-time performance.

Fast and Robust Symmetric Image Registration Based on Distances Combining Intensity and Spatial Information

Intensity-based image registration approaches rely on similarity measures to guide the search for geometric correspondences with high affinity between images. The properties of the used measure are vital for the robustness and accuracy of the registration. In this study a symmetric, intensity interpolationfree, affine registration framework based on a combination of intensity and spatial information is proposed. The excellent performance of the framework is demonstrated on a combination of synthetic tests, recovering known transformations in the presence of noise, and real applications in biomedical and medical image registration, for both 2D and 3D images. The method exhibits greater robustness and higher accuracy than similarity measures in common use, when inserted into a standard gradientbased registration framework available as part of the open source Insight Segmentation and Registration Toolkit (ITK). The method is also empirically shown to have a low computational cost, making it practical for real applications. Source code is available.

Assessment of Rigid Registration Quality Measures in Ultrasound-Guided Radiotherapy

Image guidance has become the standard of care for patient positioning in radiotherapy, where image registration is often a critical step to help manage patient motion. However, in practice, verification of registration quality is often adversely affected by difficulty in manual inspection of 3-D images and time constraint, thus affecting the therapeutic outcome. Therefore, we proposed to employ both bootstrapping and the supervised learning methods of linear discriminant analysis and random forest to help robustly assess registration quality in ultrasound-guided radiotherapy. We validated both approaches using phantom and real clinical ultrasound images, and showed that both performed well for the task. While learning-based techniques offer better accuracy and shorter evaluation time, bootstrapping requires no prior training and has a higher sensitivity.

Geometry calibration between X-ray source and detector for tomosynthesis with a portable X-ray system

Purpose

Tomosynthesis is attracting attention as a low-dose tomography technology compared with X-ray CT. However, conventional tomosynthesis imaging devices are large and stationary. Furthermore, there is a limitation in the working range of the X-ray source during image acquisition. We have previously proposed the use of a portable X-ray device for tomosynthesis that can be used for ward rounds and emergency medicine. The weight of this device can be reduced by using a flat panel detector (FPD), and flexibility is realized by the free placement of the X-ray source and FPD. Tomosynthesis using a portable X-ray device requires calibration of the geometry between the X-ray source and detector at each image acquisition. We propose a method for geometry calibration and demonstrate tomosynthesis image reconstruction by this method.

Methods

An image processing-based calibration method using an asymmetric and multilayered calibration object (AMCO) is presented. Since the AMCO is always attached to the X-ray source housing for geometry calibration, the additional setting of a calibration object or marker around or on the patients is not required. The AMCO’s multilayer structure improves the calibration accuracy, especially in the out-of-plane direction.

Results

Two experiments were conducted. The first was performed to evaluate the calibration accuracy using an XY positioning stage and a gonio stage. As a result, an accuracy of approximately 1 mm was achieved both in the in-plane and out-of-plane directions. An angular accuracy of approximately \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$0.5^{\circ }$$\end{document}0.5∘ was confirmed. The second experiment was conducted to evaluate the reconstructed image using a foot model phantom. Only the sagittal plane could be clearly observed with the proposed method.

Conclusion

We proposed a tomosynthesis imaging system using a portable X-ray device. From the experimental results, the proposed method could provide sufficient calibration accuracy and a clear sagittal plane of the reconstructed tomosynthesis image.

Performance Assessment for Brain MR Imaging Registration Methods

BACKGROUND AND PURPOSE

Clinical brain MR imaging registration algorithms are often made available by commercial vendors without figures of merit. The purpose of this study was to suggest a rational performance comparison methodology for these products.

MATERIALS AND METHODS

Twenty patients were imaged on clinical 3T scanners by using 4 sequences: T2-weighted, FLAIR, susceptibility-weighted angiography, and T1 postcontrast. Fiducial landmark sites (n = 1175) were specified throughout these image volumes to define identical anatomic locations across sequences. Multiple registration algorithms were applied by using the T2 sequence as a fixed reference. Euclidean error was calculated before and after each registration and compared with a criterion standard landmark registration. The Euclidean effectiveness ratio is the fraction of Euclidean error remaining after registration, and the statistical effectiveness ratio is similar, but accounts for dispersion and noise.

RESULTS

Before registration, error values for FLAIR, susceptibility-weighted angiography, and T1 postcontrast were 2.07 ± 0.55 mm, 2.63 ± 0.62 mm, and 3.65 ± 2.00 mm, respectively. Postregistration, the best error values for FLAIR, susceptibility-weighted angiography, and T1 postcontrast were 1.55 ± 0.46 mm, 1.34 ± 0.23 mm, and 1.06 ± 0.16 mm, with Euclidean effectiveness ratio values of 0.493, 0.181, and 0.096 and statistical effectiveness ratio values of 0.573, 0.352, and 0.929 for rigid mutual information, affine mutual information, and a commercial GE registration, respectively.

CONCLUSIONS

We demonstrate a method for comparing the performance of registration algorithms and suggest the Euclidean error, Euclidean effectiveness ratio, and statistical effectiveness ratio as performance metrics for clinical registration algorithms. These figures of merit allow registration algorithms to be rationally compared.

3D-2D image registration for target localization in spine surgery: investigation of similarity metrics providing robustness to content mismatch

In image-guided spine surgery, robust three-dimensional to two-dimensional (3D-2D) registration of preoperative computed tomography (CT) and intraoperative radiographs can be challenged by the image content mismatch associated with the presence of surgical instrumentation and implants as well as soft-tissue resection or deformation. This work investigates image similarity metrics in 3D-2D registration offering improved robustness against mismatch, thereby improving performance and reducing or eliminating the need for manual masking. The performance of four gradient-based image similarity metrics (gradient information (GI), gradient correlation (GC), gradient information with linear scaling (GS), and gradient orientation (GO)) with a multi-start optimization strategy was evaluated in an institutional review board-approved retrospective clinical study using 51 preoperative CT images and 115 intraoperative mobile radiographs. Registrations were tested with and without polygonal masks as a function of the number of multistarts employed during optimization. Registration accuracy was evaluated in terms of the projection distance error (PDE) and assessment of failure modes (PDE  >  30 mm) that could impede reliable vertebral level localization. With manual polygonal masking and 200 multistarts, the GC and GO metrics exhibited robust performance with 0% gross failures and median PDE < 6.4 mm (±4.4 mm interquartile range (IQR)) and a median runtime of 84 s (plus upwards of 1-2 min for manual masking). Excluding manual polygonal masks and decreasing the number of multistarts to 50 caused the GC-based registration to fail at a rate of >14%; however, GO maintained robustness with a 0% gross failure rate. Overall, the GI, GC, and GS metrics were susceptible to registration errors associated with content mismatch, but GO provided robust registration (median PDE  =  5.5 mm, 2.6 mm IQR) without manual masking and with an improved runtime (29.3 s). The GO metric improved the registration accuracy and robustness in the presence of strong image content mismatch. This capability could offer valuable assistance and decision support in spine level localization in a manner consistent with clinical workflow.

A neural network-based 2D/3D image registration quality evaluator for pediatric patient setup in external beam radiotherapy

Our purpose was to develop a neural network‐based registration quality evaluator (RQE) that can improve the 2D/3D image registration robustness for pediatric patient setup in external beam radiotherapy. Orthogonal daily setup X‐ray images of six pediatric patients with brain tumors receiving proton therapy treatments were retrospectively registered with their treatment planning computed tomography (CT) images. A neural network‐based pattern classifier was used to determine whether a registration solution was successful based on geometric features of the similarity measure values near the point‐of‐solution. Supervised training and test datasets were generated by rigidly registering a pair of orthogonal daily setup X‐ray images to the treatment planning CT. The best solution for each registration task was selected from 50 optimizing attempts that differed only by the randomly generated initial transformation parameters. The distance from each individual solution to the best solution in the normalized parametrical space was compared to a user‐defined error tolerance to determine whether that solution was acceptable. A supervised training was then used to train the RQE. Performance of the RQE was evaluated using test dataset consisting of registration results that were not used in training. The RQE was integrated with our in‐house 2D/3D registration system and its performance was evaluated using the same patient dataset. With an optimized sampling step size (i.e., 5 mm) in the feature space, the RQE has the sensitivity and the specificity in the ranges of 0.865–0.964 and 0.797–0.990, respectively, when used to detect registration error with mean voxel displacement (MVD) greater than 1 mm. The trial‐to‐acceptance ratio of the integrated 2D/3D registration system, for all patients, is equal to 1.48. The final acceptance ratio is 92.4%. The proposed RQE can potentially be used in a 2D/3D rigid image registration system to improve the overall robustness by rejecting unsuccessful registration solutions. The RQE is not patient‐specific, so a single RQE can be constructed and used for a particular application (e.g., the registration for images acquired on the same anatomical site). Implementation of the RQE in a 2D/3D registration system is clinically feasible.

PACS numbers: 87.57.nj, 87.85.dq, 87.55.Qr

Evaluating Similarity Measures for Brain Image Registration

Evaluation of similarity measures for image registration is a challenging problem due to its complex interaction with the underlying optimization, regularization, image type and modality. We propose a single performance metric, named robustness, as part of a new evaluation method which quantifies the effectiveness of similarity measures for brain image registration while eliminating the effects of the other parts of the registration process. We show empirically that similarity measures with higher robustness are more effective in registering degraded images and are also more successful in performing intermodal image registration. Further, we introduce a new similarity measure, called normalized spatial mutual information, for 3D brain image registration whose robustness is shown to be much higher than the existing ones. Consequently, it tolerates greater image degradation and provides more consistent outcomes for intermodal brain image registration.

Evaluation of the registration of temporal series of contrast-enhanced perfusion magnetic resonance 3D images of the liver

The registration of 2D and 3D images is one of the key tasks in medical image processing and analysis. Accurate registration is a crucial preprocessing step for many tasks; consequently, the evaluation of its accuracy becomes necessary. Unfortunately, this is a difficult task, especially when no golden pattern (true result) is available and when the signal values may have changed between successive images to be registered. This is the case this paper deals with: we have a series of 3D images, magnetic resonance images (MRI) of the liver and adjacent areas that have to be registered. They have been taken while a contrast is diffused through the liver tissue, so intensity of each observed point changes for two reasons: contrast diffusion/perfusion and deformation of the liver (due to body movement and breathing). In this paper, we introduce a new method to automatically compare two or more registration algorithms applied to the same case of a perfusion magnetic resonance dynamic image so that the best of them can be chosen when no ground truth is available. This is done by modeling the function that gives the intensity at a given point as a functional datum, and using statistical techniques to assess its change in comparison with other functions. An example of the application is shown by comparing two parametrizations of a B-spline based registration algorithm. The main result of the proposed method is a suggestive evidence to guide the physician in the process of selecting a registration algorithm, that recommends the algorithm of minimal complexity but still suitable for the case to be analyzed.

Optimization of PET-MR registrations for nonhuman primates using mutual information measures: a Multi-Transform Method (MTM)

An important step in PET brain kinetic analysis is the registration of functional data to an anatomical MR image. Typically, PET-MR registrations in nonhuman primate neuroreceptor studies used PET images acquired early post-injection, (e.g., 0-10 min) to closely resemble the subject's MR image. However, a substantial fraction of these registrations (~25%) fail due to the differences in kinetics and distribution for various radiotracer studies and conditions (e.g., blocking studies). The Multi-Transform Method (MTM) was developed to improve the success of registrations between PET and MR images. Two algorithms were evaluated, MTM-I and MTM-II. The approach involves creating multiple transformations by registering PET images of different time intervals, from a dynamic study, to a single reference (i.e., MR image) (MTM-I) or to multiple reference images (i.e., MR and PET images pre-registered to the MR) (MTM-II). Normalized mutual information was used to compute similarity between the transformed PET images and the reference image(s) to choose the optimal transformation. This final transformation is used to map the dynamic dataset into the animal's anatomical MR space, required for kinetic analysis. The chosen transforms from MTM-I and MTM-II were evaluated using visual rating scores to assess the quality of spatial alignment between the resliced PET and reference images. One hundred twenty PET datasets involving eleven different tracers from 3 different scanners were used to evaluate the MTM algorithms. Studies were performed with baboons and rhesus monkeys on the HR+, HRRT, and Focus-220. Successful transformations increased from 77.5%, 85.8%, to 96.7% using the 0-10 min method, MTM-I, and MTM-II, respectively, based on visual rating scores. The Multi-Transform Methods proved to be a robust technique for PET-MR registrations for a wide range of PET studies.

Automatic nonrigid calibration of image registration for real time MR-guided HIFU ablations of mobile organs

Real time magnetic resonance imaging (MRI) is rapidly gaining importance in interventional therapies. An accurate motion estimation is required for mobile targets and can be conveniently addressed using an image registration algorithm. Since the adaptation of the control parameters of the algorithm depends on the application (targeted organ, location of the tumor, slice orientation, etc.), typically an individual calibration is required. However, the assessment of the estimated motion accuracy is difficult since the real target motion is unknown. In this paper, existing criteria based only on anatomical image similarity are demonstrated to be inadequate. A new criterion is introduced, which is based on the local magnetic field distribution. The proposed criterion was used to assess, during a preparative calibration step, the optimal configuration of an image registration algorithm derived from the Horn and Schunck method. The accuracy of the proposed method was evaluated in a moving phantom experiment, which allows the comparison with the known motion pattern and to an established criterion based on anatomical images. The usefulness of the method for the calibration of optical-flow based algorithms was also demonstrated in vivo under conditions similar to thermo-ablation for the abdomen of twelve volunteers. In average over all volunteers, a resulting displacement error of 1.5 mm was obtained (largest observed error equal to 4-5 mm) using a criterion based on anatomical image similarity. A better average accuracy of 1 mm was achieved using the proposed criterion (largest observed error equal to 2 mm). In both kidney and liver, the proposed criterion was shown to provide motion field accuracy in the range of the best achievable.

Automatic colposcopy video tissue classification using higher order entropy-based image registration

Colposcopy is a well-established method to detect and diagnose intraepithelial lesions and uterine cervical cancer in early stages. During the exam color and texture changes are induced by the application of a contrast agent (e.g.3-5% acetic acid solution or iodine). Our aim is to densely quantify the change in the acetowhite decay level for a sequence of images captured during a colposcopy exam to help the physician in his diagnosis providing new tools that overcome subjectivity and improve reproducibility. As the change in acetowhite decay level must be calculated from the same tissue point in all images, we present an elastic image registration scheme able to compensate patient, camera and tissue movement robustly in cervical images. The image registration is based on a novel multi-feature entropy similarity criterion. Temporal features are then extracted using the color properties of the aligned image sequence and a dual compartment tissue model of the cervix. An example of the use of the temporal features for pixel-wise classification is presented and the results are compared against ground truth histopathological annotations.

Validation for 2D/3D registration. II: The comparison of intensity- and gradient-based merit functions using a new gold standard data set

PURPOSE

A new gold standard data set for validation of 2D/3D registration based on a porcine cadaver head with attached fiducial markers was presented in the first part of this article. The advantage of this new phantom is the large amount of soft tissue, which simulates realistic conditions for registration. This article tests the performance of intensity- and gradient-based algorithms for 2D/3D registration using the new phantom data set.

METHODS

Intensity-based methods with four merit functions, namely, cross correlation, rank correlation, correlation ratio, and mutual information (MI), and two gradient-based algorithms, the backprojection gradient-based (BGB) registration method and the reconstruction gradient-based (RGB) registration method, were compared. Four volumes consisting of CBCT with two fields of view, 64 slice multidetector CT, and magnetic resonance-T1 weighted images were registered to a pair of kV x-ray images and a pair of MV images. A standardized evaluation methodology was employed. Targets were evenly spread over the volumes and 250 starting positions of the 3D volumes with initial displacements of up to 25 mm from the gold standard position were calculated. After the registration, the displacement from the gold standard was retrieved and the root mean square (RMS), mean, and standard deviation mean target registration errors (mTREs) over 250 registrations were derived. Additionally, the following merit properties were computed: Accuracy, capture range, number of minima, risk of nonconvergence, and distinctiveness of optimum for better comparison of the robustness of each merit.

RESULTS

Among the merit functions used for the intensity-based method, MI reached the best accuracy with an RMS mTRE down to 1.30 mm. Furthermore, it was the only merit function that could accurately register the CT to the kV x rays with the presence of tissue deformation. As for the gradient-based methods, BGB and RGB methods achieved subvoxel accuracy (RMS mTRE down to 0.56 and 0.70 mm, respectively). Overall, gradient-based similarity measures were found to be substantially more accurate than intensity-based methods and could cope with soft tissue deformation and enabled also accurate registrations of the MR-T1 volume to the kV x-ray image.

CONCLUSIONS

In this article, the authors demonstrate the usefulness of a new phantom image data set for the evaluation of 2D/3D registration methods, which featured soft tissue deformation. The author's evaluation shows that gradient-based methods are more accurate than intensity-based methods, especially when soft tissue deformation is present. However, the current nonoptimized implementations make them prohibitively slow for practical applications. On the other hand, the speed of the intensity-based method renders these more suitable for clinical use, while the accuracy is still competitive.

A neural network based 3D/3D image registration quality evaluator for the head-and-neck patient setup in the absence of a ground truth

PURPOSE

To develop a neural network based registration quality evaluator (RQE) that can identify unsuccessful 3D/3D image registrations for the head-and-neck patient setup in radiotherapy.

METHODS

A two-layer feed-forward neural network was used as a RQE to classify 3D/3D rigid registration solutions as successful or unsuccessful based on the features of the similarity surface near the point-of-solution. The supervised training and test data sets were generated by rigidly registering daily cone-beam CTs to the treatment planning fan-beam CTs of six patients with head-and-neck tumors. Two different similarity metrics (mutual information and mean-squared intensity difference) and two different types of image content (entire image versus bony landmarks) were used. The best solution for each registration pair was selected from 50 optimizing attempts that differed only by the initial transformation parameters. The distance from each individual solution to the best solution in the normalized parametrical space was compared to a user-defined error threshold to determine whether that solution was successful or not. The supervised training was then used to train the RQE. The performance of the RQE was evaluated using the test data set that consisted of registration results that were not used in training.

RESULTS

The RQE constructed using the mutual information had very good performance when tested using the test data sets, yielding the sensitivity, the specificity, the positive predictive value, and the negative predictive value in the ranges of 0.960-1.000, 0.993-1.000, 0.983-1.000, and 0.909-1.000, respectively. Adding a RQE into a conventional 3D/3D image registration system incurs only about 10%-20% increase of the overall processing time.

CONCLUSIONS

The authors' patient study has demonstrated very good performance of the proposed RQE when used with the mutual information in identifying unsuccessful 3D/3D registrations for daily patient setup. The classifier had very good generality and required only to be trained once for each implementation. When the RQE is incorporated with an automated 3D/3D image registration system, it can improve the robustness of the system.

Prostate localization on daily cone-beam computed tomography images: accuracy assessment of similarity metrics

PURPOSE

To evaluate different similarity metrics (SM) using natural calcifications and observation-based measures to determine the most accurate prostate and seminal vesicle localization on daily cone-beam CT (CBCT) images.

METHODS AND MATERIALS

CBCT images of 29 patients were retrospectively analyzed; 14 patients with prostate calcifications (calcification data set) and 15 patients without calcifications (no-calcification data set). Three groups of test registrations were performed. Test 1: 70 CT/CBCT pairs from calcification dataset were registered using 17 SMs (6,580 registrations) and compared using the calcification mismatch error as an endpoint. Test 2: Using the four best SMs from Test 1, 75 CT/CBCT pairs in the no-calcification data set were registered (300 registrations). Accuracy of contour overlays was ranked visually. Test 3: For the best SM from Tests 1 and 2, accuracy was estimated using 356 CT/CBCT registrations. Additionally, target expansion margins were investigated for generating registration regions of interest.

RESULTS

Test 1-Incremental sign correlation (ISC), gradient correlation (GC), gradient difference (GD), and normalized cross correlation (NCC) showed the smallest errors (mu +/- sigma: 1.6 +/- 0.9 approximately 2.9 +/- 2.1 mm). Test 2-Two of the three reviewers ranked GC higher. Test 3-Using GC, 96% of registrations showed <3-mm error when calcifications were filtered. Errors were left/right: 0.1 +/- 0.5mm, anterior/posterior: 0.8 +/- 1.0mm, and superior/inferior: 0.5 +/- 1.1 mm. The existence of calcifications increased the success rate to 97%. Expansion margins of 4-10 mm were equally successful.

CONCLUSION

Gradient-based SMs were most accurate. Estimated error was found to be <3 mm (1.1 mm SD) in 96% of the registrations. Results suggest that the contour expansion margin should be no less than 4 mm.

Musculoskeletal MRI segmentation using multi-resolution simplex meshes with medial representations

The automatic segmentation of the musculoskeletal system from medical images is a particularly challenging task, due to its morphological complexity, its large variability in the population and its potentially large deformations. In this paper we propose a novel approach for musculoskeletal segmentation and registration based on simplex meshes. Such discrete models have already proven to be efficient and versatile for medical image segmentation. We extend the current framework by introducing a multi-resolution approach and a reversible medial representation, in order to reduce the complexity of geometric and non-penetration constraints computation. Our framework allows both inter and intra-patient registration (involving both rigid and elastic matching). We also show that the introduced representations facilitate morphological analysis. As a case study, we demonstrate that muscles, bones, ligaments and cartilages of the hip and the thigh can be registered at an interactive frame rate, in a time-efficient way (<30min), with a satisfactory accuracy ( approximately 1.5mm), and with a minimal amount of manual tasks.

Evaluation of similarity measures for use in the intensity-based rigid 2D-3D registration for patient positioning in radiotherapy

PURPOSE

Rigid 2D-3D registration is an alternative to 3D-3D registration for cases where largely bony anatomy can be used for patient positioning in external beam radiation therapy. In this article, the authors evaluated seven similarity measures for use in the intensity-based rigid 2D-3D registration using a variation in Skerl's similarity measure evaluation protocol.

METHODS

The seven similarity measures are partitioned intensity uniformity, normalized mutual information (NMI), normalized cross correlation (NCC), entropy of the difference image, pattern intensity (PI), gradient correlation (GC), and gradient difference (GD). In contrast to traditional evaluation methods that rely on visual inspection or registration outcomes, the similarity measure evaluation protocol probes the transform parameter space and computes a number of similarity measure properties, which is objective and optimization method independent. The variation in protocol offers an improved property in the quantification of the capture range. The authors used this protocol to investigate the effects of the downsampling ratio, the region of interest, and the method of the digitally reconstructed radiograph (DRR) calculation [i.e., the incremental ray-tracing method implemented on a central processing unit (CPU) or the 3D texture rendering method implemented on a graphics processing unit (GPU)] on the performance of the similarity measures. The studies were carried out using both the kilovoltage (kV) and the megavoltage (MV) images of an anthropomorphic cranial phantom and the MV images of a head-and-neck cancer patient.

RESULTS

Both the phantom and the patient studies showed the 2D-3D registration using the GPU-based DRR calculation yielded better robustness, while providing similar accuracy compared to the CPU-based calculation. The phantom study using kV imaging suggested that NCC has the best accuracy and robustness, but its slow function value change near the global maximum requires a stricter termination condition for an optimization method. The phantom study using MV imaging indicated that PI, GD, and GC have the best accuracy, while NCC and NMI have the best robustness. The clinical study using MV imaging showed that NCC and NMI have the best robustness.

CONCLUSIONS

The authors evaluated the performance of seven similarity measures for use in 2D-3D image registration using the variation in Skerl's similarity measure evaluation protocol. The generalized methodology can be used to select the best similarity measures, determine the optimal or near optimal choice of parameter, and choose the appropriate registration strategy for the end user in his specific registration applications in medical imaging.

Evaluation of registration strategies for multi-modality images of rat brain slices

In neuroscience, small-animal studies frequently involve dealing with series of images from multiple modalities such as histology and autoradiography. The consistent and bias-free restacking of multi-modality image series is obligatory as a starting point for subsequent non-rigid registration procedures and for quantitative comparisons with positron emission tomography (PET) and other in vivo data. Up to now, consistency between 2D slices without cross validation using an inherent 3D modality is frequently presumed to be close to the true morphology due to the smooth appearance of the contours of anatomical structures. However, in multi-modality stacks consistency is difficult to assess. In this work, consistency is defined in terms of smoothness of neighboring slices within a single modality and between different modalities. Registration bias denotes the distortion of the registered stack in comparison to the true 3D morphology and shape. Based on these metrics, different restacking strategies of multi-modality rat brain slices are experimentally evaluated. Experiments based on MRI-simulated and real dual-tracer autoradiograms reveal a clear bias of the restacked volume despite quantitatively high consistency and qualitatively smooth brain structures. However, different registration strategies yield different inter-consistency metrics. If no genuine 3D modality is available, the use of the so-called SOP (slice-order preferred) or MOSOP (modality-and-slice-order preferred) strategy is recommended.

Taxotere chemosensitivity evaluation in mice prostate tumor: validation and diagnostic accuracy of quantitative measurement of tumor characteristics by MRI, PET, and histology of mice tumor

Increased PET and MRI image intensities of mouse prostate tumors were correlated with histostaining tumor characteristics. The hypothesis was that increased intracellular sodium microMRI signal intensities and flouro-2-deoxy-glucose utilization by microPET in apoptosis rich regions in tumors were positively correlated as chemosensitivity assay of Taxotere. The PC-3 cancer cell line induced prostate tumor MRI and PET images and histology slices were digitally captured and compared in pre- and post-Taxotere treated tumors. The optimization of inversion recovery MRI parameters was done to generate sodium images of phantom. The (18)FDG biotransformation was optimized to measure PET image intensities. A criterion was developed to evaluate malignancy by histology. For correlation, regression analysis was done using imaging, histology, and immunostaining data from PC3 tumor after 24 and 48 hours post-Taxotere treatment. Apoptosis indices were calculated by histostaining and ss-DNA antibody assay. Sodium MRI and PET signal intensity distributions were comparable at specific locations relatively and measured in tumor tissue regions. In tumors, Taxotere induced an increase in intracellular sodium MRI signal 30% (p<0.001) with decreased tumor size (20%; p<0.001) and micro-PET showed FDG uptake increase 15% (p<0.001) with decreased tumor size (10%; p<0.001) than that of control tumors after 24 hours. Histological features indicated tumor risk (high 'intracellular/extracellular ratio', high mitotic index, and apoptotic index), decreased tumor viability (reduced mitotic figures, reduced diploidy or aneuploidy, and proliferation index) after Taxotere treatment. These features in co-registered intracellular sodium, microPET hypermetabolic, and monoclonal antibody (ss-DNA) sensitive regions showed (% difference > 6%). Apoptosis rich regions showed characteristic nuclei with S phase DNA histogram, appearing brighter on IC-Na images and mild active on PET images (sensitivity=65%; specificity=70%). In conclusion, MRI and PET multimodal imaging may be rapid non-invasive chemosensitivity assay to monitor the drug anticancer effect.

Evaluation of a stochastic approach to 2D-3D intensity-based registration

this paper assesses a new 2D-3D rigid registration method based on stochastic clustering and an enhanced estimator for mutual information. It combines precision, accuracy and acceptable computation time. Spine datasets (fluoroscopy and computed tomography) with their gold standard transformations are used. Both optimization method and similarity measure are assessed separately using standardized evaluation methodologies. Sub-millimeter accuracy and the high convergence rate obtained within one minute are compared to other quasi-global optimization processes such as particle filtering.

Comparative evaluation of similarity measures for the rigid registration of multi-modal head images

Image registrations that are based on similarity measures simply adjust the parameters of an appropriate spatial transformation model until the similarity measure reaches an optimum. The numerous similarity measures that have been proposed in the past are differently sensitive to imaging modality, image content and differences in the image content, selection of the floating and target image, partial image overlap, etc. In this paper, we evaluate and compare 12 similarity measures for the rigid registration. To study the impact of different imaging modalities on the behavior of similarity measures, we have used 16 CT/MR and 6 PET/MR image pairs with known 'gold standard' registrations. The results for the PET/MR registration and for the registration of CT to both rectified and unrectified MR images indicate that mutual information, normalized mutual information and the entropy correlation coefficient are the most accurate similarity measures and have the smallest risk of being trapped in a local optimum. The results of an experiment on the impact of exchanging the floating and target image indicate that, especially in MR/PET registrations, the behavior of some similarity measures, such as mutual information, significantly depends on which image is the floating and which is the target.

Novel image registration quality evaluator (RQE) with an implementation for automated patient positioning in cranial radiation therapy

In external beam radiation therapy, digitally reconstructed radiographs (DRRs) and portal images are used to verify patient setup based either on a visual comparison or, less frequently, with automated registration algorithms. A registration algorithm can be trapped in local optima due to irregularity of patient anatomy, image noise and artifacts, and/or out-of-plane shifts, resulting in an incorrect solution. Thus, human observation, which is subjective, is still required to check the registration result. We propose to use a novel image registration quality evaluator (RQE) to automatically identify misregistrations as part of an algorithm-based decision-making process for verification of patient positioning. A RQE, based on an adaptive pattern classifier, is generated from a pair of reference and target images to determine the acceptability of a registration solution given an optimization process. Here we applied our RQE to patient positioning for cranial radiation therapy. We constructed two RQEs-one for the evaluation of intramodal registrations (i.e., portal-portal); the other for intermodal registrations (i.e., portal-DRR). Mutual information, because of its high discriminatory ability compared with other measures (i.e., correlation coefficient and partitioned intensity uniformity), was chosen as the test function for both RQEs. We adopted 1 mm translation and 1 degree rotation as the maximal acceptable registration errors, reflecting desirable clinical setup tolerances for cranial radiation therapy. Receiver operating characteristic analysis was used to evaluate the performance of the RQE, including computations of sensitivity and specificity. The RQEs showed very good performance for both intramodal and intermodal registrations using simulated and phantom data. The sensitivity and the specificity were 0.973 and 0.936, respectively, for the intramodal RQE using phantom data. Whereas the sensitivity and the specificity were 0.961 and 0.758, respectively, for the intermodal RQE using phantom data. Phantom experiments also indicated our RQEs detected out-of-plane deviations exceeding 2.5 mm and 2.50. A preliminary retrospective clinical study of the RQE on cranial portal imaging also yielded good sensitivity > or = 0.857) and specificity (> or = 0.987). Clinical implementation of a RQE could potentially reduce the involvement of the human observer for routine patient positioning verification, while increasing setup accuracy and reducing setup verification time.

Brain functional localization: a survey of image registration techniques

Functional localization is a concept which involves the application of a sequence of geometrical and statistical image processing operations in order to define the location of brain activity or to produce functional/parametric maps with respect to the brain structure or anatomy. Considering that functional brain images do not normally convey detailed structural information and, thus, do not present an anatomically specific localization of functional activity, various image registration techniques are introduced in the literature for the purpose of mapping functional activity into an anatomical image or a brain atlas. The problems addressed by these techniques differ depending on the application and the type of analysis, i.e., single-subject versus group analysis. Functional to anatomical brain image registration is the core part of functional localization in most applications and is accompanied by intersubject and subject-to-atlas registration for group analysis studies. Cortical surface registration and automatic brain labeling are some of the other tools towards establishing a fully automatic functional localization procedure. While several previous survey papers have reviewed and classified general-purpose medical image registration techniques, this paper provides an overview of brain functional localization along with a survey and classification of the image registration techniques related to this problem.