A framework for automatic creation of gold-standard rigid 3D–2D registration datasets

3D/2D Vessel Registration Based on Monte Carlo Tree Search and Manifold Regularization

The augmented intra-operative real-time imaging in vascular interventional surgery, which is generally performed by projecting preoperative computed tomography angiography images onto intraoperative digital subtraction angiography (DSA) images, can compensate for the deficiencies of DSA-based navigation, such as lack of depth information and excessive use of toxic contrast agents. 3D/2D vessel registration is the critical step in image augmentation. A 3D/2D registration method based on vessel graph matching is proposed in this study. For rigid registration, the matching of vessel graphs can be decomposed into continuous states, thus 3D/2D vascular registration is formulated as a search tree problem. The Monte Carlo tree search method is applied to find the optimal vessel matching associated with the highest rigid registration score. For nonrigid registration, we propose a novel vessel deformation model based on manifold regularization. This model incorporates the smoothness constraint of vessel topology into the objective function. Furthermore, we derive simplified gradient formulas that enable fast registration. The proposed technique undergoes evaluation against seven rigid and three nonrigid methods using a variety of data - simulated, algorithmically generated, and manually annotated - across three vascular anatomies: the hepatic artery, coronary artery, and aorta. Our findings show the proposed method's resistance to pose variations, noise, and deformations, outperforming existing methods in terms of registration accuracy and computational efficiency. The proposed method demonstrates average registration errors of 2.14 mm and 0.34 mm for rigid and nonrigid registration, and an average computation time of 0.51 s.

Analysis of potential time saving in brain arteriovenous malformation stereotactic radiosurgery planning using a new software platform

To evaluate the utility of integrating a 3D vessel tree co-registration software platform into the stereotactic radiosurgery (SRS) workflow and its time saving for brain arteriovenous malformation (bAVM) treatment in adults compared to the conventional stereotactic head frame workflow. Eight consecutive adult bAVM cases were selected and retrospectively reviewed. Total number of angiograms and SRS procedures were 8. The electronic medical records were analyzed by time stamps to determine the length of time for each component of the set-up, transport, and frame removal. Times were averaged and the start of sedation by anesthesia used as a surrogate for the start of the frame application process. Reductions in workflow times were then modeled assuming cerebral angiography as a separate procedure. There were 8 adult bAVM cases included. Six were female. All patients had a single treatment session. Average age was 51.5 years (Range: 36-71). All patients were treated under monitored anesthesia care. In 6 patients, the AVM was deeply located (basal ganglia, midbrain, brainstem); in 2 cases, the lesion was frontal. Spetzler-Martin grades were 4 (50%) Grade 2 and 4 (50%) Grade 3. The average prescription isodose volume (PIV) and 12 Gy volumes (V_12Gy) were 0.85 cc and 1.74 cc, respectively. The mean time from frame application to arrival in the angiography room was 111.5 minutes (range 40 to 171 min; median 107 min; SD 35.3 min); transport from angiography room to SRS was 47.5 minutes (range 15 to 107 min; median 36 min; SD 31.1 min), and frame removal after SRS was 20.5 minutes (range 10 to 47 min; median 16 min; SD 11.6 min). The average total additional time for the entire process of frame application, patient transportation, and frame removal was 132 minutes (range 87 to 181 min; median 127.5 min; SD 28.4 min). Therefore, assuming a non-frame based workflow and with angiography performed ahead of the actual radiosurgical treatment, the total time savings on the day of treatment was estimated at 132 minutes (range 87 to 181 min; median 127.5 min; SD 28.4 min). The ability to perform angiography, image fusion, and treatment planning for the actual day-of-delivery using 3-dimensional vessel tree co-registration could result in significant time savings over traditional workflow practices. Further experience with this system will evaluate its accuracy, reproducibility, and potential broader use in SRS workflow paradigms for the treatment of vascular pathologies. For bAVMs, the benefits of this time savings might allow for streamlined workflows on the day of SRS.

A new 2D-3D registration gold-standard dataset for the hip joint based on uncertainty modeling

Purpose

Estimation of the accuracy of 2D‐3D registration is paramount for a correct evaluation of its outcome in both research and clinical studies. Publicly available datasets with standardized evaluation methodology are necessary for validation and comparison of 2D‐3D registration techniques. Given the large use of 2D‐3D registration in biomechanics, we introduced the first gold standard validation dataset for computed tomography (CT)‐to‐x‐ray registration of the hip joint, based on fluoroscopic images with large rotation angles. As the ground truth computed with fiducial markers is affected by localization errors in the image datasets, we proposed a new methodology based on uncertainty propagation to estimate the accuracy of a gold standard dataset.

Methods

The gold standard dataset included a 3D CT scan of a female hip phantom and 19 2D fluoroscopic images acquired at different views and voltages. The ground truth transformations were estimated based on the corresponding pairs of extracted 2D and 3D fiducial locations. These were assumed to be corrupted by Gaussian noise, without any restrictions of isotropy. We devised the multiple projective points criterion (MPPC) that jointly optimizes the transformations and the noisy 3D fiducial locations for all views. The accuracy of the transformations obtained with the MPPC was assessed in both synthetic and real experiments using different formulations of the target registration error (TRE), including a novel formulation of the TRE (uTRE) derived from the uncertainty analysis of the MPPC.

Results

The proposed MPPC method was statistically more accurate compared to the validation methods for 2D‐3D registration that did not optimize the 3D fiducial positions or wrongly assumed the isotropy of the noise. The reported results were comparable to previous published works of gold standard datasets. However, a formulation of the TRE commonly found in these gold standard datasets was found to significantly miscalculate the true TRE computed in synthetic experiments with known ground truths. In contrast, the uncertainty‐based uTRE was statistically closer to the true TRE.

Conclusions

We proposed a new gold standard dataset for the validation of CT‐to‐X‐ray registration of the hip joint. The gold standard transformations were derived from a novel method modeling the uncertainty in extracted 2D and 3D fiducials. Results showed that considering possible noise anisotropy and including corrupted 3D fiducials in the optimization resulted in improved accuracy of the gold standard. A new uncertainty‐based formulation of the TRE also appeared as a good alternative to the unknown true TRE that has been replaced in previous works by an alternative TRE not fully reflecting the gold standard accuracy.

3D-2D registration in endovascular image-guided surgery: evaluation of state-of-the-art methods on cerebral angiograms

PURPOSE

Image guidance for minimally invasive surgery is based on spatial co-registration and fusion of 3D pre-interventional images and treatment plans with the 2D live intra-interventional images. The spatial co-registration or 3D-2D registration is the key enabling technology; however, the performance of state-of-the-art automated methods is rather unclear as they have not been assessed under the same test conditions. Herein we perform a quantitative and comparative evaluation of ten state-of-the-art methods for 3D-2D registration on a public dataset of clinical angiograms.

METHODS

Image database consisted of 3D and 2D angiograms of 25 patients undergoing treatment for cerebral aneurysms or arteriovenous malformations. On each of the datasets, highly accurate "gold-standard" registrations of 3D and 2D images were established based on patient-attached fiducial markers. The database was used to rigorously evaluate ten state-of-the-art 3D-2D registration methods, namely two intensity-, two gradient-, three feature-based and three hybrid methods, both for registration of 3D pre-interventional image to monoplane or biplane 2D images.

RESULTS

Intensity-based methods were most accurate in all tests (0.3 mm). One of the hybrid methods was most robust with 98.75% of successful registrations (SR) and capture range of 18 mm for registrations of 3D to biplane 2D angiograms. In general, registration accuracy was similar whether registration of 3D image was performed onto mono- or biplanar 2D images; however, the SR was substantially lower in case of 3D to monoplane 2D registration. Two feature-based and two hybrid methods had clinically feasible execution times in the order of a second.

CONCLUSIONS

Performance of methods seems to fall below expectations in terms of robustness in case of registration of 3D to monoplane 2D images, while translation into clinical image guidance systems seems readily feasible for methods that perform registration of the 3D pre-interventional image onto biplanar intra-interventional 2D images.

Dynamic 2-D/3-D Rigid Registration Framework Using Point-To-Plane Correspondence Model

In image-guided interventional procedures, live 2-D X-ray images can be augmented with preoperative 3-D computed tomography or MRI images to provide planning landmarks and enhanced spatial perception. An accurate alignment between the 3-D and 2-D images is a prerequisite for fusion applications. This paper presents a dynamic rigid 2-D/3-D registration framework, which measures the local 3-D-to-2-D misalignment and efficiently constrains the update of both planar and non-planar 3-D rigid transformations using a novel point-to-plane correspondence model. In the simulation evaluation, the proposed method achieved a mean 3-D accuracy of 0.07 mm for the head phantom and 0.05 mm for the thorax phantom using single-view X-ray images. In the evaluation on dynamic motion compensation, our method significantly increases the accuracy comparing with the baseline method. The proposed method is also evaluated on a publicly-available clinical angiogram data set with "gold-standard" registrations. The proposed method achieved a mean 3-D accuracy below 0.8 mm and a mean 2-D accuracy below 0.3 mm using single-view X-ray images. It outperformed the state-of-the-art methods in both accuracy and robustness in single-view registration. The proposed method is intuitive, generic, and suitable for both initial and dynamic registration scenarios.