Rigid-body point-based registration: The distribution of the target registration error when the fiducial registration errors are given

Design and implementation of a surgical planning system for robotic assisted mandible reconstruction with fibula free flap

PURPOSE

Free fibula flap is the gold standard for the treatment of mandibular defects. However, the existing preoperative planning protocol is cumbersome to execute, costly to learn, and poorly collaborative with the robot-assisted cutting of the fibular osteotomy plane.

METHODS

A surgical planning system for robotic assisted mandibular reconstruction with fibula free flap is proposed in this study. A fibular osteotomy planning algorithm is presented so that the virtual surgical planning of the fibular osteotomy segments can be obtained automatically with selected mandibular anatomical landmarks. The planned osteotomy planes are then converted into the motion path of the robotic arm, and the automatic fibula osteotomy is completed under optical navigation.

RESULTS

Surgical planning was performed on 35 patients to verify the feasibility of our system's virtual surgical planning module, with an average time of 13 min. Phantom experiments were performed to evaluate the reliability and stability of this system. The average distance and angular deviations of the osteotomy planes are 1.04 ± 0.68 mm and 1.56 ±1.10°, respectively.

CONCLUSIONS

Our system can achieve not only precise and convenient preoperative planning, but also safe and reliable osteotomy trajectory. The clinical applications of our system for mandibular reconstruction surgery are expected soon.

Utility of optical see-through head mounted displays in augmented reality-assisted surgery: A systematic review

This article presents a systematic review of optical see-through head mounted display (OST-HMD) usage in augmented reality (AR) surgery applications from 2013 to 2020. Articles were categorised by: OST-HMD device, surgical speciality, surgical application context, visualisation content, experimental design and evaluation, accuracy and human factors of human-computer interaction. 91 articles fulfilled all inclusion criteria. Some clear trends emerge. The Microsoft HoloLens increasingly dominates the field, with orthopaedic surgery being the most popular application (28.6%). By far the most common surgical context is surgical guidance (n=58) and segmented preoperative models dominate visualisation (n=40). Experiments mainly involve phantoms (n=43) or system setup (n=21), with patient case studies ranking third (n=19), reflecting the comparative infancy of the field. Experiments cover issues from registration to perception with very different accuracy results. Human factors emerge as significant to OST-HMD utility. Some factors are addressed by the systems proposed, such as attention shift away from the surgical site and mental mapping of 2D images to 3D patient anatomy. Other persistent human factors remain or are caused by OST-HMD solutions, including ease of use, comfort and spatial perception issues. The significant upward trend in published articles is clear, but such devices are not yet established in the operating room and clinical studies showing benefit are lacking. A focused effort addressing technical registration and perceptual factors in the lab coupled with design that incorporates human factors considerations to solve clear clinical problems should ensure that the significant current research efforts will succeed.

A novel dynamic electromagnetic tracking navigation system for distal locking of intramedullary nails

BACKGROUND

The accurate distal locking of intramedullary (IM) nails is a clinical challenge for surgeons. Although many navigation systems have been developed, a real-time guide method with free radiation exposure, better user convenience, and high cost performance has not been proposed.

METHODS

This paper aims to develop an electromagnetic navigation system named TianXuan-MDTS that provides surgeons with a proven surgical solution. And the registration method with external landmarks for IM nails and calibration algorithm for guiders were proposed. A puncture experiment, model experiments measured by 3D Slicer and cadaver experiments (2 cadaveric leg specimens and 6 drilling operations) are conducted to evaluate its performance and stability.

RESULTS

The registration deviations (TRE) is 1.05± 0.13 mm. In the puncture experiment, a success rate of 96% can be achieved in 45.94 s. TianXuan-MDTS were evaluated on 3 tibia model. The results demonstrated that all 9 screw holes were successfully prepared at a rate of 100% in 91.67 s. And the entry point, end point, and angular deviations were 1.60±0.20 mm, 1.47±0.18 mm, and 3.10±0.84°, respectively. Postoperative fluoroscopy in cadaver experiments showed that all drills were in the distal locking holes, with a success rate of 100% and the average time 143.17± 18.27 s.

CONCLUSIONS

The experimental results indicate that our system with novel registration and calibration methods could serve as a feasible and promising tool to assist surgeons during distal locking.

An electromagnetic tracking implantation navigation system in dentistry with virtual calibration

BACKGROUND

Dental implant placement navigation systems based on optical tracking have been widely used in clinics. However, electromagnetic (EM) navigation method that does not suffer from problems of hidden line-of-light has not yet been described.

METHODS

This work proposes an EM-guided navigation method named TianShu-ESNS with virtual calibration. Model (12 implants) and animal experiments (pig head: six implants) were conducted to evaluate its performance and stability.

RESULT

The mean virtual calibration error was 0.83 ± 0.20 mm. The mean deviations at the entry point, end point and angle in the phantom experiment of TianShu-ESNS were 1.23 ± 0.17 mm, 1.59 ± 0.20 mm and 1.83 ± 0.27°, respectively. In the animal experiment, the same deviations were 1.25 ± 0.07 mm, 1.57 ± 0.35 mm and 1.90 ± 0.60°, respectively.

CONCLUSIONS

The experimental results show that TianShu-ESNS with the virtual calibration method could serve as a promising tool to eliminate the line-of-light hidden problem and simplify operation procedure in dental implant placement.

Ultrasound 3D reconstruction of malignant masses in robotic-assisted partial nephrectomy using the PAF rail system: a comparison study

Purpose

In robotic-assisted partial nephrectomy (RAPN), the use of intraoperative ultrasound (IOUS) helps to localise and outline the tumours as well as the blood vessels within the kidney. The aim of this work is to evaluate the use of the pneumatically attachable flexible (PAF) rail system for US 3D reconstruction of malignant masses in RAPN. The PAF rail system is a novel device developed and previously presented by the authors to enable track-guided US scanning.

Methods

We present a comparison study between US 3D reconstruction of masses based on: the da Vinci Surgical System kinematics, single- and stereo-camera tracking of visual markers embedded on the probe. An US-realistic kidney phantom embedding a mass is used for testing. A new design for the US probe attachment to enhance the performance of the kinematic approach is presented. A feature extraction algorithm is proposed to detect the margins of the targeted mass in US images.

Results

To evaluate the performance of the investigated approaches the resulting 3D reconstructions have been compared to a CT scan of the phantom. The data collected indicates that single camera reconstruction outperformed the other approaches, reconstructing with a sub-millimetre accuracy the targeted mass.

Conclusions

This work demonstrates that the PAF rail system provides a reliable platform to enable accurate US 3D reconstruction of masses in RAPN procedures. The proposed system has also the potential to be employed in other surgical procedures such as hepatectomy or laparoscopic liver resection.

Automated fiducial marker detection and fiducial point localization in CT images for lung biopsy image-guided surgery systems

In the lung biopsy image-guided surgery systems, the fiducial markers are used for point-based registration of the patient space to the CT image space. Fiducial marker detection and fiducial point localization in CT images have great influence on the accuracy of registration and guidance. This study proposes a fiducial marker detection approach based on the features of marker image slice sequences and a fiducial point localization approach according to marker projection images, without depending on the priori-knowledge of the marker default parameters provided by the manufacturers. The accuracy of our method was validated based on a CT image dataset of 24 patients. The experimental results showed that all 144 markers of 24 patients were correctly detected, and the fiducial points were localized with the average error of 0.35 mm. In addition, the localization accuracy of the proposed method was improved by an average of 12.5% compared with the accuracy of the previous method using the marker default parameters provided by the manufacturers. Thus, the study demonstrated that the proposed detection and localization methods are accurate and robust, which is quite encouraging to meet the requirement of future clinical applications in the image guided lung biopsy and surgery systems.

Orientation Uncertainty Characteristics of Some Pose Measuring Systems

We investigate the performance of pose measuring systems which determine an object's pose from measurement of a few fiducial markers attached to the object. Such systems use point-based, rigid body registration to get the orientation matrix. Uncertainty in the fiducials' measurement propagates to the uncertainty of the orientation matrix. This orientation uncertainty then propagates to points on the object's surface. This propagation is anisotropic, and the direction along which the uncertainty is the smallest is determined by the eigenvector associated with the largest eigenvalue of the orientation data's covariance matrix. This eigenvector in the coordinate frame defined by the fiducials remains almost fixed for any rotation of the object. However, the remaining two eigenvectors vary widely and the direction along which the propagated uncertainty is the largest cannot be determined from the object's pose. Conditions that result in such a behavior and practical consequences of it are presented.

Estimation of surgical tool-tip tracking error distribution in coordinate reference frame involving pivot calibration uncertainty

Accurate understanding of surgical tool-tip tracking error is important for decision making in image-guided surgery. In this Letter, the authors present a novel method to estimate/model surgical tool-tip tracking error in which they take pivot calibration uncertainty into consideration. First, a new type of error that is referred to as total target registration error (TTRE) is formally defined in a single-rigid registration. Target localisation error (TLE) in two spaces to be registered is considered in proposed TTRE formulation. With first-order approximation in fiducial localisation error (FLE) or TLE magnitude, TTRE statistics (mean, covariance matrix and root-mean-square (RMS)) are then derived. Second, surgical tool-tip tracking error in optical tracking system (OTS) frame is formulated using TTRE when pivot calibration uncertainty is considered. Finally, TTRE statistics of tool-tip in OTS frame are then propagated relative to a coordinate reference frame (CRF) rigid-body. Monte Carlo simulations are conducted to validate the proposed error model. The percentage passing statistical tests that there is no difference between simulated and theoretical mean and covariance matrix of tool-tip tracking error in CRF space is more than 90% in all test cases. The RMS percentage difference between simulated and theoretical tool-tip tracking error in CRF space is within 5% in all test cases.

Selection of Fiducial Locations and Performance Metrics for Point-Based Rigid-Body Registration

A method is described to select the location and number of fiducials used in point-based, rigid-body registration of two coordinate frames. Two indices are introduced which are used to search for the optimum configuration of fiducials. They can be used to quickly evaluate a large number of configurations because no actual registration is involved in their calculation. Furthermore, configurations yielding small values of the indices correlate well with configurations which result in optimum registrations. Three registration performance metrics are discussed, and it is shown that optimization of different metrics leads to different selection of fiducial configurations. If an optimized configuration is selected as a starting configuration of N fiducials, the addition of extra fiducials does not significantly improve the registration in most cases. This work is based on 3D data acquired with three different instruments, each having different noise and bias characteristics.

Localizing ECoG electrodes on the cortical anatomy without post-implantation imaging

INTRODUCTION

Electrocorticographic (ECoG) grids are placed subdurally on the cortex in people undergoing cortical resection to delineate eloquent cortex. ECoG signals have high spatial and temporal resolution and thus can be valuable for neuroscientific research. The value of these data is highest when they can be related to the cortical anatomy. Existing methods that establish this relationship rely either on post-implantation imaging using computed tomography (CT), magnetic resonance imaging (MRI) or X-Rays, or on intra-operative photographs. For research purposes, it is desirable to localize ECoG electrodes on the brain anatomy even when post-operative imaging is not available or when intra-operative photographs do not readily identify anatomical landmarks.

METHODS

We developed a method to co-register ECoG electrodes to the underlying cortical anatomy using only a pre-operative MRI, a clinical neuronavigation device (such as BrainLab VectorVision), and fiducial markers. To validate our technique, we compared our results to data collected from six subjects who also had post-grid implantation imaging available. We compared the electrode coordinates obtained by our fiducial-based method to those obtained using existing methods, which are based on co-registering pre- and post-grid implantation images.

RESULTS

Our fiducial-based method agreed with the MRI-CT method to within an average of 8.24 mm (mean, median = 7.10 mm) across 6 subjects in 3 dimensions. It showed an average discrepancy of 2.7 mm when compared to the results of the intra-operative photograph method in a 2D coordinate system. As this method does not require post-operative imaging such as CTs, our technique should prove useful for research in intra-operative single-stage surgery scenarios. To demonstrate the use of our method, we applied our method during real-time mapping of eloquent cortex during a single-stage surgery. The results demonstrated that our method can be applied intra-operatively in the absence of post-operative imaging to acquire ECoG signals that can be valuable for neuroscientific investigations.

Bayesian characterization of uncertainty in intra-subject non-rigid registration

In settings where high-level inferences are made based on registered image data, the registration uncertainty can contain important information. In this article, we propose a Bayesian non-rigid registration framework where conventional dissimilarity and regularization energies can be included in the likelihood and the prior distribution on deformations respectively through the use of Boltzmann's distribution. The posterior distribution is characterized using Markov Chain Monte Carlo (MCMC) methods with the effect of the Boltzmann temperature hyper-parameters marginalized under broad uninformative hyper-prior distributions. The MCMC chain permits estimation of the most likely deformation as well as the associated uncertainty. On synthetic examples, we demonstrate the ability of the method to identify the maximum a posteriori estimate and the associated posterior uncertainty, and demonstrate that the posterior distribution can be non-Gaussian. Additionally, results from registering clinical data acquired during neurosurgery for resection of brain tumor are provided; we compare the method to single transformation results from a deterministic optimizer and introduce methods that summarize the high-dimensional uncertainty. At the site of resection, the registration uncertainty increases and the marginal distribution on deformations is shown to be multi-modal.

A method for registration of single photon emission computed tomography (SPECT) and computed tomography (CT) images for liver stereotactic radiotherapy (SRT)

PURPOSE

To describe a simple method of coregistration of nonanatomic liver SPECT and CT images acquired in separate sessions for three-dimensional (3D)-CRT planning utilizing dual radiolabeled and radiopaque body surface markers, and evaluate the accuracy of the registration on the patient surface.

METHODS

Ten patients treated for liver metastases or hepatocellular carcinoma with stereotactic body radiation therapy or 3D-CRT were selected for this study to evaluate the SPECT∕CT registration process. All patients were positioned in a custom-molded vacuum bag on the flat table top. Nine radiopaque markers were taped to the abdominal surface in three axial planes at the level of the liver. Following CT imaging, the nine radiopaque markers were then labeled with radioactive tags, each containing 10 μCi of (99m)Tc, and SPECT images were acquired. The metric used to evaluate the registration was the fiducial registration error (FRE), defined as the root mean square of the distance between pairs of homologous markers on the CT and SPECT images. The evaluation of the registration accuracy was performed in two steps: first the minimum number of markers necessary to obtain a robust registration was optimized; second the FRE was calculated on the remaining set of unused markers. Additionally, the deformation of the patient's abdominal surface between CT and SPECT acquisition sessions was evaluated using the distances between all possible unused marker pairs on the CT and SPECT images separately. The root mean square of the CT-to-SPECT difference between those distances was used to define the deformation index (DI). The registration method was evaluated on all ten patients in addition to an anthropomorphic phantom study.

RESULTS

The minimum number of markers above which the registration was not improved by more than 1 mm was 4. The FRE, calculated over the 5 remaining markers, was 6.1 mm for the patient population and 1.8 mm for the phantom study. The DI was 5.0 mm on average over all 10 patients and correlated well with the FRE. The DI was 1.6 mm for the phantom study, which represented the imaging systems' resolution and the ability to place the CT and SPECT markers at the exact same location.

CONCLUSIONS

It is feasible to use radiolabeled and radiopaque dual body surface markers for registration of SPECT and CT images acquired in separate sessions allowing conformal avoidance of SPECT-defined functional normal liver. Point-based rigid registration accuracy on the patient surface of 6.1 mm can be achieved using 4 dual body surface markers. The main contribution to the registration error is the deformation of the abdominal surface, arising from the inability to setup the patient in the exact same position at different times on two different imaging systems, and to properly account for breathing artifacts on the CT and SPECT images.

Accuracy validation for medical image registration algorithms: a review

Accuracy validation is essential to clinical application of medical image registration techniques. Registration validation remains a challenging problem in practice mainly due to lack of 'ground truth'.In this paper, an overview of current validation methods for medical image registration is presented with detailed discussion of their benefits and drawbacks.Special focus is on non-rigid registration validation. Promising solution is also discussed.