Improving target registration accuracy in image-guided neurosurgery by optimizing the distribution of fiducial points

Review of robotic systems for thoracoabdominal puncture interventional surgery

Cancer, with high morbidity and high mortality, is one of the major burdens threatening human health globally. Intervention procedures via percutaneous puncture have been widely used by physicians due to its minimally invasive surgical approach. However, traditional manual puncture intervention depends on personal experience and faces challenges in terms of precisely puncture, learning-curve, safety and efficacy. The development of puncture interventional surgery robotic (PISR) systems could alleviate the aforementioned problems to a certain extent. This paper attempts to review the current status and prospective of PISR systems for thoracic and abdominal application. In this review, the key technologies related to the robotics, including spatial registration, positioning navigation, puncture guidance feedback, respiratory motion compensation, and motion control, are discussed in detail.

Optimization Model for the Distribution of Fiducial Markers in Liver Intervention

The distribution of fiducial markers is one of the main factors affected the accuracy of optical navigation system. However, many studies have been focused on improving the fiducial registration accuracy or the target registration accuracy, but few solutions involve optimization model for the distribution of fiducial markers. In this paper, we propose an optimization model for the distribution of fiducial markers to improve the optical navigation accuracy. The strategy of optimization model is reducing the distribution from three dimensional to two dimensional to obtain the 2D optimal distribution by using optimization algorithm in terms of the marker number and the expectation equation of target registration error (TRE), and then extend the 2D optimal distribution in two dimensional to three dimensional to calculate the optimal distribution according to the distance parameter and the expectation equation of TRE. The results of the experiments show that the averaged TRE for the human phantom is approximately 1.00 mm by applying the proposed optimization model, and the averaged TRE for the abdominal phantom is 0.59 mm. The experimental results of liver simulator model and ex-vivo porcine liver model show that the proposed optimization model can be effectively applied in liver intervention.

How does adding anatomical landmarks as fiducial points in the point-matching registration of neuronavigation influence registration accuracy?

Skin markers (SMs) are usually used as fiducial points in registration of neuronavigation, but the areas in which they can be adhered to are restricted, which usually results in poor distribution of the SMs and a large registration error. In this research, we studied whether the registration accuracy can be improved by adding anatomical landmarks (ALs), which are thought to have a larger localization error than SMs. A series of random SM configurations were generated, and for each SM configuration, we generated a corresponding SM-AL configuration by adding several ALs. We then compared the accuracy of the point-matching registration of the SM configurations with that of the corresponding SM-AL configurations. Experiment results indicated that adding ALs always made the mean target registration error of the whole head fall into a lower and narrower range, which meant that the registration became more accurate and more stable. In addition, adding more ALs resulted in a better performance.

Orientation Uncertainty Characteristics of Some Pose Measuring Systems

We investigate the performance of pose measuring systems which determine an object's pose from measurement of a few fiducial markers attached to the object. Such systems use point-based, rigid body registration to get the orientation matrix. Uncertainty in the fiducials' measurement propagates to the uncertainty of the orientation matrix. This orientation uncertainty then propagates to points on the object's surface. This propagation is anisotropic, and the direction along which the uncertainty is the smallest is determined by the eigenvector associated with the largest eigenvalue of the orientation data's covariance matrix. This eigenvector in the coordinate frame defined by the fiducials remains almost fixed for any rotation of the object. However, the remaining two eigenvectors vary widely and the direction along which the propagated uncertainty is the largest cannot be determined from the object's pose. Conditions that result in such a behavior and practical consequences of it are presented.

A Surface-Based Spatial Registration Method Based on Sense Three-Dimensional Scanner

OBJECTIVE

The purpose of this study was to investigate the feasibility of a surface-based registration method based on a low-cost, hand-held Sense three-dimensional (3D) scanner in image-guided neurosurgery system.

METHODS

The scanner was calibrated prior and fixed on a tripod before registration. During registration, a part of the head surface was scanned at first and the spatial position of the adapter was recorded. Then the scanner was taken off from the tripod and the entire head surface was scanned by moving the scanner around the patient's head. All the scan points were aligned to the recorded spatial position to form a unique point cloud of the head by the automatic mosaic function of the scanner. The coordinates of the scan points were transformed from the device space to the adapter space by a calibration matrix, and then to the patient space. A 2-step patient-to-image registration method was then performed to register the patient space to the image space.

RESULTS

The experimental results showed that the mean target registration error of 15 targets on the surface of the phantom was 1.61±0.09 mm. In a clinical experiment, the mean target registration error of 7 targets on the patient's head surface was 2.50±0.31 mm, which was sufficient to meet clinical requirements.

CONCLUSIONS

It is feasible to use the Sense 3D scanner for patient-to-image registration, and the low-cost Sense 3D scanner can take the place of the current used scanner in the image-guided neurosurgery system.

Selection of Fiducial Locations and Performance Metrics for Point-Based Rigid-Body Registration

A method is described to select the location and number of fiducials used in point-based, rigid-body registration of two coordinate frames. Two indices are introduced which are used to search for the optimum configuration of fiducials. They can be used to quickly evaluate a large number of configurations because no actual registration is involved in their calculation. Furthermore, configurations yielding small values of the indices correlate well with configurations which result in optimum registrations. Three registration performance metrics are discussed, and it is shown that optimization of different metrics leads to different selection of fiducial configurations. If an optimized configuration is selected as a starting configuration of N fiducials, the addition of extra fiducials does not significantly improve the registration in most cases. This work is based on 3D data acquired with three different instruments, each having different noise and bias characteristics.

Recent advances in surgical planning & navigation for tumor biopsy and resection

This paper highlights recent advancements in imaging technologies for surgical planning and navigation in tumor biopsy and resection which need high-precision in detection and characterization of lesion margin in preoperative planning and intraoperative navigation. Multimodality image-guided surgery platforms brought great benefits in surgical planning and operation accuracy via registration of various data sets with information on morphology [X-ray, magnetic resonance (MR), computed tomography (CT)], function connectivity [functional magnetic resonance imaging (fMRI), diffusion tensor imaging (DTI), rest-status fMRI], or molecular activity [positron emission tomography (PET)]. These image-guided platforms provide a correspondence between the pre-operative surgical planning and intra-operative procedure. We envisage that the combination of advanced multimodal imaging, three-dimensional (3D) printing, and cloud computing will play increasingly important roles in planning and navigation of surgery for tumor biopsy and resection in the coming years.

A new markerless patient-to-image registration method using a portable 3D scanner

PURPOSE

Patient-to-image registration is critical to providing surgeons with reliable guidance information in the application of image-guided neurosurgery systems. The conventional point-matching registration method, which is based on skin markers, requires expensive and time-consuming logistic support. Surface-matching registration with facial surface scans is an alternative method, but the registration accuracy is unstable and the error in the more posterior parts of the head is usually large because the scan range is limited. This study proposes a new surface-matching method using a portable 3D scanner to acquire a point cloud of the entire head to perform the patient-to-image registration.

METHODS

A new method for transforming the scan points from the device space into the patient space without calibration and tracking was developed. Five positioning targets were attached on a reference star, and their coordinates in the patient space were measured prior. During registration, the authors moved the scanner around the head to scan its entire surface as well as the positioning targets, and the scanner generated a unique point cloud in the device space. The coordinates of the positioning targets in the device space were automatically detected by the scanner, and a spatial transformation from the device space to the patient space could be calculated by registering them to their coordinates in the patient space that had been measured prior. A three-step registration algorithm was then used to register the patient space to the image space. The authors evaluated their method on a rigid head phantom and an elastic head phantom to verify its practicality and to calculate the target registration error (TRE) in different regions of the head phantoms. The authors also conducted an experiment with a real patient's data to test the feasibility of their method in the clinical environment.

RESULTS

In the phantom experiments, the mean fiducial registration error between the device space and the patient space, the mean surface registration error, and the mean TRE of 15 targets on the surface of each phantom were 0.34 ± 0.01 mm and 0.33 ± 0.02 mm, 1.17 ± 0.02 mm and 1.34 ± 0.10 mm, and 1.06 ± 0.11 mm and 1.48 ± 0.21 mm, respectively. When grouping the targets according to their positions on the head, high accuracy was achieved in all parts of the head, and the TREs were similar across different regions. The authors compared their method with the current surface registration methods that use only a part of the facial surface on the elastic phantom, and the mean TRE of 15 targets was 1.48 ± 0.21 mm and 1.98 ± 0.53 mm, respectively. In a clinical experiment, the mean TRE of seven targets on the patient's head surface was 1.92 ± 0.18 mm, which was sufficient to meet clinical requirements.

CONCLUSIONS

The proposed surface-matching registration method provides sufficient registration accuracy even in the posterior area of the head. The 3D point cloud of the entire head, including the facial surface and the back of the head, can be easily acquired using a portable 3D scanner. The scanner does not need to be calibrated prior or tracked by the optical tracking system during scanning.

Anatomical landmarks for point-matching registration in image-guided neurosurgery

BACKGROUND

Accurate patient to image registration is the core for successful image-guided neurosurgery. While skin adhesive markers (SMs) are widely used in point-matching registration, a proper implementation of anatomical landmarks (ALs) may overcome the inconvenience brought by the use of SMs.

METHODS

Using nine ALs, a set of three configurations of different combinations of them is proposed. These configurations are defined according to the required positioning of the patient's head during surgery and the resulting distribution of the expected target registration error (TRE). These configurations were first evaluated by simulation experiment using the data of 20 patients from two hospitals, and then testing the applicability of them in eight real clinical surgeries of neuronavigation.

RESULTS

The results of the simulation experiment showed that, by incorporating a fiducial registration error (FRE) of 3.5 mm measured in the clinical setting, the expected TRE in the whole skull was less than 2.5 mm, and the expected TRE in the whole brain was less than 1.75 mm when using all the nine ALs. A small TRE could also be achieved in the corresponding surgical field by using the other three configurations with less ALs. In the clinical experiment, the FLE ranges in the image and the patient space were 1.4-3.6 mm and 1.6-5.5 mm, respectively. The measured TRE and FRE were 3.1 ± 0.75 mm and 3.5 ± 0.17 mm, respectively.

CONCLUSIONS

The AL configurations proposed in this investigation provide sufficient registration accuracy and can help to avoid the disadvantages of SMs if used clinically.

Fiducial optimization for minimal target registration error in image-guided neurosurgery

This paper presents new methods for the optimal selection of anatomical landmarks and optimal placement of fiducial markers in image-guided neurosurgery. These methods allow the surgeon to optimally plan fiducial marker locations on routine diagnostic images before preoperative imaging and to intraoperatively select the set of fiducial markers and anatomical landmarks that minimize the expected target registration error (TRE). The optimization relies on a novel empirical simulation-based TRE estimation method built on actual fiducial localization error (FLE) data. Our methods take the guesswork out of the registration process and can reduce localization error without additional imaging and hardware. Our clinical experiments on five patients who underwent brain surgery with a navigation system show that optimizing one marker location and the anatomical landmarks configuration reduced the TRE. The average TRE values using the usual fiducials setup and using the suggested method were 4.7 mm and 3.2 mm, respectively. We observed a maximum improvement of 4 mm. Reducing the target registration error has the potential to support safer and more accurate minimally invasive neurosurgical procedures.

Classification and Analysis of the Errors in Neuronavigation

There are many different types of errors in neuronavigation, and the reasons and results of these errors are complex. For a neurosurgeon using the neuronavigation system, it is important to have a clear understanding of when an error may occur, what the magnitude of it is, and how to avoid it or reduce its influence on the final application accuracy. In this article, we classify all the errors into 2 groups according to the working principle of neuronavigation systems. The first group contains the errors caused by the differences between the anatomic structures in the images and that of the real patient, and the second group contains the errors occurring in transforming the position of surgical tools from the patient space to the image space. Each group is further divided into 2 subgroups. We discuss 16 types of errors and classify each of them into one of the subgroups. The classification and analysis of these errors should help neurosurgeons understand the power and limits of neuronavigation systems and use them more properly.

Target and Trajectory Clinical Application Accuracy in Neuronavigation

BACKGROUND:

Catheter, needle, and electrode misplacement in navigated neurosurgery can result in ineffective treatment and severe complications.

OBJECTIVE:

To assess the Ommaya ventricular catheter localization accuracy both along the planned trajectory and at the target.

METHODS:

We measured the localization error along the ventricular catheter and on its tip for 15 consecutive patients who underwent insertion of the Ommaya catheter surgery with a commercial neuronavigation system. The preoperative computed tomography/magnetic resonance images and the planned trajectory were aligned with the postoperative computed tomography images showing the Ommaya catheter. The localization errors along the trajectory and at the target were then computed by comparing the preoperative planned trajectory with the actual postoperative catheter position. The measured localization errors were also compared with the error reported by the navigation system.

RESULTS:

The mean localization errors at the target and entry point locations were 5.9 ± 4.3 and 3.3 ± 1.9 mm, respectively. The mean shift and angle between planned and actual trajectories were 1.6 ± 1.9 mm and 3.9 ± 4.7°, respectively. The mean difference between the localization error at the target and entry point was 3.9 ± 3.7 mm. The mean difference between the target localization error and the reported navigation system error was 4.9 ± 4.8 mm.

CONCLUSION:

The catheter localization errors have significant variations at the target and along the insertion trajectory. Trajectory errors may differ significantly from the errors at the target. Moreover, the single registration error number reported by the navigation system does not appropriately reflect the trajectory and target errors and thus should be used with caution to assess the procedure risk.

Optimal Fiducial Configuration in Image-Guided Neurosurgery Using a Genetic Algorithm

Image-guided neurosurgery allows surgeons to navigate and localize lesion through the patient’s cranium with a 3D image guidance. The model of the head is reconstructed using preoperative computed tomography or magnetic resonance images and real and virtual spaces are aligned by means of fiducial markers placed on the patient. In this paper, a new method for the optimal placement of the fiducial markers in order to reduce misalignment is presented. Using routine diagnostic images, a customized 3D model of the patient’s cranium is reconstructed. A genetic algorithm calculates optimal positions of the marker in order to minimize the target registration error. The fiducial set is shown to the surgeons on the 3D model to help him/her in placement of them.

Distribution templates of the fiducial points in image-guided neurosurgery

BACKGROUND

Point-pair registration is widely used in an image-guided neurosurgery system. Poor distribution of the fiducial points leads to an increase in the target registration error (TRE).

OBJECTIVE

This study aimed to provide templates consisting of optimized positioning of the fiducial points to reduce the TRE in image-guided neurosurgery.

METHODS

We divided the head into 6 regions and provided distribution templates of the fiducial points for each of them. A variable termed TREM(r) was used to express the approximate expected square of the TRE at the target point with a specified distribution of fiducial points. We randomly selected 85 patients from 5 hospitals who underwent image-guided neurosurgery and compared the TREM(r) of the real fiducial points with that of the templates.

RESULTS

We grouped the patients by hospitals and regions. The mean TREM(r)s of the templates were much smaller than those of the real fiducial points. In each group, the range of the TREM(r) values of the templates was much smaller than that of the real fiducial points.

CONCLUSION

This study provides an easy method to implement a good distribution of the fiducial points to help reduce TRE in image-guided neurosurgery. The templates are simple and exact and can be easily integrated into current workflow.

Sulcal set optimization for cortical surface registration

Flat mapping based cortical surface registration constrained by manually traced sulcal curves has been widely used for inter subject comparisons of neuroanatomical data. Even for an experienced neuroanatomist, manual sulcal tracing can be quite time consuming, with the cost increasing with the number of sulcal curves used for registration. We present a method for estimation of an optimal subset of size N(C) from N possible candidate sulcal curves that minimizes a mean squared error metric over all combinations of N(C) curves. The resulting procedure allows us to estimate a subset with a reduced number of curves to be traced as part of the registration procedure leading to optimal use of manual labeling effort for registration. To minimize the error metric we analyze the correlation structure of the errors in the sulcal curves by modeling them as a multivariate Gaussian distribution. For a given subset of sulci used as constraints in surface registration, the proposed model estimates registration error based on the correlation structure of the sulcal errors. The optimal subset of constraint curves consists of the N(C) sulci that jointly minimize the estimated error variance for the subset of unconstrained curves conditioned on the N(C) constraint curves. The optimal subsets of sulci are presented and the estimated and actual registration errors for these subsets are computed.