Calibration of tracking systems in a surgical environment

How to objectively evaluate the impact of image-guided surgery technologies

PURPOSE

This manuscript aims to provide a better understanding of methods and techniques with which one can better quantify the impact of image-guided surgical technologies.

METHODS

A literature review was conducted with regard to economic and technical methods of medical device evaluation in various countries. Attention was focused on applications related to image-guided interventions that have enabled procedures to be performed in a minimally invasive manner, produced superior clinical outcomes, or have become standard of care.

RESULTS

The review provides examples of successful implementations and adoption of image-guided surgical techniques, mostly in the field of neurosurgery. Failures as well as newly developed technologies still undergoing cost-efficacy analysis are discussed.

CONCLUSION

The field of image-guided surgery has evolved from solely using preoperative images to utilizing highly specific tools and software to provide more information to the interventionalist in real time. While deformations in soft tissue often preclude the use of such instruments outside of neurosurgery, recent developments in optical and radioactive guidance have enabled surgeons to better account for organ motion and provide feedback to the surgeon as tissue is cut. These technologies are currently undergoing value assessments in many countries and hold promise to improve outcomes for patients, surgeons, care teams, payors, and society in general.

Specifying Inputs for the Computational Structure of a Surgical System via Optical Method and DLT Algorithm Based on In Vitro Experiments on Cardiovascular Tissue in Minimally Invasive and Robotic Surgery

With the application of four optical CMOS sensors, it was possible to capture the trajectory of an endoscopic tool during an in vitro surgical experiment on a cardiovascular preparation. This was due to the possibility of obtaining a path when a reflective marker was attached. In the work, APAS (Ariel Performance Analysis System) software and DLT (direct linear transformation) algorithm were used. This made it possible to acquire kinematic inputs to the computational model of dynamics, which enabled, regardless of the type of surgical robot structure, derivation of the analogous motion of an endoscopic effector due to the mathematical transformation of the trajectory to joints coordinates. Experiments were carried out with the participation of a practiced cardiac surgeon employing classic endoscopic instruments and robot surgical systems. The results indicated by the experiment showed that the inverse task of kinematics of position for the surgical robot with RCM (remote center of motion) structure was solved. The achieved results from the experiment were used as inputs for deriving a numerical dynamics model of surgical robot during transient states that was obtained by applying the finite element method and by driving dynamics moments acquired through the block diagrams method using a steering system with DC (direct current) motor and PID (proportional–integral–derivative) controller. The results section illustrates the course of kinematic values of endoscopic tools which were employed to apply numerical models as inputs, the course of the driving torque of the model of the surgical robot that enabled the selection of the drive system and the strength values, stresses and displacements according to von Mises hypothesis in its structure during the analysis of transient states that made it possible to establish the strength safety of the surgical robot. For the conducted experiments, the accuracy was ±2 [mm]. In the paper, the employment of optical CMOS sensors in surgical robotics and endoscopy is discussed. The paper concludes that the usage of optical sensors for determining inputs for numerical models of dynamics of surgical robots provides the basis for setting the course of physical quantities that appear in their real object structure, in manners close to reality.

Augmented Reality for Retrosigmoid Craniotomy Planning

While medical imaging data have traditionally been viewed on two-dimensional (2D) displays, augmented reality (AR) allows physicians to project the medical imaging data on patient's bodies to locate important anatomy. We present a surgical AR application to plan the retrosigmoid craniotomy, a standard approach to access the posterior fossa and the internal auditory canal. As a simple and accurate alternative to surface landmarks and conventional surgical navigation systems, our AR application augments the surgeon's vision to guide the optimal location of cortical bone removal. In this work, two surgeons performed a retrosigmoid approach 14 times on eight cadaver heads. In each case, the surgeon manually aligned a computed tomography (CT)-derived virtual rendering of the sigmoid sinus on the real cadaveric heads using a see-through AR display, allowing the surgeon to plan and perform the craniotomy accordingly. Postprocedure CT scans were acquired to assess the accuracy of the retrosigmoid craniotomies with respect to their intended location relative to the dural sinuses. The two surgeons had a mean margin of davg = 0.6 ± 4.7 mm and davg = 3.7 ± 2.3 mm between the osteotomy border and the dural sinuses over all their cases, respectively, and only positive margins for 12 of the 14 cases. The intended surgical approach to the internal auditory canal was successfully achieved in all cases using the proposed method, and the relatively small and consistent margins suggest that our system has the potential to be a valuable tool to facilitate planning a variety of similar skull-base procedures.

Motion estimation and correction in SPECT, PET and CT

Patient motion impacts single photon emission computed tomography (SPECT), positron emission tomography (PET) and X-ray computed tomography (CT) by giving rise to projection data inconsistencies that can manifest as reconstruction artifacts, thereby degrading image quality and compromising accurate image interpretation and quantification. Methods to estimate and correct for patient motion in SPECT, PET and CT have attracted considerable research effort over several decades. The aims of this effort have been two-fold: to estimate relevant motion fields characterizing the various forms of voluntary and involuntary motion; and to apply these motion fields within a modified reconstruction framework to obtain motion-corrected images. The aims of this review are to outline the motion problem in medical imaging and to critically review published methods for estimating and correcting for the relevant motion fields in clinical and preclinical SPECT, PET and CT. Despite many similarities in how motion is handled between these modalities, utility and applications vary based on differences in temporal and spatial resolution. Technical feasibility has been demonstrated in each modality for both rigid and non-rigid motion, but clinical feasibility remains an important target. There is considerable scope for further developments in motion estimation and correction, and particularly in data-driven methods that will aid clinical utility. State-of-the-art machine learning methods may have a unique role to play in this context.

CT-based Navigation System Using a Patient-Specific Instrument for Femoral Component Positioning: An Experimental in vitro Study with a Sawbone Model

PURPOSE

The intraoperative version of the femoral component is usually determined by visual appraisal of the stem position relative to the distal femoral condylar axis. However, several studies have suggested that a surgeon's visual assessment of the stem position has a high probability of misinterpretation. We developed a computed tomography (CT)-based navigation system with a patient-specific instrument (PSI) capable of three-dimensional (3D) printing and investigated its accuracy and consistency in comparison to the conventional technique of visual assessment of the stem position.

MATERIALS AND METHODS

A CT scan of a femur sawbone model was performed, and pre-experimental planning was completed. We conducted 30 femoral neck osteotomies using the conventional technique and another 30 femoral neck osteotomies using the proposed technique. The femoral medullary canals were identified in both groups using a box chisel.

RESULTS

For the absolute deviation between the measured and planned values, the mean two-dimensional anteversions of the proposed and conventional techniques were 1.41° and 4.78°, while their mean 3D anteversions were 1.15° and 3.31°. The mean θ₁, θ₂, θ₃, and d, all of which are parameters for evaluating femoral neck osteotomy, were 2.93°, 1.96°, 5.29°, and 0.48 mm for the proposed technique and 4.26°, 3.17°, 4.43°, and 3.15 mm for the conventional technique, respectively.

CONCLUSION

The CT-based navigation system with PSI was more accurate and consistent than the conventional technique for assessment of stem position. Therefore, it can be used to reduce the frequency of incorrect assessments of the stem position among surgeons and to help with accurate determination of stem anteversion.

Kalman filter-based EM-optical sensor fusion for needle deflection estimation

PURPOSE

In many clinical procedures such as cryoablation that involves needle insertion, accurate placement of the needle's tip at the desired target is the major issue for optimizing the treatment and minimizing damage to the neighboring anatomy. However, due to the interaction force between the needle and tissue, considerable error in intraoperative tracking of the needle tip can be observed as needle deflects.

METHODS

In this paper, measurements data from an optical sensor at the needle base and a magnetic resonance (MR) gradient field-driven electromagnetic (EM) sensor placed 10 cm from the needle tip are used within a model-integrated Kalman filter-based sensor fusion scheme. Bending model-based estimations and EM-based direct estimation are used as the measurement vectors in the Kalman filter, thus establishing an online estimation approach.

RESULTS

Static tip bending experiments show that the fusion method can reduce the mean error of the tip position estimation from 29.23 mm of the optical sensor-based approach to 3.15 mm of the fusion-based approach and from 39.96 to 6.90 mm, at the MRI isocenter and the MRI entrance, respectively.

CONCLUSION

This work established a novel sensor fusion scheme that incorporates model information, which enables real-time tracking of needle deflection with MRI compatibility, in a free-hand operating setup.

Real-time probe tracking using EM-optical sensor for MRI-guided cryoablation

BACKGROUND

A method of real-time, accurate probe tracking at the entrance of the MRI bore is developed, which, fused with pre-procedural MR images, will enable clinicians to perform cryoablation efficiently in a large workspace with image guidance.

METHODS

Electromagnetic (EM) tracking coupled with optical tracking is used to track the probe. EM tracking is achieved with an MRI-safe EM sensor working under the scanner's magnetic field to compensate the line-of-sight issue of optical tracking. Unscented Kalman filter-based probe tracking is developed to smooth the EM sensor measurements when occlusion occurs and to improve the tracking accuracy by fusing the measurements of two sensors.

RESULTS

Experiments with a spine phantom show that the mean targeting errors using the EM sensor alone and using the proposed method are 2.21 mm and 1.80 mm, respectively.

CONCLUSION

The proposed method achieves more accurate probe tracking than using an EM sensor alone at the MRI scanner entrance.

In vivo comparison of two navigation systems for abdominal percutaneous needle intervention

PURPOSE

To compare the accuracy of a Kinect-Optical navigation system with an electromagnetic (EM) navigation system for percutaneous liver needle intervention.

MATERIALS AND METHODS

Five beagles with nine artificial tumors were used for validation. The Veran IG4 EM navigation system and a custom-made Kinect-Optical navigation system were used. Needle insertions into each tumor were conducted with these two guidance methods. The target positioning error (TPE) and the time cost of the puncture procedures were evaluated.

RESULTS

A total of 18 needle insertions were performed to evaluate the navigation accuracy of the two guidance approaches. The targeting error was 6.78 ± 3.22 mm and 8.72 ± 3.5 mm for the Kinect-Optical navigation system and the EM navigation system, respectively. There is no statistically significant difference in the TPE between the Kinect-Optical navigation system and the EM navigation system (p = 0.229). The processing time with the Kinect-Optical system (10 min) is similar to that of the Veran IG4 system (12 min).

CONCLUSIONS

The accuracy of the Kinect-Optical navigation system is comparable to that of the EM navigation system.

Simultaneous Electromagnetic Tracking and Calibration for Dynamic Field Distortion Compensation

Electromagnetic (EM) tracking systems are highly susceptible to field distortion. The interference can cause measurement errors up to a few centimeters in clinical environments, which limits the reliability of these systems. Unless corrected for, this measurement error imperils the success of clinical procedures. It is therefore fundamental to dynamically calibrate EM tracking systems and compensate for measurement error caused by field distorting objects commonly present in clinical environments. We propose to combine a motion model with observations of redundant EM sensors and compensate for field distortions in real time. We employ a simultaneous localization and mapping technique to accurately estimate the pose of the tracked instrument while creating the field distortion map. We conducted experiments with six degrees-of-freedom motions in the presence of field distorting objects in research and clinical environments. We applied our approach to improve the EM tracking accuracy and compared our results to a conventional sensor fusion technique. Using our approach, the maximum tracking error was reduced by 67% for position measurements and by 64% for orientation measurements. Currently, clinical applications of EM trackers are hampered by the adverse distortion effects. Our approach introduces a novel method for dynamic field distortion compensation, independent from preoperative calibrations or external tracking devices, and enables reliable EM navigation for potential applications.

A preliminary study on surgical navigation for epiduroscopic laser neural decompression

Epiduroscopic laser neural decompression is an emerging therapeutic modality to treat lumbar spine pathologies including chronic low back pain, spinal stenosis, and disk herniation via catheter insertion followed by laser ablation of the lesion. Despite the efficacy of epiduroscopic laser neural decompression, excessive radiation doses due to fluoroscopy during epiduroscopic laser neural decompression have limited its widespread application. To address the issue, we propose a surgical navigation system to assist in epiduroscopic laser neural decompression procedures using radiation-free image guidance. An electromagnetic tracking system was used as the basic modality to track the internal location of the surgical instrument with respect to the patient body. Patient-to-image registration was carried out using the point-based registration method to determine the transformation between the coordinate system of the patient and that of the medical images. We applied the proposed system in epiduroscopic laser neural decompression procedures to assess its effectiveness, and the outcomes confirmed its clinical feasibility. To the best of our knowledge, this is a report on the first surgical navigation applied for epiduroscopic laser neural decompression procedure.

Simultaneous localization and calibration for electromagnetic tracking systems

BACKGROUND

In clinical environments, field distortion can cause significant electromagnetic tracking errors. Therefore, dynamic calibration of electromagnetic tracking systems is essential to compensate for measurement errors.

METHODS

It is proposed to integrate the motion model of the tracked instrument with redundant EM sensor observations and to apply a simultaneous localization and mapping algorithm in order to accurately estimate the pose of the instrument and create a map of the field distortion in real-time. Experiments were conducted in the presence of ferromagnetic and electrically-conductive field distorting objects and results compared with those of a conventional sensor fusion approach.

RESULTS

The proposed method reduced the tracking error from 3.94±1.61 mm to 1.82±0.62 mm in the presence of steel, and from 0.31±0.22 mm to 0.11±0.14 mm in the presence of aluminum.

CONCLUSIONS

With reduced tracking error and independence from external tracking devices or pre-operative calibrations, the approach is promising for reliable EM navigation in various clinical procedures. Copyright © 2015 John Wiley & Sons, Ltd.

Robot-assisted ultrasound imaging: overview and development of a parallel telerobotic system

Ultrasound imaging is frequently used in medicine. The quality of ultrasound images is often dependent on the skill of the sonographer. Several researchers have proposed robotic systems to aid in ultrasound image acquisition. In this paper we first provide a short overview of robot-assisted ultrasound imaging (US). We categorize robot-assisted US imaging systems into three approaches: autonomous US imaging, teleoperated US imaging, and human-robot cooperation. For each approach several systems are introduced and briefly discussed. We then describe a compact six degree of freedom parallel mechanism telerobotic system for ultrasound imaging developed by our research team. The long-term goal of this work is to enable remote ultrasound scanning through teleoperation. This parallel mechanism allows for both translation and rotation of an ultrasound probe mounted on the top plate along with force control. Our experimental results confirmed good mechanical system performance with a positioning error of < 1 mm. Phantom experiments by a radiologist showed promising results with good image quality.

Electromagnetic tracking in medicine--a review of technology, validation, and applications

Object tracking is a key enabling technology in the context of computer-assisted medical interventions. Allowing the continuous localization of medical instruments and patient anatomy, it is a prerequisite for providing instrument guidance to subsurface anatomical structures. The only widely used technique that enables real-time tracking of small objects without line-of-sight restrictions is electromagnetic (EM) tracking. While EM tracking has been the subject of many research efforts, clinical applications have been slow to emerge. The aim of this review paper is therefore to provide insight into the future potential and limitations of EM tracking for medical use. We describe the basic working principles of EM tracking systems, list the main sources of error, and summarize the published studies on tracking accuracy, precision and robustness along with the corresponding validation protocols proposed. State-of-the-art approaches to error compensation are also reviewed in depth. Finally, an overview of the clinical applications addressed with EM tracking is given. Throughout the paper, we report not only on scientific progress, but also provide a review on commercial systems. Given the continuous debate on the applicability of EM tracking in medicine, this paper provides a timely overview of the state-of-the-art in the field.

A robot-assisted surgical system using a force-image control method for pedicle screw insertion

Objective

To introduce a robot-assisted surgical system for spinal posterior fixation that can automatically recognize the drilling state and stop potential cortical penetration with force and image information and to further evaluate the accuracy and safety of the robot for sheep vertebra pedicle screw placement.

Methods

The Robotic Spinal Surgery System (RSSS) was composed of an optical tracking system, a navigation and planning system, and a surgical robot equipped with a 6-DOF force/torque sensor. The robot used the image message and force signals to sense the different operation states and to prevent potential cortical penetration in the pedicle screw insertion operation. To evaluate the accuracy and safety of the RSSS, 32 screw insertions were conducted. Furthermore, six trajectories were deliberately planned incorrectly to explore whether the robot could recognize the different drilling states and immediately prevent cortical penetration.

Results

All 32 pedicle screws were placed in the pedicle without any broken pedicle walls. Compared with the preoperative planning, the average deviations of the entry points in the axial and sagittal views were 0.50±0.33 and 0.65±0.40 mm, and the average deviations of the angles in the axial and sagittal views were 1.9±0.82° and 1.48±1.2°. The robot successfully recognized the different drilling states and prevented potential cortical penetration. In the deliberately incorrectly planned trajectory experiments, the robot successfully prevented the cortical penetration.

Conclusion

These results verified the RSSS’s accuracy and safety, which supported its potential use for the spinal surgery.

Electromagnetic tracking system with reduced distortion using quadratic excitation

PURPOSE

Electromagnetic tracking systems, frequently used in minimally invasive surgery, are affected by conductive distorters. The influence of conductive distorters on electromagnetic tracking system accuracy can be reduced through magnetic field modifications. This approach was developed and tested.

METHODS

The voltage induced directly by the emitting coil in the sensing coil without additional influence by the conductive distorter depends on the first derivative of the voltage on the emitting coil. The voltage which is induced indirectly by the emitting coil across the conductive distorter in the sensing coil, however, depends on the second derivative of the voltage on the emitting coil. The electromagnetic tracking system takes advantage of this difference by supplying the emitting coil with a quadratic excitation voltage. The method is adaptive relative to the amount of distortion cause by the conductive distorters. This approach is evaluated with an experimental setup of the electromagnetic tracking system.

RESULTS

In vitro testing showed that the maximal error decreased from 10.9 to 3.8 mm when the quadratic voltage was used to excite the emitting coil instead of the sinusoidal voltage. Furthermore, the root mean square error in the proximity of the aluminum disk used as a conductive distorter was reduced from 3.5 to 1.6 mm when the electromagnetic tracking system used the quadratic instead of sinusoidal excitation.

CONCLUSIONS

Electromagnetic tracking with quadratic excitation is immune to the effects of a conductive distorter, especially compared with sinusoidal excitation of the emitting coil. Quadratic excitation of electromagnetic tracking for computer-assisted surgery is promising for clinical applications.

Electromagnetic servoing-a new tracking paradigm

Electromagnetic (EM) tracking is highly relevant for many computer assisted interventions. This is in particular due to the fact that the scientific community has not yet developed a general solution for tracking of flexible instruments within the human body. Electromagnetic tracking solutions are highly attractive for minimally invasive procedures, since they do not require line of sight. However, a major problem with EM tracking solutions is that they do not provide uniform accuracy throughout the tracking volume and the desired, highest accuracy is often only achieved close to the center of tracking volume. In this paper, we present a solution to the tracking problem, by mounting an EM field generator onto a robot arm. Proposing a new tracking paradigm, we take advantage of the electromagnetic tracking to detect the sensor within a specific sub-volume, with known and optimal accuracy. We then use the more accurate and robust robot positioning for obtaining uniform accuracy throughout the tracking volume. Such an EM servoing methodology guarantees optimal and uniform accuracy, by allowing us to always keep the tracked sensor close to the center of the tracking volume. In this paper, both dynamic accuracy and accuracy distribution within the tracking volume are evaluated using optical tracking as ground truth. In repeated evaluations, the proposed method was able to reduce the overall error from 6.64±7.86 mm to a significantly improved accuracy of 3.83±6.43 mm. In addition, the combined system provides a larger tracking volume, which is only limited by the reach of the robot and not the much smaller tracking volume defined by the magnetic field generator.

Technical accuracy of optical and the electromagnetic tracking systems

Thousands of operations are annually guided with computer assisted surgery (CAS) technologies. As the use of these devices is rapidly increasing, the reliability of the devices becomes ever more critical. The problem of accuracy assessment of the devices has thus become relevant. During the past five years, over 200 hazardous situations have been documented in the MAUDE database during operations using these devices in the field of neurosurgery alone. Had the accuracy of these devices been periodically assessed pre-operatively, many of them might have been prevented.

The technical accuracy of a commercial navigator enabling the use of both optical (OTS) and electromagnetic (EMTS) tracking systems was assessed in the hospital setting using accuracy assessment tools and methods developed by the authors of this paper. The technical accuracy was obtained by comparing the positions of the navigated tool tip with the phantom accuracy assessment points. Each assessment contained a total of 51 points and a region of surgical interest (ROSI) volume of 120x120x100 mm roughly mimicking the size of the human head.

The error analysis provided a comprehensive understanding of the trend of accuracy of the surgical navigator modalities. This study showed that the technical accuracies of OTS and EMTS over the pre-determined ROSI were nearly equal. However, the placement of the particular modality hardware needs to be optimized for the surgical procedure. New applications of EMTS, which does not require rigid immobilization of the surgical area, are suggested.

On mixed reality environments for minimally invasive therapy guidance: systems architecture, successes and challenges in their implementation from laboratory to clinic

Mixed reality environments for medical applications have been explored and developed over the past three decades in an effort to enhance the clinician's view of anatomy and facilitate the performance of minimally invasive procedures. These environments must faithfully represent the real surgical field and require seamless integration of pre- and intra-operative imaging, surgical instrument tracking, and display technology into a common framework centered around and registered to the patient. However, in spite of their reported benefits, few mixed reality environments have been successfully translated into clinical use. Several challenges that contribute to the difficulty in integrating such environments into clinical practice are presented here and discussed in terms of both technical and clinical limitations. This article should raise awareness among both developers and end-users toward facilitating a greater application of such environments in the surgical practice of the future.

Electromagnetic tracking for image-guided abdominal procedures: overall system and technical issues

This paper summarizes our work over the past several years in developing an image-guided system based on electromagnetic tracking for abdominal interventions. The paper begins with a review of computer-aided surgery and electromagnetic tracking. We next describe our image-guided system along with phantom and animal studies. We then present some technical issues in improving accuracy including pivot calibration, dynamic referencing, and registration using two 5 degree-of- freedom sensors. Electromagnetic tracking has great potential for assisting physicians in precision placement of instruments during minimally invasive interventions. However, the accuracy of these systems needs to be validated in the clinical environment and issues such as respiratory motion and organ deformation need to be addressed.

An image-based guidewire navigation method for robot-assisted intravascular interventions

This paper aims at using a newly developed robotic system to automatically deliver guidewires or catheters to the target site on percutaneous coronary interventions (PCIs) or electrophysiology interventions. An autonomous delivery strategy using electromagnetic tracking technology is introduced and phantom experiments are performed to validate this strategy. In order to advance the guidewire into the planned branch, the strategy classifies this branch selection problem into three cases according to the width of the vessels and employs an image-based algorithm for the first and second cases. Another image-based algorithm specifically designed for the third case is also presented.

Enabling freehand lateral scanning of optical coherence tomography needle probes with a magnetic tracking system

We present a high-resolution three-dimensional position tracking method that allows an optical coherence tomography (OCT) needle probe to be scanned laterally by hand, providing the high degree of flexibility and freedom required in clinical usage. The method is based on a magnetic tracking system, which is augmented by cross-correlation-based resampling and a two-stage moving window average algorithm to improve upon the tracker's limited intrinsic spatial resolution, achieving 18 µm RMS position accuracy. A proof-of-principle system was developed, with successful image reconstruction demonstrated on phantoms and on ex vivo human breast tissue validated against histology. This freehand scanning method could contribute toward clinical implementation of OCT needle imaging.

Integration of the OpenIGTLink network protocol for image-guided therapy with the medical platform MeVisLab

BACKGROUND

OpenIGTLink is a new, open, simple and extensible network communication protocol for image-guided therapy (IGT). The protocol provides a standardized mechanism to connect hardware and software by the transfer of coordinate transforms, images, and status messages. MeVisLab is a framework for the development of image processing algorithms and visualization and interaction methods, with a focus on medical imaging.

METHODS

The paper describes the integration of the OpenIGTLink network protocol for IGT with the medical prototyping platform MeVisLab. The integration of OpenIGTLink into MeVisLab has been realized by developing a software module using the C++ programming language.

RESULTS

The integration was evaluated with tracker clients that are available online. Furthermore, the integration was used to connect MeVisLab to Slicer and a NDI tracking system over the network. The latency time during navigation with a real instrument was measured to show that the integration can be used clinically.

CONCLUSIONS

Researchers using MeVisLab can interface their software to hardware devices that already support the OpenIGTLink protocol, such as the NDI Aurora magnetic tracking system. In addition, the OpenIGTLink module can also be used to communicate directly with Slicer, a free, open source software package for visualization and image analysis.

Accuracy considerations in image-guided cardiac interventions: experience and lessons learned

MOTIVATION

Medical imaging and its application in interventional guidance has revolutionized the development of minimally invasive surgical procedures leading to reduced patient trauma, fewer risks, and shorter recovery times. However, a frequently posed question with regard to an image guidance system is "how accurate is it?" On one hand, the accuracy challenge can be posed in terms of the tolerable clinical error associated with the procedure; on the other hand, accuracy is bound by the limitations of the system's components, including modeling, patient registration, and surgical instrument tracking, all of which ultimately impact the overall targeting capabilities of the system.

METHODS

While these processes are not unique to any interventional specialty, this paper discusses them in the context of two different cardiac image guidance platforms: a model-enhanced ultrasound platform for intracardiac interventions and a prototype system for advanced visualization in image-guided cardiac ablation therapy.

RESULTS

Pre-operative modeling techniques involving manual, semi-automatic and registration-based segmentation are discussed. The performance and limitations of clinically feasible approaches for patient registration evaluated both in the laboratory and in the operating room are presented. Our experience with two different magnetic tracking systems for instrument and ultrasound transducer localization is reported. Ultimately, the overall accuracy of the systems is discussed based on both in vitro and preliminary in vivo experience.

CONCLUSION

While clinical accuracy is specific to a particular patient and procedure and vastly dependent on the surgeon's experience, the system's engineering limitations are critical to determine whether the clinical requirements can be met.

Automatic registration between 3D intra-operative ultrasound and pre-operative CT images of the liver based on robust edge matching

The registration of a three-dimensional (3D) ultrasound (US) image with a computed tomography (CT) or magnetic resonance image is beneficial in various clinical applications such as diagnosis and image-guided intervention of the liver. However, conventional methods usually require a time-consuming and inconvenient manual process for pre-alignment, and the success of this process strongly depends on the proper selection of initial transformation parameters. In this paper, we present an automatic feature-based affine registration procedure of 3D intra-operative US and pre-operative CT images of the liver. In the registration procedure, we first segment vessel lumens and the liver surface from a 3D B-mode US image. We then automatically estimate an initial registration transformation by using the proposed edge matching algorithm. The algorithm finds the most likely correspondences between the vessel centerlines of both images in a non-iterative manner based on a modified Viterbi algorithm. Finally, the registration is iteratively refined on the basis of the global affine transformation by jointly using the vessel and liver surface information. The proposed registration algorithm is validated on synthesized datasets and 20 clinical datasets, through both qualitative and quantitative evaluations. Experimental results show that automatic registration can be successfully achieved between 3D B-mode US and CT images even with a large initial misalignment.

Position error reduction in a mechanical tracking linkage for arthroscopic hip surgery

PURPOSE

Position tracking is an important aspect of many computer-aided surgical techniques. Given the obstacles of current optical, electromagnetic, and mechanical systems for medical applications, this work investigates error reduction in a new mechanical tracking system developed for arthroscopic hip surgery. This new tracking linkage addresses the current contradictory requirements of a thin, small linkage for ease of surgical use and a large, bulky linkage for increased accuracy by using (1) kinematic redundancy and (2) data averaging and curve fitting.

METHOD

To reduce the position error in the proposed mechanical tracking linkage, four numerical techniques were applied to data from the linkage. Two averaging techniques and two curve fitting techniques were investigated. After implementing each numerical technique, error testing was performed to quantify improvement in performance.

RESULTS

While the simple average and moving average techniques lowered the error by over 30%, these two methods were undesirable for the overall system performance. The lowest error was measured by the linear curve prediction method. This technique measured 0.552 mm of error, roughly half of the error measured by the control case. The quadratic prediction method reduced the error by 35% and had the lowest standard deviation in the measurements.

CONCLUSION

The linear prediction technique was able to significantly lower the error measured by a kinematically redundant mechanical tracking linkage. While further testing is still necessary, this data suggests that a thin, small mechanical tracking linkage could achieve a high level of accuracy to be an appropriate choice for a surgical tracking application.

Magnetically guided 3-dimensional virtual neuronavigation for neuroendoscopic surgery: technique and clinical experience

OBJECTIVE

The authors have developed a novel intraoperative neuronavigation with 3-dimensional (3D) virtual images, a 3D virtual navigation system, for neuroendoscopic surgery. The present study describes this technique and clinical experience with the system.

METHODS

Preoperative imaging data sets were transferred to a personal computer to construct virtual endoscopic views with image segmentation software. An electromagnetic tracker was used to acquire the position and orientation of the tip of the neuroendo-scope. Virtual endoscopic images were interlinked to an electromagnetic tracking system and demonstrated on the navigation display in real time. Accuracy and efficacy of the 3D virtual navigation system were evaluated in a phantom test and on 5 consecutive patients undergoing neuroendoscopic surgery.

RESULTS

Virtual navigation views were consistent with actual endoscopic views and trajectory in both phantom testing and clinical neuroendoscopic surgery. Anatomic structures that can affect surgical approaches were adequately predicted with the virtual navigation system. The virtual semitransparent view contributed to a clear understanding of spatial relationships between surgical targets and surrounding structures. Surgical procedures in all patients were performed while confirming with virtual navigation. In neurosurgery with a flexible neuroscope, virtual navigation also demonstrated anatomic structures in real time.

CONCLUSION

The interactive method of intraoperative visualization influenced the decision-making process during surgery and provided useful assistance in identifying safe approaches for neuroendoscopic surgery. The magnetically guided navigation system enabled navigation of surgical targets in both rigid and flexible endoscopic surgeries.

Evaluation of model-enhanced ultrasound-assisted interventional guidance in a cardiac phantom

Minimizing invasiveness associated with cardiac procedures has led to limited visual access to the target tissues. To address these limitations, we have developed a visualization environment that integrates interventional ultrasound (US) imaging with preoperative anatomical models and virtual representations of the surgical instruments tracked in real time. In this paper, we present a comprehensive evaluation of our model-enhanced US-guidance environment by simulating clinically relevant interventions in vitro . We have demonstrated that model-enhanced US guidance provides a clinically desired targeting accuracy better than 3-mm rms and maintains this level of accuracy even in the case of image-to-patient misalignments that are often encountered in the clinic. These studies emphasize the benefits of integrating real-time imaging with preoperative data to enhance surgical navigation in the absence of direct vision during minimally invasive cardiac interventions.

Three-dimensional ultrasound imaging

This review is about the development of three-dimensional (3D) ultrasonic medical imaging, how it works, and where its future lies. It assumes knowledge of two-dimensional (2D) ultrasound, which is covered elsewhere in this issue. The three main ways in which 3D ultrasound may be acquired are described: the mechanically swept 3D probe, the 2D transducer array that can acquire intrinsically 3D data, and the freehand 3D ultrasound. This provides an appreciation of the constraints implicit in each of these approaches together with their strengths and weaknesses. Then some of the techniques that are used for processing the 3D data and the way this can lead to information of clinical value are discussed. A table is provided to show the range of clinical applications reported in the literature. Finally, the discussion relating to the technology and its clinical applications to explain why 3D ultrasound has been relatively slow to be adopted in routine clinics is drawn together and the issues that will govern its development in the future explored.

OpenIGTLink: an open network protocol for image-guided therapy environment

BACKGROUND

With increasing research on system integration for image-guided therapy (IGT), there has been a strong demand for standardized communication among devices and software to share data such as target positions, images and device status.

METHOD

We propose a new, open, simple and extensible network communication protocol for IGT, named OpenIGTLink, to transfer transform, image and status messages. We conducted performance tests and use-case evaluations in five clinical and engineering scenarios.

RESULTS

The protocol was able to transfer position data with submillisecond latency up to 1024 fps and images with latency of <10 ms at 32 fps. The use-case tests demonstrated that the protocol is feasible for integrating devices and software.

CONCLUSION

The protocol proved capable of handling data required in the IGT setting with sufficient time resolution and latency. The protocol not only improves the interoperability of devices and software but also promotes transitions of research prototypes to clinical applications.

How accurate is accurate enough? A brief overview on accuracy considerations in image-guided cardiac interventions

Image-guided interventions have revolutionized the development of minimally invasive surgical procedures, leading to reduced patient trauma, fewer risks and shorter recovery times. However, one of the most frequently posed question with regards to an image guidance system is how accurate it is. In this work we provide a brief overview on accuracy considerations from our perspective on cardiac image-guided procedures: what are the clinically-imposed accuracy constraints, how do these measure against the limitations of the image-guidance system, and how can surgeons directly benefit from real-time accuracy feedback to ensure optimal navigation at all times during the intervention?

Computer assistance for intraoperative navigation in ENT surgery

The intraoperative need for exact orientation during interventions in the paranasal sinuses and the augmented need for navigational aids in lateral skull base surgery have lead to the development of computer-aided tools during the last fifteen years. These tools, which provide the position of a tool or a pointer in the patient's preoperative radiologic imaging, have quickly gained a wide acceptance for revision surgeries and the surgical treatment of complex pathologies in Ear-, Nose- and Throat (ENT-) surgery. Currently, the use of such systems is spreading from academic centers to smaller hospitals and will become a standard tool in the near future. We review the present state of computer-aided surgery (CAS) systems, based on our experience as clinical and research centers with a long experience in the field, provide some technological background information and, based on selected cases, show the merits of this technology. The systems we have been working with cover a wide variety of intraoperative navigational systems in ENT surgery (Easy Guide, MedScan II, MKM, SNN, STN, SurgiGATE ORL, Treon, VectorVision, Viewing Wand, [without claiming completeness]), and virtually the whole area of ENT surgeries: macroscopic, (video-)endoscopic and microscopic procedures. The 3D tracking technologies involved cover mechanical, optical (active and passive), magnetic and robotic principles. The visualization tools used are computer monitors, video monitors, head-up-displays and the microscope's oculars, thus spanning the area from pointer-systems to real navigators and a surgical telepresence demonstrator, implementing the majority of available patient-to-image referencing strategies. Clinically, the systems can be operated with an acceptable accuracy of around 1 mm, whereas in laboratory settings and in cadaver studies application accuracy may be pushed to its limits: the physical resolution of the radiologic imaging used for navigation.

Magneto-optical tracking of flexible laparoscopic ultrasound: model-based online detection and correction of magnetic tracking errors

Electromagnetic tracking is currently one of the most promising means of localizing flexible endoscopic instruments such as flexible laparoscopic ultrasound transducers. However, electromagnetic tracking is also susceptible to interference from ferromagnetic material, which distorts the magnetic field and leads to tracking errors. This paper presents new methods for real-time online detection and reduction of dynamic electromagnetic tracking errors when localizing a flexible laparoscopic ultrasound transducer. We use a hybrid tracking setup to combine optical tracking of the transducer shaft and electromagnetic tracking of the flexible transducer tip. A novel approach of modeling the poses of the transducer tip in relation to the transducer shaft allows us to reliably detect and significantly reduce electromagnetic tracking errors. For detecting errors of more than 5 mm, we achieved a sensitivity and specificity of 91% and 93%, respectively. Initial 3-D rms error of 6.91 mm were reduced to 3.15 mm.

Augmented reality: a new tool to improve surgical accuracy during laparoscopic partial nephrectomy? Preliminary in vitro and in vivo results

BACKGROUND

Use of an augmented reality (AR)-based soft tissue navigation system in urologic laparoscopic surgery is an evolving technique.

OBJECTIVE

To evaluate a novel soft tissue navigation system developed to enhance the surgeon's perception and to provide decision-making guidance directly before initiation of kidney resection for laparoscopic partial nephrectomy (LPN).

DESIGN, SETTING, AND PARTICIPANTS

Custom-designed navigation aids, a mobile C-arm capable of cone-beam imaging, and a standard personal computer were used. The feasibility and reproducibility of inside-out tracking principles were evaluated in a porcine model with an artificially created intraparenchymal tumor in vitro. The same algorithm was then incorporated into clinical practice during LPN.

INTERVENTIONS

Evaluation of a fully automated inside-out tracking system was repeated in exactly the same way for 10 different porcine renal units. Additionally, 10 patients underwent retroperitoneal LPNs under manual AR guidance by one surgeon.

MEASUREMENTS

The navigation errors and image-acquisition times were determined in vitro. The mean operative time, time to locate the tumor, and positive surgical margin were assessed in vivo.

RESULTS AND LIMITATIONS

The system was able to navigate and superpose the virtually created images and real-time images with an error margin of only 0.5 mm, and fully automated initial image acquisition took 40 ms. The mean operative time was 165 min (range: 135-195 min), and mean time to locate the tumor was 20 min (range: 13-27 min). None of the cases required conversion to open surgery. Definitive histology revealed tumor-free margins in all 10 cases.

CONCLUSIONS

This novel AR tracking system proved to be functional with a reasonable margin of error and image-to-image registration time. Mounting the pre- or intraoperative imaging properties on real-time videoendoscopic images in a real-time manner will simplify and increase the precision of laparoscopic procedures.

Hybrid attitude estimation for laparoscopic surgical tools: a preliminary study

Laparoscopic surgery poses a challenging problem for a real-time navigation system: how to keep tracking the surgical tools inside the human body intraoperatively. This paper proposes a sensor fusion method for a hybrid tracking system that incorporates a miniature inertial measurement unit and an electromagnetic navigation system, in order to obtain continuous orientation information, even in the presence of metal objects. The sensor fusion algorithm employs an extended Kalman filter to integrate the data from the two sensor streams, based on a quaternion formulation of the system dynamics. The preliminary experimental results show that the integration of low-cost inertial measurement is able to compensate the distortion of EM tracking.

Intraoperative magnetic tracker calibration using a magneto-optic hybrid tracker for 3-D ultrasound-based navigation in laparoscopic surgery

This paper describes a ultrasound (3-D US) system that aims to achieve augmented reality (AR) visualization during laparoscopic surgery, especially for the liver. To acquire 3-D US data of the liver, the tip of a laparoscopic ultrasound probe is tracked inside the abdominal cavity using a magnetic tracker. The accuracy of magnetic trackers, however, is greatly affected by magnetic field distortion that results from the close proximity of metal objects and electronic equipment, which is usually unavoidable in the operating room. In this paper, we describe a calibration method for intraoperative magnetic distortion that can be applied to laparoscopic 3-D US data acquisition; we evaluate the accuracy and feasibility of the method by in vitro and in vivo experiments. Although calibration data can be acquired freehand using a magneto-optic hybrid tracker, there are two problems associated with this method--error caused by the time delay between measurements of the optical and magnetic trackers, and instability of the calibration accuracy that results from the uniformity and density of calibration data. A temporal calibration procedure is developed to estimate the time delay, which is then integrated into the calibration, and a distortion model is formulated by zeroth-degree to fourth-degree polynomial fitting to the calibration data. In the in vivo experiment using a pig, the positional error caused by magnetic distortion was reduced from 44.1 to 2.9 mm. The standard deviation of corrected target positions was less than 1.0 mm. Freehand acquisition of calibration data was performed smoothly using a magneto-optic hybrid sampling tool through a trocar under guidance by realtime 3-D monitoring of the tool trajectory; data acquisition time was less than 2 min. The present study suggests that our proposed method could correct for magnetic field distortion inside the patient's abdomen during a laparoscopic procedure within a clinically permissible period of time, as well as enabling an accurate 3-D US reconstruction to be obtained that can be superimposed onto live endoscopic images.

A new navigation system based on cephalograms and dental casts for oral and maxillofacial surgery

Intraoperative navigation systems help surgeons to accurately carry out preoperative plans without injuring anatomically important structures. A system is evaluated that uses cephalograms instead of computed tomographic (CT) scans to create images. Three-dimensional (3D) dental casts provide registration between imaging data and the patient. Cephalograms are widely employed in orthognathic and oral and maxillofacial surgery and expose patients to lower doses of radiation than CT. The system uses a dental cast to register the operation field to a pair of frontal and lateral cephalograms. The cast is transformed to 3D data with a laser scanner and a programme that runs on a personal computer. 3D data describing the dental cast, cephalograms and the oral and maxillofacial region of the patient are integrated with specialized software. The optical tracking system for navigation uses charged-coupled-device (CCD) video cameras and light-emitting diodes (LEDs). Two CCD video cameras follow the 3D coordinates of LED assemblies attached to the head, lower jaw and a handpiece. Errors occurring when a dental cast was transformed to 3D data ranged from 0.08 to 0.21 mm. Mean errors were 0.71 mm (0.21-1.09 mm) for the right maxillary central incisor, 0.62 mm (0.04-1.69 mm) for the right maxillary 2nd molar and 1.02 mm (0.23-1.47 mm) for the left maxillary 2nd molar. This surgical navigation system is sufficiently accurate for use in oral and maxillofacial surgery.