Comparison of calibration methods for spatial tracking of a 3-D ultrasound probe

Development and validation of a gel wax phantom to evaluate geometric accuracy and measurement of a hyperechoic target diameter in diagnostic ultrasound imaging

Diagnostic ultrasound (US) scanners are generally evaluated using proprietary quality assurance (QA) phantoms, but their prohibitively high cost may prevent organizations to perform the necessary tests. This study aimed to develop a low-cost gel wax phantom with targets to determine the lateral and axial resolution and diameter of a hyperechoic target in an US scanner. The acoustic property (AP) of gel wax, which includes the speed of sound (cus), acoustic impedance (Z), and attenuation coefficient (µ), were determined for multiple transducers operating at 2.25, 5, 10, 15, and 30 MHz. These results were compared to the AP of soft tissue. Two polytetrafluoroethylene (PTFE) rectangular frames with holes separated by 5, 10, and 20 mm were constructed. Nylon filaments and stainless-steel disc (SS disc) (diameter = 16.8 mm) were threaded through the frames and suitably placed in gel wax to obtain orthogonal targets in the phantom. The target dimensions obtained from computerized tomography (CT) and US images of the phantom were compared for phantom validation. The average cus=1431.4 m/s, mass density ρ = 0.87 g/cm3, Z = 1.24 MRayls, and µ ranged from 0.7 to 0.98 dB/cm/MHz for gel wax at 22 °C. The US image measurement exhibited a maximum error in determining the diameter of the SS disc, resulting in a value of 18 mm instead of its actual value of 16.8 mm. The phantom volume decreased by 1.8% in 62 weeks. The present phantom is affordable, stable, customizable, and can be used to evaluate diagnostic US scanners across multiple centers.

Development of A Multi-Modality Navigational Based Training System for Fetoscopic Surgical Therapy

Fetal surgery is regarded as a technically difficult and new field of research, requiring the use of fetoscopic and ultrasound (US) navigation to perform minimally invasive procedures within the amniotic cavity. The Surgical Apprenticeship Training model (SAT) centres around the subjective assessment of a surgical resident's cognitive competency and technical skills under proctorship using opportunity-based environments. The restrictiveness and rarity of fetal procedures limit the effectiveness of the SAT model, resulting in a slow learning curve (LC) and higher procedural complication rates. This paper aimed to investigate the use of optical tracking technology to construct a novel simulated training system and accompanying scoring assessment under the Proficiency-Based Training model (PBT), providing real-time positional feedback of surgical tools and a quantitative feedback assessment of a surgical resident's technical skills. Clinical Relevance- Clinical feedback deemed the system as valid and confirmed that this novel approach to surgical training will significantly benefit smaller clinics that lack opportunity-based environments. Clinical feedback also suggested that the training system could be adapted to provide access to complex surgical training across the world.

An Improved Sensing Method of a Robotic Ultrasound System for Real-Time Force and Angle Calibration

An ultrasonic examination is a clinically universal and safe examination method, and with the development of telemedicine and precision medicine, the robotic ultrasound system (RUS) integrated with a robotic arm and ultrasound imaging system receives increasing attention. As the RUS requires precision and reproducibility, it is important to monitor the real-time calibration of the RUS during examination, especially the angle of the probe for image detection and its force on the surface. Additionally, to speed up the integration of the RUS and the current medical ultrasound system (US), the current RUSs mostly use a self-designed fixture to connect the probe to the arm. If the fixture has inconsistencies, it may cause an operating error. In order to improve its resilience, this study proposed an improved sensing method for real-time force and angle calibration. Based on multichannel pressure sensors, an inertial measurement unit (IMU), and a novel sensing structure, the ultrasonic probe and robotic arm could be simply and rapidly combined, which rendered real-time force and angle calibration at a low cost. The experimental results show that the average success rate of the downforce position identification achieved was 88.2%. The phantom experiment indicated that the method could assist the RUS in the real-time calibration of both force and angle during an examination.

Compact and Wireless Freehand 3D Ultrasound Real-time Spine Imaging System: A pilot study

The 3D ultrasound reconstruction technology has led to a rapid development of ultrasound spine imaging in recent decades. However, the current imaging apparatus is bulky and not portable. The objective of this study is to develop a new compact and wireless system to offer the real-time visualized spine images during data acquisition. A portable and WI-FI based ultrasound scanner and a compact EM tracking system were assembled to acquire ultrasound transverse frames with location information which could be reconstructed into 3D spine image volume in real-time. The validation was implemented on the 2D coronal images of vertebra phantoms, and the in vivo data acquisition and reconstruction were demonstrated on volunteers. The result showed that the new system could provide reconstructed spine images in real time and the average errors of the reconstructed images were about 1mm (approximate to image pixel size).

Fast And Simple Automatic 3D Ultrasound Probe Calibration Based On 3D Printed Phantom And An Untracked Marker

Tracking the pose of an ultrasound (US) probe is essential for an intraoperative US-based navigation system. The tracking requires mounting a marker on the US probe and calibrating the probe. The goal of the US probe calibration is to determine the rigid transformation between the coordinate system (CS) of the image and the CS of the marker mounted on the probe. We present a fast and automatic calibration method based on a 3D printed phantom and an untracked marker for three-dimensional (3D) US probe calibration. To simplify the conventional calibration procedures using and tracking at least two markers, we used only one marker and did not track it in the whole calibration process. Our automatic calibration method is fast, simple and does not require any experience from the user. The performance of our calibration method was evaluated by point reconstruction tests. The root mean square (RMS) of the point reconstruction errors was 1.39 mm.

Freehand 3-D Ultrasound Imaging: A Systematic Review

Two-dimensional ultrasound (US) imaging has been successfully used in clinical applications as a low-cost, portable and non-invasive image modality for more than three decades. Recent advances in computer science and technology illustrate the promise of the 3-D US modality as a medical imaging technique that is comparable to other prevalent modalities and that overcomes certain drawbacks of 2-D US. This systematic review covers freehand 3-D US imaging between 1970 and 2017, highlighting the current trends in research fields, the research methods, the main limitations, the leading researchers, standard assessment criteria and clinical applications. Freehand 3-D US systems are more prevalent in the academic environment, whereas in clinical applications and industrial research, most studies have focused on 3-D US transducers and improvement of hardware performance. This topic is still an interesting active area for researchers, and there remain many unsolved problems to be addressed.

Active phantoms: a paradigm for ultrasound calibration using phantom feedback

In ultrasound (US)-guided medical procedures, accurate tracking of interventional tools is crucial to patient safety and clinical outcome. This requires a calibration procedure to recover the relationship between the US image and the tracking coordinate system. In literature, calibration has been performed on passive phantoms, which depend on image quality and parameters, such as frequency, depth, and beam-thickness as well as in-plane assumptions. In this work, we introduce an active phantom for US calibration. This phantom actively detects and responds to the US beams transmitted from the imaging probe. This active echo (AE) approach allows identification of the US image midplane independent of image quality. Both target localization and segmentation can be done automatically, minimizing user dependency. The AE phantom is compared with a crosswire phantom in a robotic US setup. An out-of-plane estimation US calibration method is also demonstrated through simulation and experiments to compensate for remaining elevational uncertainty. The results indicate that the AE calibration phantom can have more consistent results across experiments with varying image configurations. Automatic segmentation is also shown to have similar performance to manual segmentation.

Development and Phantom Validation of a 3-D-Ultrasound-Guided System for Targeting MRI-Visible Lesions During Transrectal Prostate Biopsy

OBJECTIVE

Three- and four-dimensional transrectal ultrasound transducers are now available from most major ultrasound equipment manufacturers, but currently are incorporated into only one commercial prostate biopsy guidance system. Such transducers offer the benefits of rapid volumetric imaging, but can cause substantial measurement distortion in electromagnetic tracking sensors, which are commonly used to enable 3-D navigation. In this paper, we describe the design, development, and validation of a 3-D-ultrasound-guided transrectal prostate biopsy system that employs high-accuracy optical tracking to localize the ultrasound probe and prostate targets in 3-D physical space.

METHODS

The accuracy of the system was validated by evaluating the targeted needle placement error after inserting a biopsy needle to sample planned targets in a phantom using standard 2-D ultrasound guidance versus real-time 3-D guidance provided by the new system.

RESULTS

The overall mean needle-segment-to-target distance error was 3.6 ± 4.0 mm and mean needle-to-target distance was 3.2 ± 2.4 mm.

CONCLUSION

A significant increase in needle placement accuracy was observed when using the 3-D guidance system compared with visual targeting of invisible (virtual) lesions using a standard B-mode ultrasound-guided biopsy technique.

Spatial calibration of a 2D/3D ultrasound using a tracked needle

Purpose

Spatial calibration between a 2D/3D ultrasound and a pose tracking system requires a complex and time-consuming procedure. Simplifying this procedure without compromising the calibration accuracy is still a challenging problem.

Method

We propose a new calibration method for both 2D and 3D ultrasound probes that involves scanning an arbitrary region of a tracked needle in different poses. This approach is easier to perform than most alternative methods that require a precise alignment between US scans and a calibration phantom.

Results

Our calibration method provides an average accuracy of 2.49 mm for a 2D US probe with 107 mm scanning depth, and an average accuracy of 2.39 mm for a 3D US with 107 mm scanning depth.

Conclusion

Our method proposes a unified calibration framework for 2D and 3D probes using the same phantom object, work-flow, and algorithm. Our method significantly improves the accuracy of needle-based methods for 2D US probes as well as extends its use for 3D US probes.

User-friendly freehand ultrasound calibration using Lego bricks and automatic registration

PURPOSE

As an inexpensive, noninvasive, and portable clinical imaging modality, ultrasound (US) has been widely employed in many interventional procedures for monitoring potential tissue deformation, surgical tool placement, and locating surgical targets. The application requires the spatial mapping between 2D US images and 3D coordinates of the patient. Although positions of the devices (i.e., ultrasound transducer) and the patient can be easily recorded by a motion tracking system, the spatial relationship between the US image and the tracker attached to the US transducer needs to be estimated through an US calibration procedure. Previously, various calibration techniques have been proposed, where a spatial transformation is computed to match the coordinates of corresponding features in a physical phantom and those seen in the US scans. However, most of these methods are difficult to use for novel users.

METHODS

We proposed an ultrasound calibration method by constructing a phantom from simple Lego bricks and applying an automated multi-slice 2D-3D registration scheme without volumetric reconstruction. The method was validated for its calibration accuracy and reproducibility.

RESULTS

Our method yields a calibration accuracy of [Formula: see text] mm and a calibration reproducibility of 1.29 mm.

CONCLUSION

We have proposed a robust, inexpensive, and easy-to-use ultrasound calibration method.

Panorama Ultrasound for Navigation and Guidance of Epidural Anesthesia

Despite the common use of epidural anesthesia in obstetrics and surgery, the procedure can be challenging, especially for obese patients. We propose the use of an ultrasound guidance system employing a transducer-mounted camera to create 3-D panorama ultrasound volumes of the spine, thereby allowing identification of vertebrae and selection of puncture site, needle trajectory and depth of insertion. The camera achieves absolute position estimation of the transducer with respect to the patient using a specialized marker strip attached to the skin surface. The guidance system is validated first on a phantom against a commercial optical tracking system and then in vivo by comparing panorama images from human subjects against independent measurements by an experienced sonographer. The results for measuring depth to the epidural space, intervertebral spacing and registration of interspinous gaps to the skin prove the potential of the system for improving guidance of epidural anesthesia. The tracking and visualization are implemented in real time using the 3D Slicer software package.

Review of ultrasound image guidance in external beam radiotherapy: I. Treatment planning and inter-fraction motion management

In modern radiotherapy, verification of the treatment to ensure the target receives the prescribed dose and normal tissues are optimally spared has become essential. Several forms of image guidance are available for this purpose. The most commonly used forms of image guidance are based on kilovolt or megavolt x-ray imaging. Image guidance can also be performed with non-harmful ultrasound (US) waves. This increasingly used technique has the potential to offer both anatomical and functional information.This review presents an overview of the historical and current use of two-dimensional and three-dimensional US imaging for treatment verification in radiotherapy. The US technology and the implementation in the radiotherapy workflow are described. The use of US guidance in the treatment planning process is discussed. The role of US technology in inter-fraction motion monitoring and management is explained, and clinical studies of applications in areas such as the pelvis, abdomen and breast are reviewed. A companion review paper (O'Shea et al 2015 Phys. Med. Biol. submitted) will extensively discuss the use of US imaging for intra-fraction motion quantification and novel applications of US technology to RT.

Calibration for position tracking of swept motor 3-D ultrasound

Tracking the position and orientation of a 3-D ultrasound transducer has many clinical applications. Tracking requires calibration to find the transformation between the tracking sensor and the ultrasound coordinates. Typically the set of image slice data are scan converted to a Cartesian volume using assumed motor geometry and a single transformation to the sensor. We propose, instead, the calibration of individual slices using a 2-D calibration technique. A best fit to a subset of slices is performed to decrease data collection time compared with that for calibration of all slices, and to reduce the influence of random errors in individual calibrations. We compare our technique with four scan conversion-based techniques: 2-D N-wire on the center slice, N-wire using a 3-D volume, N-wire using a 3-D volume including the edge points and a new closed-form planar method using a 3-D volume. The proposed multi-slice technique produced the smallest point reconstruction error (0.82 mm using a tracked stylus).

An error analysis perspective for patient alignment systems

PURPOSE

This paper analyses the effects of error sources which can be found in patient alignment systems. As an example, an ultrasound (US) repositioning system and its transformation chain are assessed. The findings of this concept can also be applied to any navigation system.

METHODS AND MATERIALS

In a first step, all error sources were identified and where applicable, corresponding target registration errors were computed. By applying error propagation calculations on these commonly used registration/calibration and tracking errors, we were able to analyse the components of the overall error. Furthermore, we defined a special situation where the whole registration chain reduces to the error caused by the tracking system. Additionally, we used a phantom to evaluate the errors arising from the image-to-image registration procedure, depending on the image metric used. We have also discussed how this analysis can be applied to other positioning systems such as Cone Beam CT-based systems or Brainlab's ExacTrac.

RESULTS

The estimates found by our error propagation analysis are in good agreement with the numbers found in the phantom study but significantly smaller than results from patient evaluations. We probably underestimated human influences such as the US scan head positioning by the operator and tissue deformation. Rotational errors of the tracking system can multiply these errors, depending on the relative position of tracker and probe.

CONCLUSIONS

We were able to analyse the components of the overall error of a typical patient positioning system. We consider this to be a contribution to the optimization of the positioning accuracy for computer guidance systems.

Real time 3D visualization of intraoperative organ deformations using structured dictionary

Restricted visualization of the surgical field is one of the most critical challenges for minimally invasive surgery (MIS). Current intraoperative visualization systems are promising. However, they can hardly meet the requirements of high resolution and real time 3D visualization of the surgical scene to support the recognition of anatomic structures for safe MIS procedures. In this paper, we present a new approach for real time 3D visualization of organ deformations based on optical imaging patches with limited field-of-view and a single preoperative scan of magnetic resonance imaging (MRI) or computed tomography (CT). The idea for reconstruction is motivated by our empirical observation that the spherical harmonic coefficients corresponding to distorted surfaces of a given organ lie in lower dimensional subspaces in a structured dictionary that can be learned from a set of representative training surfaces. We provide both theoretical and practical designs for achieving these goals. Specifically, we discuss details about the selection of limited optical views and the registration of partial optical images with a single preoperative MRI/CT scan. The design proposed in this paper is evaluated with both finite element modeling data and ex vivo experiments. The ex vivo test is conducted on fresh porcine kidneys using 3D MRI scans with 1.2 mm resolution and a portable laser scanner with an accuracy of 0.13 mm. Results show that the proposed method achieves a sub-3 mm spatial resolution in terms of Hausdorff distance when using only one preoperative MRI scan and the optical patch from the single-sided view of the kidney. The reconstruction frame rate is between 10 frames/s and 39 frames/s depending on the complexity of the test model.

Three-dimensional ultrasound scanning

The past two decades have witnessed developments of new imaging techniques that provide three-dimensional images about the interior of the human body in a manner never before available. Ultrasound (US) imaging is an important cost-effective technique used routinely in the management of a number of diseases. However, two-dimensional viewing of three-dimensional anatomy, using conventional two-dimensional US, limits our ability to quantify and visualize the anatomy and guide therapy, because multiple two-dimensional images must be integrated mentally. This practice is inefficient, and may lead to variability and incorrect diagnoses. Investigators and companies have addressed these limitations by developing three-dimensional US techniques. Thus, in this paper, we review the various techniques that are in current use in three-dimensional US imaging systems, with a particular emphasis placed on the geometric accuracy of the generation of three-dimensional images. The principles involved in three-dimensional US imaging are then illustrated with a diagnostic and an interventional application: (i) three-dimensional carotid US imaging for quantification and monitoring of carotid atherosclerosis and (ii) three-dimensional US-guided prostate biopsy.

Improvement of freehand ultrasound calibration accuracy using the elevation beamwidth profile

This article presents a novel approach that incorporates an ultrasound slice-thickness profile into a filtered, weighted-least-square framework to improve the reconstruction accuracy of a real-time freehand calibration system. An important part of the system is a slice-thickness calibration device that aids in the extraction of the slice thickness across a wide range of imaging depths. Extensive experiments were conducted on a 10,000-image dataset to evaluate the effects of the framework on the calibration accuracy. The results showed that three-dimensional (3-D) reconstruction errors were significantly reduced in every experiment (p < 0.001). Real-time testing showed that the proposed method worked effectively with a small number of input images, suggesting great potential for intraoperative use where only a limited number of data may be available. This new framework can enable efficient quality control of calibration accuracy in real-time operating-room use.

Adaptive spatial calibration of a 3D ultrasound system

PURPOSE

The authors present a method devised to calibrate the spatial relationship between a 3D ultrasound scanhead and its tracker completely automatically and reliably. The user interaction is limited to collecting ultrasound data on which the calibration is based.

METHODS

The method of calibration is based on images of a fixed plane of unknown location with respect to the 3D tracking system. This approach has, for advantage, to eliminate the measurement of the plane location as a source of error. The devised method is sufficiently general and adaptable to calibrate scanheads for 2D images and 3D volume sets using the same approach. The basic algorithm for both types of scanheads is the same and can be run unattended fully automatically once the data are collected. The approach was devised by seeking the simplest and most robust solutions for each of the steps required. These are the identification of the plane intersection within the images or volumes and the optimization method used to compute a calibration transformation matrix. The authors use adaptive algorithms in these two steps to eliminate data that would otherwise prevent the convergence of the procedure, which contributes to the robustness of the method.

RESULTS

The authors have run tests amounting to 57 runs of the calibration on two a scanhead that produce 3D imaging volumes, at all the available scales. The authors evaluated the system on two criteria: Robustness and accuracy. The program converged to useful values unattended for every one of the tests (100%). Its accuracy, based on the measured location of a reference plane, was estimated to be 0.7 +/- 0.6 mm for all tests combined.

CONCLUSIONS

The system presented is robust and allows unattended computations of the calibration parameters required for freehand tracked ultrasound based on either 2D or 3D imaging systems.

Evaluation of targeting errors in ultrasound-assisted radiotherapy

A method for validating the start-to-end accuracy of a 3-D ultrasound (US)-based patient positioning system for radiotherapy is described. A radiosensitive polymer gel is used to record the actual dose delivered to a rigid phantom after being positioned using 3-D US guidance. Comparison of the delivered dose with the treatment plan allows accuracy of the entire radiotherapy treatment process, from simulation to 3-D US guidance, and finally delivery of radiation, to be evaluated. The 3-D US patient positioning system has a number of features for achieving high accuracy and reducing operator dependence. These include using tracked 3-D US scans of the target anatomy acquired using a dedicated 3-D ultrasound probe during both the simulation and treatment sessions, automatic 3-D US-to-US registration and use of infrared LED (IRED) markers of the optical position-sensing system for registering simulation computed tomography to US data. The mean target localization accuracy of this system was 2.5 mm for four target locations inside the phantom, compared with 1.6 mm obtained using the conventional patient positioning method of laser alignment. Because the phantom is rigid, this represents the best possible set-up accuracy of the system. Thus, these results suggest that 3-D US-based target localization is practically feasible and potentially capable of increasing the accuracy of patient positioning for radiotherapy in sites where day-to-day organ shifts are greater than 1 mm in magnitude.

Towards scarless surgery: an endoscopic ultrasound navigation system for transgastric access procedures

OBJECTIVE

Scarless surgery is an innovative and promising technique that may herald a new era in surgical procedures. We have created a navigation system, named IRGUS, for endoscopic and transgastric access interventions and have validated it in in vivo pilot studies. Our hypothesis is that endoscopic ultrasound procedures will be performed more easily and efficiently if the operator is provided with approximately registered 3D and 2D processed CT images in real time that correspond to the probe position and ultrasound image.

MATERIALS AND METHODS

The system provides augmented visual feedback and additional contextual information to assist the operator. It establishes correspondence between the real-time endoscopic ultrasound image and a preoperative CT volume registered using electromagnetic tracking of the endoscopic ultrasound probe position. Based on this positional information, the CT volume is reformatted in approximately the same coordinate frame as the ultrasound image and displayed to the operator.

RESULTS

The system reduces the mental burden of probe navigation and enhances the operator's ability to interpret the ultrasound image. Using an initial rigid body registration, we measured the mis-registration error between the ultrasound image and the reformatted CT plane to be less than 5 mm, which is sufficient to enable the performance of novice users of endoscopic systems to approach that of expert users.

CONCLUSIONS

Our analysis shows that real-time display of data using rigid registration is sufficiently accurate to assist surgeons in performing endoscopic abdominal procedures. By using preoperative data to provide context and support for image interpretation and real-time imaging for targeting, it appears probable that both preoperative and intraoperative data may be used to improve operator performance.

Tracking a 3-D ultrasound probe with constantly visible fiducials

A new method is presented for tracking a 3-D ultrasound (US) probe in space. The key is to use small fiducials that create point features in the US volume near the probe face and which are connected rigidly to the tracker on the probe. In this way, fiducials appear in every US volume and are used to calculate the position and orientation of the volume with respect to a fixed base. The main novelty is the elimination of a separate calibration device because calibration can be considered to be performed on every volume. After acquisition, the user simply marks the locations of the fiducials in the volume and solves a single equation to convert volume coordinates to the base. The point accuracy of the new method is slightly lower than those of conventional methods mainly because of the suboptimal appearance of the fiducials near the top of the image and little data averaging, but ease of use is improved.

Effect of 3D ultrasound probes on the accuracy of electromagnetic tracking systems

In the last few years, 3D ultrasound probes have became readily available. New fields of image-guided surgery applications are opened by attaching small electromagnetic position sensors to 3D ultrasound probes. However, nothing is known about the distortions caused by 3D ultrasound probes regarding electromagnetic sensors. Several trials were performed to investigate error-proneness of state-of-the-art electromagnetic tracking systems when used in combination with 3D ultrasound probes. It was found that 3D ultrasound probes do distort electromagnetic sensors more than 2D probes do. When attaching electromagnetic sensors to 3D probes, maximum errors of 5 mm up to 119 mm occur. The distortion strongly depends on the electromagnetic technology as well on the probe technology used. Thus, for 3D ultrasound-guided applications using electromagnetic tracking technology, the interference of ultrasound probes and electromagnetic sensors have to be checked carefully.

Three-dimensional extended field-of-view ultrasound

Three-dimensional (3-D) extended field-of-view ultrasound creates a mosaic view from a set of volumes acquired from a dedicated 3-D ultrasound machine combined with a position tracker. A simple compounding technique can be used to combine the volumes together using only the position measurements, but some misalignment remains. Two different registration methods were developed to correct these errors in the overlapping regions. The first method divides the overlap into smaller blocks and warps the blocks to best align the features. The second method is similar, but uses rigid body registration of the blocks. Experiments in vitro and in vivo showed that block-based registration with warping produced the most reproducible results and the greatest increase in similarity among the overlapping regions. It also produced the best reconstruction accuracy, with a mean distance error of 0.4 mm measured across 101.78 mm in a phantom, representing 0.4% error.