Volumetric B-mode ultrasound and Doppler Imaging: Automatic Tracking With One Single Camera

Vascular diseases may occur in the upper extremities, and the lesions can span the entire length of the blood vessel. One of the most popular methods to identify vascular disorders is ultrasound Doppler imaging. However, traditional two-dimensional (2D) ultrasound Doppler imaging cannot capture the entire length of a long vessel in one image. Medical professionals often have to painstakingly reconstruct three-dimensional (3D) data using 2D ultrasound images to locate the lesions, especially for large blood vessels. 3D ultrasound Doppler imaging can display the morphological structure of blood vessels and the distribution of lesions more directly, providing a more comprehensive view compared to 2D imaging. In this work, we propose a wide-range 3D volumetric ultrasound Doppler imaging system with dual modality, in which a high-definition camera is adopted to automatically track the movement of the ultrasound transducer, simultaneously capturing a corresponding sequence of 2D ultrasound Doppler images. We conducted experiments on human arms using our proposed system and separately with X-ray computerized tomography (X-CT). The comparison results prove the potential value of our proposed system in the diagnosis of arm vascular diseases.

A Review on Advances in Intra-operative Imaging for Surgery and Therapy: Imagining the Operating Room of the Future

With the advent of Minimally Invasive Surgery (MIS), intra-operative imaging has become crucial for surgery and therapy guidance, allowing to partially compensate for the lack of information typical of MIS. This paper reviews the advancements in both classical (i.e. ultrasounds, X-ray, optical coherence tomography and magnetic resonance imaging) and more recent (i.e. multispectral, photoacoustic and Raman imaging) intra-operative imaging modalities. Each imaging modality was analyzed, focusing on benefits and disadvantages in terms of compatibility with the operating room, costs, acquisition time and image characteristics. Tables are included to summarize this information. New generation of hybrid surgical room and algorithms for real time/in room image processing were also investigated. Each imaging modality has its own (site- and procedure-specific) peculiarities in terms of spatial and temporal resolution, field of view and contrasted tissues. Besides the benefits that each technique offers for guidance, considerations about operators and patient risk, costs, and extra time required for surgical procedures have to be considered. The current trend is to equip surgical rooms with multimodal imaging systems, so as to integrate multiple information for real-time data extraction and computer-assisted processing. The future of surgery is to enhance surgeons eye to minimize intra- and after-surgery adverse events and provide surgeons with all possible support to objectify and optimize the care-delivery process.

Development and Evaluation of CT-to-3D Ultrasound Image Registration Algorithm in Vertebral Phantoms for Spine Surgery

Posterior spinal fusion surgery requires careful insertion of screws into the spine to avoid neurologic injury. While current systems use CT-scans, three-dimensional ultrasound (3DUS) could provide guidance by reconstructing the vertebral surface, and then registering a pre-operative vertebral model to that surface for localization. The aim of this study was to evaluate the accuracy and processing time of a custom CT-3DUS registration algorithm. A phantom human vertebra was 3D-printed and scanned with a motion capture-based 3D ultrasound (3DUS) system. Image registration was performed that included a pre-alignment phase using vertebral symmetry information, and then comparing Gaussian pyramid intensity-based registration with iterative-closest-point registration for final transformations. Image registration was performed 192 times while surgical registration between CT and real-world position was performed 84 times. The accuracy of image registration (CT-to-3DUS) was 0.3 ± 0.2 mm and 0.9 ± 0.8° completed in 13.3 ± 2.9 s. The surgical navigation accuracy (CT model to real-world position) of the system was 1.2 ± 0.5 mm and 2.2 ± 2.0° completed in 16.2 ± 3.0 s. Both meet accuracy thresholds of < 2 mm and < 5° required for the surgery. A feasibility study on porcine spine qualitatively showed appropriate overlapping anatomy in CT-3DUS registrations. The usage of 3D ultrasound for navigation has demonstrated accuracy to provide radiation-free image guidance for spine surgery.

Probe Sector Matching for Freehand 3D Ultrasound Reconstruction

A 3D ultrasound image reconstruction technique, named probe sector matching (PSM), is proposed in this paper for a freehand linear array ultrasound probe equipped with multiple sensors, providing the position and attitude of the transducer and the pressure between the transducer and the target surface. The proposed PSM method includes three main steps. First, the imaging target and the working range of the probe are set to be the center and the radius of the imaging field of view, respectively. To reconstruct a 3D volume, the positions of all necessary probe sectors are pre-calculated inversely to form a sector database. Second, 2D cross-section probe sectors with the corresponding optical positioning, attitude and pressure information are collected when the ultrasound probe is moving around the imaging target. Last, an improved 3D Hough transform is used to match the plane of the current probe sector to the existing sector images in the sector database. After all pre-calculated probe sectors are acquired and matched into the 3D space defined by the sector database, a 3D ultrasound reconstruction is completed. The PSM is validated through two experiments: a virtual simulation using a numerical model and a lab experiment using a real physical model. The experimental results show that the PSM effectively reduces the errors caused by changes in the target position due to the uneven surface pressure or the inhomogeneity of the transmission media. We conclude that the PSM proposed in this study may help to design a lightweight, inexpensive and flexible ultrasound device with accurate 3D imaging capacity.

Efficient image based method using water-filled balloons for improving probe spatial calibration in 3D freehand ultrasonography

The ultrasound (US) probe spatial calibration is a key prerequisite for enabling the use of the 3D freehand US technique. Several methods have been proposed for achieving an accurate and precise calibration, although these methods still require specialised equipment. This equipment is often not available in research or clinical facilities. Therefore, the present investigation aimed to propose an efficient US probe calibration method that is accessible in terms of cost, easy to apply and capable of achieving results suitable for clinical applications. The data acquisition was carried out by performing two perpendicular US sweeps over water filled balloon phantoms. The data analysis was carried out by computing the similarity measures between 2D images from the first sweep and the corresponding images of the 3D reconstruction of the second sweep. These measures were maximized by using the Nelder-Mead algorithm, to find the optimal solution for the calibration parameters. The calibration results were evaluated in terms of accuracy and precision by comparing known phantom geometries with those extracted from the US images. The accuracy and the precision after applying the calibration method were improved. By using the parameters obtained from the plane phantom method as initialization of the calibration parameters, the accuracy and the precision in the best scenario was 0.4 mm and 1.5 mm, respectively. These results were in line with the methods requiring specialised equipment. However, the applied method was unable to consistently produce this level of accuracy and precision. The calibration parameters were also tested in a musculoskeletal application, revealing sufficient matching of the relevant anatomical features when multiple US sweeps are combined in a 3D reconstruction. To improve the current results and increase the reproducibility of this research, the developed software is made available.

Reconstruction and positional accuracy of 3D ultrasound on vertebral phantoms for adolescent idiopathic scoliosis spinal surgery

PURPOSE

Determine the positional, rotational and reconstruction accuracy of a 3D ultrasound system to be used for image registration in navigation surgery.

METHODS

A custom 3D ultrasound for spinal surgery image registration was developed using Optitrack Prime 13-W motion capture cameras and a SonixTablet Ultrasound System. Temporal and spatial calibration was completed to account for time latencies between the two systems and to ensure accurate motion tracking of the ultrasound transducer. A mock operating room capture volume with a pegboard grid was set up to allow phantoms to be placed at a variety of predetermined positions to validate accuracy measurements. Five custom-designed ultrasound phantoms were 3D printed to allow for a range of linear and angular dimensions to be measured when placed on the pegboard.

RESULTS

Temporal and spatial calibration was completed with measurement repeatabilities of 0.2 mm and 0.5° after calibration. The mean positional accuracy was within 0.4 mm, with all values within 0.5 mm within the critical surgical regions and 96% of values within 1 mm within the full capture volume. All orientation values were within 1.5°. Reconstruction accuracy was within 0.6 mm and 0.9° for geometrically shaped phantoms and 0.5 and 1.9° for vertebrae-mimicking phantoms.

CONCLUSIONS

The accuracy of the developed 3D ultrasound system meets the 1 mm and 5° requirements of spinal surgery from this study. Further repeatability studies and evaluation on vertebrae are needed to validate the system for surgical use.

Actuator-Assisted Calibration of Freehand 3D Ultrasound System

Freehand three-dimensional (3D) ultrasound has been used independently of other technologies to analyze complex geometries or registered with other imaging modalities to aid surgical and radiotherapy planning. A fundamental requirement for all freehand 3D ultrasound systems is probe calibration. The purpose of this study was to develop an actuator-assisted approach to facilitate freehand 3D ultrasound calibration using point-based phantoms. We modified the mathematical formulation of the calibration problem to eliminate the need of imaging the point targets at different viewing angles and developed an actuator-assisted approach/setup to facilitate quick and consistent collection of point targets spanning the entire image field of view. The actuator-assisted approach was applied to a commonly used cross wire phantom as well as two custom-made point-based phantoms (original and modified), each containing 7 collinear point targets, and compared the results with the traditional freehand cross wire phantom calibration in terms of calibration reproducibility, point reconstruction precision, point reconstruction accuracy, distance reconstruction accuracy, and data acquisition time. Results demonstrated that the actuator-assisted single cross wire phantom calibration significantly improved the calibration reproducibility and offered similar point reconstruction precision, point reconstruction accuracy, distance reconstruction accuracy, and data acquisition time with respect to the freehand cross wire phantom calibration. On the other hand, the actuator-assisted modified “collinear point target” phantom calibration offered similar precision and accuracy when compared to the freehand cross wire phantom calibration, but it reduced the data acquisition time by 57%. It appears that both actuator-assisted cross wire phantom and modified collinear point target phantom calibration approaches are viable options for freehand 3D ultrasound calibration.

Freehand three-dimensional ultrasound imaging of carotid artery using motion tracking technology

Ultrasound imaging has been extensively used for determining the severity of carotid atherosclerotic stenosis. In particular, the morphological characterization of carotid plaques can be performed for risk stratification of patients. However, using 2D ultrasound imaging for detecting morphological changes in plaques has several limitations. Due to the scan was performed on a single longitudinal cross-section, the selected 2D image is difficult to represent the entire morphology and volume of plaque and vessel lumen. In addition, the precise positions of 2D ultrasound images highly depend on the radiologists' experience, it makes the serial long-term exams of anti-atherosclerotic therapies are difficult to relocate the same corresponding planes by using 2D B-mode images. This has led to the recent development of three-dimensional (3D) ultrasound imaging, which offers improved visualization and quantification of complex morphologies of carotid plaques. In the present study, a freehand 3D ultrasound imaging technique based on optical motion tracking technology is proposed. Unlike other optical tracking systems, the marker is a small rigid body that is attached to the ultrasound probe and is tracked by eight high-performance digital cameras. The probe positions in 3D space coordinates are then calibrated at spatial and temporal resolutions of 10μm and 0.01s, respectively. The image segmentation procedure involves Otsu's and the active contour model algorithms and accurately detects the contours of the carotid arteries. The proposed imaging technique was verified using normal artery and atherosclerotic stenosis phantoms. Human experiments involving freehand scanning of the carotid artery of a volunteer were also performed. The results indicated that compared with manual segmentation, the lowest percentage errors of the proposed segmentation procedure were 7.8% and 9.1% for the external and internal carotid arteries, respectively. Finally, the effect of handshaking was calibrated using the optical tracking system for reconstructing a 3D image.