Registration of 3D CT and ultrasound datasets of the spine using bone structures

Combined Ultrasound and Photoacoustic Image Guidance of Spinal Pedicle Cannulation Demonstrated With Intact ex vivo Specimens

OBJECTIVE

Spinal fusion surgeries require accurate placement of pedicle screws in anatomic corridors without breaching bone boundaries. We are developing a combined ultrasound and photoacoustic image guidance system to avoid pedicle screw misplacement and accidental bone breaches, which can lead to nerve damage.

METHODS

Pedicle cannulation was performed on a human cadaver, with co-registered photoacoustic and ultrasound images acquired at various time points during the procedure. Bony landmarks obtained from coherence-based ultrasound images of lumbar vertebrae were registered to post-operative CT images. Registration methods were additionally tested on an ex vivo caprine vertebra.

RESULTS

Locally weighted short-lag spatial coherence (LW-SLSC) ultrasound imaging enhanced the visualization of bony structures with generalized contrast-to-noise ratios (gCNRs) of 0.99 and 0.98-1.00 in the caprine and human vertebrae, respectively. Short-lag spatial coherence (SLSC) and amplitude-based delay-and-sum (DAS) ultrasound imaging generally produced lower gCNRs of 0.98 and 0.84, respectively, in the caprine vertebra and 0.84-0.93 and 0.34-0.99, respectively, in the human vertebrae. The mean ± standard deviation of the area of -6 dB contours created from DAS photoacoustic images acquired with an optical fiber inserted in prepared pedicle holes (i.e., fiber surrounded by cancellous bone) and holes created after intentional breaches (i.e., fiber exposed to cortical bone) was 10.06 ±5.22 mm ² and 2.47 ±0.96 mm ², respectively (p 0.01).

CONCLUSIONS

Coherence-based LW-SLSC and SLSC beamforming improved visualization of bony anatomical landmarks for ultrasound-to-CT registration, while amplitude-based DAS beamforming successfully distinguished photoacoustic signals within the pedicle from less desirable signals characteristic of impending bone breaches.

SIGNIFICANCE

These results are promising to improve visual registration of ultrasound and photoacoustic images with CT images, as well as to assist surgeons with identifying and avoiding impending bone breaches during pedicle cannulation in spinal fusion surgeries.

A level-wise spine registration framework to account for large pose changes

PURPOSES

Accurate and efficient spine registration is crucial to success of spine image guidance. However, changes in spine pose cause intervertebral motion that can lead to significant registration errors. In this study, we develop a geometrical rectification technique via nonlinear principal component analysis (NLPCA) to achieve level-wise vertebral registration that is robust to large changes in spine pose.

METHODS

We used explanted porcine spines and live pigs to develop and test our technique. Each sample was scanned with preoperative CT (pCT) in an initial pose and rescanned with intraoperative stereovision (iSV) in a different surgical posture. Patient registration rectified arbitrary spinal postures in pCT and iSV into a common, neutral pose through a parameterized moving-frame approach. Topologically encoded depth projection 2D images were then generated to establish invertible point-to-pixel correspondences. Level-wise point correspondences between pCT and iSV vertebral surfaces were generated via 2D image registration. Finally, closed-form vertebral level-wise rigid registration was obtained by directly mapping 3D surface point pairs. Implanted mini-screws were used as fiducial markers to measure registration accuracy.

RESULTS

In seven explanted porcine spines and two live animal surgeries (maximum in-spine pose change of 87.5 mm and 32.7 degrees averaged from all spines), average target registration errors (TRE) of 1.70  ±  0.15 mm and 1.85 ± 0.16 mm were achieved, respectively. The automated spine rectification took 3-5 min, followed by an additional 30 secs for depth image projection and level-wise registration.

CONCLUSIONS

Accuracy and efficiency of the proposed level-wise spine registration support its application in human open spine surgeries. The registration framework, itself, may also be applicable to other intraoperative imaging modalities such as ultrasound and MRI, which may expand utility of the approach in spine registration in general.

Photoacoustic imaging of a human vertebra: implications for guiding spinal fusion surgeries

It is well known that there are structural differences between cortical and cancellous bone. However, spinal surgeons currently have no reliable method to non-invasively determine these differences in real-time when choosing the optimal starting point and trajectory to insert pedicle screws and avoid surgical complications associated with breached or weakened bone. This paper explores 3D photoacoustic imaging of a human vertebra to noninvasively differentiate cortical from cancellous bone for this surgical task. We observed that signals from the cortical bone tend to appear as compact, high-amplitude signals, while signals from the cancellous bone have lower amplitudes and are more diffuse. In addition, we discovered that the location of the light source for photoacoustic imaging is a critical parameter that can be adjusted to non-invasively determine the optimal entry point into the pedicle. Once inside the pedicle, statistically significant differences in the contrast and SNR of signals originating from the cancellous core of the pedicle (when compared to signals originating from the surrounding cortical bone) were obtained with laser energies of 0.23-2.08 mJ (p  <  0.05). Similar quantitative differences were observed with an energy of 1.57 mJ at distances  ⩾6 mm from the cortical bone of the pedicle. These quantifiable differences between cortical and cancellous bone (when imaging with an ultrasound probe in direct contact with each bone type) can potentially be used to ensure an optimal trajectory during surgery. Our results are promising for the introduction and development of photoacoustic imaging systems to overcome a wide range of longstanding challenges with spinal surgeries, including challenges with the occurrence of bone breaches due to misplaced pedicle screws.

Fast and automatic bone segmentation and registration of 3D ultrasound to CT for the full pelvic anatomy: a comparative study

PURPOSE

Ultrasound (US) is a safer alternative to X-rays for bone imaging, and its popularity for orthopedic surgical navigation is growing. Routine use of intraoperative US for navigation requires fast, accurate and automatic alignment of tracked US to preoperative computed tomography (CT) patient models. Our group previously investigated image segmentation and registration to align untracked US to CT of only the partial pelvic anatomy. In this paper, we extend this to study the performance of these previously published techniques over the full pelvis in a tracked framework, to characterize their suitability in more realistic scenarios, along with an additional simplified segmentation method and similarity metric for registration.

METHOD

We evaluated phase symmetry segmentation, and Gaussian mixture model (GMM) and coherent point drift (CPD) registration methods on a pelvic phantom augmented with human soft tissue images. Additionally, we proposed and evaluated a simplified 3D bone segmentation algorithm we call Shadow-Peak (SP), which uses acoustic shadowing and peak intensities to detect bone surfaces. We paired this with a registration pipeline that optimizes the normalized cross-correlation (NCC) between distance maps of the segmented US-CT images.

RESULTS

SP segmentation combined with the proposed NCC registration successfully aligned tracked US volumes to the preoperative CT model in all trials, in contrast to the other techniques. SP with NCC achieved a median target registration error (TRE) of 2.44 mm (maximum 4.06 mm), when imaging all three anterior pelvic structures, and a mean runtime of 27.3 s. SP segmentation with CPD registration was the next most accurate combination: median TRE of 3.19 mm (maximum 6.07 mm), though a much faster runtime of 4.2 s.

CONCLUSION

We demonstrate an accurate, automatic image processing pipeline for intraoperative alignment of US-CT over the full pelvis and compare its performance with the state-of-the-art methods. The proposed methods are amenable to clinical implementation due to their high accuracy on realistic data and acceptably low runtimes.

Imaging beyond ultrasonically-impenetrable objects

Ultrasound images are severely degraded by the presence of obstacles such as bones and air gaps along the beam path. This paper describes a method for imaging structures that are distal to obstacles that are otherwise impenetrable to ultrasound. The method uses an optically-inspired holographic algorithm to beam-shape the emitted ultrasound field in order to bypass the obstacle and place the beam focus beyond the obstruction. The resulting performance depends on the transducer aperture, the size and position of the obstacle, and the position of the target. Improvement compared to standard ultrasound imaging is significant for obstacles for which the width is larger than one fourth of the transducer aperture and the depth is within a few centimeters of the transducer. For such cases, the improvement in focal intensity at the location of the target reaches 30-fold, and the improvement in peak-to-side-lobe ratio reaches 3-fold. The method can be implemented in conventional ultrasound systems, and the entire process can be performed in real time. This method has applications in the fields of cancer detection, abdominal imaging, imaging of vertebral structure and ultrasound tomography. Here, its effectiveness is demonstrated using wire targets, tissue mimicking phantoms and an ex vivo biological sample.

Accumulated Angle Factor-Based Beamforming to Improve the Visualization of Spinal Structures in Ultrasound Images

In recent years, ultrasound has been increasingly used to guide needle insertion procedures for spinal anesthesia. The primary anatomical targets are facet joints and epidural spaces. For these procedures, accurate visualization of the spine anatomy is of critical importance. Challenges arising from the interactions between the ultrasound beam and spinal structures including tilt caused by specular reflections, off-axis interference, and reverberations often result in weakened and blurred vertebra surfaces. Previously, adaptive beamforming methods have been proposed to improve the resolution and contrast. However, most of these methods are not specialized for improving the contrast of specular targets like bones. In this paper, we propose an accumulated angle factor (AAF)-based beamforming method customized for bone surface enhancement. This approach applies a Hilbert transform on delay compensated channel data across the receive aperture. The accumulated phase change across the receive aperture is then calculated and utilized as the weight in the beamforming output. We compared our method with classical delay and sum (DAS) beamforming method and adaptive beamforming methods such as Wiener, phase coherence factor (PCF), CF, and generalized CF (GCF) beamforming. In 12 volunteer data sets, the mean contrast ratio between the vertebrae surface and the surrounding tissue for DAS, Wiener, PCF, CF, GCF, and the proposed AAF methods are 0.49, 0.64, 0.82, 0.77, 0.76, and 0.91, respectively. The contrast is significantly improved in the proposed method.

Enhancement of bone shadow region using local phase-based ultrasound transmission maps

PURPOSE

Ultrasound is increasingly being employed in different orthopedic procedures as an imaging modality for real-time guidance. Nevertheless, low signal-to-noise-ratio and different imaging artifacts continue to hamper the success of ultrasound-based procedures. Bone shadow region is an important feature indicating the presence of bone/tissue interface in the acquired ultrasound data. Enhancement and automatic detection of this region could improve the sensitivity of ultrasound for imaging bone and result in improved guidance for various orthopedic procedures.

METHODS

In this work, a method is introduced for the enhancement of bone shadow regions from B-mode ultrasound data. The method is based on the combination of three different image phase features: local phase tensor, local weighted mean phase angle, and local phase energy. The combined local phase image features are used as an input to an [Formula: see text] norm-based contextual regularization method which emphasizes uncertainty in the shadow regions. The enhanced bone shadow images are automatically segmented and compared against expert segmentation.

RESULTS

Qualitative and quantitative validation was performed on 100 in vivo US scans obtained from five subjects by scanning femur and vertebrae bones. Validation against expert segmentation achieved a mean dice similarity coefficient of 0.88.

CONCLUSIONS

The encouraging results obtained in this initial study suggest that the proposed method is promising enough for further evaluation. The calculated bone shadow maps could be incorporated into different ultrasound bone segmentation and registration approaches as an additional feature.

Local phase tensor features for 3-D ultrasound to statistical shape+pose spine model registration

Most conventional spine interventions are performed under X-ray fluoroscopy guidance. In recent years, there has been a growing interest to develop nonionizing imaging alternatives to guide these procedures. Ultrasound guidance has emerged as a leading alternative. However, a challenging problem is automatic identification of the spinal anatomy in ultrasound data. In this paper, we propose a local phase-based bone feature enhancement technique that can robustly identify the spine surface in ultrasound images. The local phase information is obtained using a gradient energy tensor filter. This information is used to construct local phase tensors in ultrasound images, which highlight the spine surface. We show that our proposed approach results in a more distinct enhancement of the bone surfaces compared to recently proposed techniques based on monogenic scale-space filters and logarithmic Gabor filters. We also demonstrate that registration accuracy of a statistical shape+pose model of the spine to 3-D ultrasound images can be significantly improved, using the proposed method, compared to those obtained using monogenic scale-space filters and logarithmic Gabor filters.

Eigenspace based minimum variance beamforming applied to ultrasound imaging of acoustically hard tissues

Minimum variance (MV) based beamforming techniques have been successfully applied to medical ultrasound imaging. These adaptive methods offer higher lateral resolution, lower sidelobes, and better definition of edges compared to delay and sum beamforming (DAS). In standard medical ultrasound, the bone surface is often visualized poorly, and the boundaries region appears unclear. This may happen due to fundamental limitations of the DAS beamformer, and different artifacts due to, e.g., specular reflection, and shadowing. The latter can degrade the robustness of the MV beamformers as the statistics across the imaging aperture is violated because of the obstruction of the imaging beams. In this study, we employ forward/backward averaging to improve the robustness of the MV beamforming techniques. Further, we use an eigen-spaced minimum variance technique (ESMV) to enhance the edge detection of hard tissues. In simulation, in vitro, and in vivo studies, we show that performance of the ESMV beamformer depends on estimation of the signal subspace rank. The lower ranks of the signal subspace can enhance edges and reduce noise in ultrasound images but the speckle pattern can be distorted.

Minimum variance beamforming applied to ultrasound imaging with a partially shaded aperture

Shadowing of an imaging aperture occurs when ultrasound beams are partially obstructed by an acoustically hard tissue, e.g., bone tissue. This effect leads to reduced resolution and, in some cases, geometrical distortion. In this paper, we initially introduce a binary apodization model to simulate effects of the shadowing on the point scatterers located close to a bone structure. Further, in a simulation study and an in vitro experiment, the minimum variance (MV) beamforming method is employed to image scatterers partly located in the shadow of bone. We show that the MV beamformer can result in a distorted image when the imaging aperture is highly obstructed by the bone structure. This distortion can be seen as an apparent lateral shift of the point spread function and a decrease in the sensitivity. Based on the signal power across the aperture, we adaptively determine the shadowed elements and discard their corresponding data from the covariance matrix to improve the MV beamformer performance. This modified MV beamformer can retain the resolution and compensate for the apparent lateral shifting and signal attenuation for the shadowed point scatterers.

Integrating diagnostic B-mode ultrasonography into CT-based radiation treatment planning

This paper presents methods and a clinical procedure for integrating B-mode ultrasound images tagged with position information with a planning computed tomography (CT) scan for radiotherapy. A workflow is described that allows the integration of these modalities into the clinic. A surface mapping approach provides a preregistration of the ultrasound image borders onto the patient's skin. Successively, a set of individual ultrasound images from a freehand sweep is chosen by the physician. These images are automatically registered with the planning CT scan using novel intensity-based methods. We put a particular focus on deriving an appropriate similarity measure based on the physical properties and artifacts of ultrasound. A combination of a weighted mutual information term, edge correlation, clamping to the skin surface, and occlusion detection is able to assess the alignment of structures in ultrasound images and information reconstructed from the CT data. We demonstrate the practicality of our methods on five patients with head and neck tumors and cervical lymph node metastases and provide a detailed report on the conducted experiments, including the setup, calibration, acquisition, and verification of our algorithms. The mean target registration error on nine data sets is 3.9 mm. Thus, the additional information about intranodal architecture and fulfillment of malignancy criteria derived from a high-resolution ultrasonography of lymph nodes can be localized and visualized in the CT scan coordinate space and is made available for further radiation treatment planning.

Self-calibrating 3D-ultrasound-based bone registration for minimally invasive orthopedic surgery

Intraoperative freehand three-dimensional (3-D) ultrasound (3D-US) has been proposed as a noninvasive method for registering bones to a preoperative computed tomography image or computer-generated bone model during computer-aided orthopedic surgery (CAOS). In this technique, an US probe is tracked by a 3-D position sensor and acts as a percutaneous device for localizing the bone surface. However, variations in the acoustic properties of soft tissue, such as the average speed of sound, can introduce significant errors in the bone depth estimated from US images, which limits registration accuracy. We describe a new self-calibrating approach to US-based bone registration that addresses this problem, and demonstrate its application within a standard registration scheme. Using realistic US image data acquired from 6 femurs and 3 pelves of intact human cadavers, and accurate Gold Standard registration transformations calculated using bone-implanted fiducial markers, we show that self-calibrating registration is significantly more accurate than a standard method, yielding an average root mean squared target registration error of 1.6 mm. We conclude that self-calibrating registration results in significant improvements in registration accuracy for CAOS applications over conventional approaches where calibration parameters of the 3D-US system remain fixed to values determined using a preoperative phantom-based calibration.

FAIR: a hardware architecture for real-time 3-D image registration

Mutual information-based image registration, shown to be effective in registering a range of medical images, is a computationally expensive process, with a typical execution time on the order of minutes on a modern single-processor computer. Accelerated execution of this process promises to enhance efficiency and therefore promote routine use of image registration clinically. This paper presents details of a hardware architecture for real-time three-dimensional (3-D) image registration. Real-time performance can be achieved by setting up a network of processing units, each with three independent memory buses: one each for the two image memories and one for the mutual histogram memory. Memory access parallelization and pipelining, by design, allow each processing unit to be 25 times faster than a processor with the same bus speed, when calculating mutual information using partial volume interpolation. Our architecture provides superior per-processor performance at a lower cost compared to a parallel supercomputer.

Gradient-based 2-D/3-D rigid registration of fluoroscopic X-ray to CT

We present a gradient-based method for rigid registration of a patient preoperative computed tomography (CT) to its intraoperative situation with a few fluoroscopic X-ray images obtained with a tracked C-arm. The method is noninvasive, anatomy-based, requires simple user interaction, and includes validation. It is generic and easily customizable for a variety of routine clinical uses in orthopaedic surgery. Gradient-based registration consists of three steps: 1) initial pose estimation; 2) coarse geometry-based registration on bone contours, and; 3) fine gradient projection registration (GPR) on edge pixels. It optimizes speed, accuracy, and robustness. Its novelty resides in using volume gradients to eliminate outliers and foreign objects in the fluoroscopic X-ray images, in speeding up computation, and in achieving higher accuracy. It overcomes the drawbacks of intensity-based methods, which are slow and have a limited convergence range, and of geometry-based methods, which depend on the image segmentation quality. Our simulated, in vitro, and cadaver experiments on a human pelvis CT, dry vertebra, dry femur, fresh lamb hip, and human pelvis under realistic conditions show a mean 0.5-1.7 mm (0.5-2.6 mm maximum) target registration accuracy.