Anatomy-aware computed tomography-to-ultrasound spine registration

BACKGROUND

Ultrasound (US) has demonstrated to be an effective guidance technique for lumbar spine injections, enabling precise needle placement without exposing the surgeon or the patient to ionizing radiation. However, noise and acoustic shadowing artifacts make US data interpretation challenging. To mitigate these problems, many authors suggested using computed tomography (CT)-to-US registration to align the spine in pre-operative CT to intra-operative US data, thus providing localization of spinal landmarks.

PURPOSE

In this paper, we propose a deep learning (DL) pipeline for CT-to-US registration and address the problem of a need for annotated medical data for network training. Firstly, we design a data generation method to generate paired CT-US data where the spine is deformed in a physically consistent manner. Secondly, we train a point cloud (PC) registration network using anatomy-aware losses to enforce anatomically consistent predictions.

METHODS

Our proposed pipeline relies on training the network on realistic generated data. In our data generation method, we model the properties of the joints and disks between vertebrae based on biomechanical measurements in previous studies. We simulate the supine and prone position deformation by applying forces on the spine models. We choose the spine models from 35 patients in VerSe dataset. Each spine is deformed 10 times to create a noise-free data with ground-truth segmentation at hand. In our experiments, we use one-leave-out cross-validation strategy to measure the performance and the stability of the proposed method. For each experiment, we choose generated PCs from three spines as the test set. From the remaining, data from 3 spines act as the validation set and we use the rest of the data for training the algorithm. To train our network, we introduce anatomy-aware losses and constraints on the movement to match the physics of the spine, namely, rigidity loss and bio-mechanical loss. We define rigidity loss based on the fact that each vertebra can only transform rigidly while the disks and the surrounding tissue are deformable. Second, by using bio-mechanical loss we stop the network from inferring extreme movements by penalizing the force needed to get to a certain pose.

RESULTS

To validate the effectiveness of our fully automated data generation pipeline, we qualitatively assess the fidelity of the generated data. This assessment involves verifying the realism of the spinal deformation and subsequently confirming the plausibility of the simulated ultrasound images. Next, we demonstrate that the introduction of the anatomy-aware losses brings us closer to state-of-the-art (SOTA) and yields a reduction of 0.25 mm in terms of target registration error (TRE) compared to using only mean squared error (MSE) loss on the generated dataset. Furthermore, by using the proposed losses, the rigidity loss in inference decreases which shows that the inferred deformation respects the rigidity of the vertebrae and only introduces deformations in the soft tissue area to compensate the difference to the target PC. We also show that our results are close to the SOTA for the simulated US dataset with TRE of 3.89 mm and 3.63 mm for the proposed method and SOTA respectively. In addition, we show that our method is more robust against errors in the initialization in comparison to SOTA and significantly achieves better results (TRE of 4.88 mm compared to 5.66 mm) in this experiment.

CONCLUSIONS

In conclusion, we present a pipeline for spine CT-to-US registration and explore the potential benefits of utilizing anatomy-aware losses to enhance registration results. Additionally, we propose a fully automatic method to synthesize paired CT-US data with physically consistent deformations, which offers the opportunity to generate extensive datasets for network training. The generated dataset and the source code for data generation and registration pipeline can be accessed via https://github.com/mfazampour/medphys_ct_us_registration.

Ultrasound-based navigated pedicle screw insertion without intraoperative radiation: feasibility study on porcine cadavers

BACKGROUND

Navigation systems for spinal fusion surgery rely on intraoperative computed tomography (CT) or fluoroscopy imaging. Both expose patient, surgeons and operating room staff to significant amounts of radiation. Alternative methods involving intraoperative ultrasound (iUS) imaging have recently shown promise for image-to-patient registration. Yet, the feasibility and safety of iUS navigation in spinal fusion have not been demonstrated.

PURPOSE

To evaluate the accuracy of pedicle screw insertion in lumbar and thoracolumbar spinal fusion using a fully automated iUS navigation system.

STUDY DESIGN

Prospective porcine cadaver study.

METHODS

Five porcine cadavers were used to instrument the lumbar and thoracolumbar spine using posterior open surgery. During the procedure, iUS images were acquired and used to establish automatic registration between the anatomy and preoperative CT images. Navigation was performed with the preoperative CT using tracked instruments. The accuracy of the system was measured as the distance of manually collected points to the preoperative CT vertebral surface and compared against fiducial-based registration. A postoperative CT was acquired, and screw placements were manually verified. We report breach rates, as well as axial and sagittal screw deviations.

RESULTS

A total of 56 screws were inserted (5.50 mm diameter n=50, and 6.50 mm diameter n=6). Fifty-two screws were inserted safely without breach. Four screws (7.14%) presented a medial breach with an average deviation of 1.35±0.37 mm (all <2 mm). Two breaches were caused by 6.50 mm diameter screws, and two by 5.50 mm screws. For vertebrae instrumented with 5.50 mm screws, the average axial diameter of the pedicle was 9.29 mm leaving a 1.89 mm margin in the left and right pedicle. For vertebrae instrumented with 6.50 mm screws, the average axial diameter of the pedicle was 8.99 mm leaving a 1.24 mm error margin in the left and right pedicle. The average distance to the vertebral surface was 0.96 mm using iUS registration and 0.97 mm using fiducial-based registration.

CONCLUSIONS

We successfully implanted all pedicle screws in the thoracolumbar spine using the ultrasound-based navigation system. All breaches recorded were minor (<2 mm) and the breach rate (7.14%) was comparable to existing literature. More investigation is needed to evaluate consistency, reproducibility, and performance in surgical context.

CLINICAL SIGNIFICANCE

Intraoperative US-based navigation is feasible and practical for pedicle screw insertion in a porcine model. It might be used as a low-cost and radiation-free alternative to intraoperative CT and fluoroscopy in the future.

3D ultrasound navigation system for screw insertion in posterior spine surgery: a phantom study

PURPOSE

Posterior spinal fusion surgery is required to correct severe idiopathic scoliosis. The surgery involves insertion of screws which requires high accuracy to prevent neurologic damage to the spinal cord. Although conventional CT navigation can reduce this risk, 3D-ultrasound-based navigation could achieve this without added ionizing radiation and usage of expensive and bulky equipment. This study aimed to evaluate the accuracy of a 3D ultrasound navigation system for posterior spine surgery.

METHODS

A custom 3D ultrasound (3DUS) with model-to-surface registration algorithm was developed and integrated into a 3D navigation environment. A CT scan of an adolescent spine (T3-T11) was segmented and 3D printed for experiments. A probe with reflective markers was placed in vertebral pedicles 684 times in varying levels, positions in the capture space and orientation of vertebra, and the entrypoint and trajectory accuracies were measured.

RESULTS

Among 684 probe placements in vertebral levels T3 to T11 in the phantom spine, 95.5% were within 1 mm and 5° of accuracy, with an average accuracy of 0.4 ± 0.4 mm and 2.1 ± 0.9°, requiring 8.8 s to process. Accuracies were statistically significantly affected by vertebral orientation and position in the capture volume, though this was still within the targeted accuracies of 1 mm and 5°.

CONCLUSION

This preliminary ultrasound-based navigation system is accurate and fast enough for guiding placement of pedicle screws into the spine in posterior fusion surgery. The current results are limited to phantom spines, and future study in animal or human cadavers is needed to investigate soft tissue effects on registration accuracy.

Open-source software for ultrasound-based guidance in spinal fusion surgery

Spinal instrumentation and surgical manipulations may cause loss of navigation accuracy requiring an efficient re-alignment of the patient anatomy with pre-operative images during surgery. While intra-operative ultrasound (iUS) guidance has shown clear potential to reduce surgery time, compared with clinical computed tomography (CT) guidance, rapid registration aiming to correct for patient misalignment has not been addressed. In this article, we present an open-source platform for pedicle screw navigation using iUS imaging. The alignment method is based on rigid registration of CT to iUS vertebral images and has been designed for fast and fully automatic patient re-alignment in the operating room. Two steps are involved: first, we use the iUS probe's trajectory to achieve an initial coarse registration; then, the registration transform is refined by simultaneously optimizing gradient orientation alignment and mean of iUS intensities passing through the CT-defined posterior surface of the vertebra. We evaluated our approach on a lumbosacral section of a porcine cadaver with seven vertebral levels. We achieved a median target registration error of 1.47 mm (100% success rate, defined by a target registration error <2 mm) when applying the probe's trajectory initial alignment. The approach exhibited high robustness to partial visibility of the vertebra with success rates of 89.86% and 88.57% when missing either the left or right part of the vertebra and robustness to initial misalignments with a success rate of 83.14% for random starts within ±20° rotation and ±20 mm translation. Our graphics processing unit implementation achieves an efficient registration time under 8 s, which makes the approach suitable for clinical application.

The state-of-the-art in ultrasound-guided spine interventions

During the last two decades, intra-operative ultrasound (iUS) imaging has been employed for various surgical procedures of the spine, including spinal fusion and needle injections. Accurate and efficient registration of pre-operative computed tomography or magnetic resonance images with iUS images are key elements in the success of iUS-based spine navigation. While widely investigated in research, iUS-based spine navigation has not yet been established in the clinic. This is due to several factors including the lack of a standard methodology for the assessment of accuracy, robustness, reliability, and usability of the registration method. To address these issues, we present a systematic review of the state-of-the-art techniques for iUS-guided registration in spinal image-guided surgery (IGS). The review follows a new taxonomy based on the four steps involved in the surgical workflow that include pre-processing, registration initialization, estimation of the required patient to image transformation, and a visualization process. We provide a detailed analysis of the measurements in terms of accuracy, robustness, reliability, and usability that need to be met during the evaluation of a spinal IGS framework. Although this review is focused on spinal navigation, we expect similar evaluation criteria to be relevant for other IGS applications.

Ultrasound Bone Segmentation: A Scoping Review of Techniques and Validation Practices

Ultrasound bone segmentation is an important yet challenging task for many clinical applications. Several works have emerged attempting to improve and automate bone segmentation, which has led to a variety of computational techniques, validation practices and applied clinical scenarios. We characterize this exciting and growing body of research by reviewing published ultrasound bone segmentation techniques. We review 56 articles in detail and categorize and discuss the image analysis techniques that have been used for bone segmentation. We highlight the general trends of this field in terms of clinical motivation, image analysis techniques, ultrasound modalities and the types of validation practices used to quantify segmentation performance. Finally, we present an outlook on promising areas of research based on the unaddressed needs for solving ultrasound bone segmentation.

3D Ultrasound for Orthopedic Interventions

Ultrasound is a real-time, non-radiation-based imaging modality with an ability to acquire two-dimensional (2D) and three-dimensional (3D) data. Due to these capabilities, research has been carried out in order to incorporate it as an intraoperative imaging modality for various orthopedic surgery procedures. However, high levels of noise, different imaging artifacts, and bone surfaces appearing blurred with several mm in thickness have prohibited the widespread use of ultrasound as a standard of care imaging modality in orthopedics. In this chapter, we provided a detailed overview of numerous applications of 3D ultrasound in the domain of orthopedic surgery. Specifically, we discuss the advantages and disadvantages of methods proposed for segmentation and enhancement of bone ultrasound data and the successful application of these methods in clinical domain. Finally, a number of challenges are identified which need to be overcome in order for ultrasound to become a preferred imaging modality in orthopedics.

Accumulated Angle Factor-Based Beamforming to Improve the Visualization of Spinal Structures in Ultrasound Images

In recent years, ultrasound has been increasingly used to guide needle insertion procedures for spinal anesthesia. The primary anatomical targets are facet joints and epidural spaces. For these procedures, accurate visualization of the spine anatomy is of critical importance. Challenges arising from the interactions between the ultrasound beam and spinal structures including tilt caused by specular reflections, off-axis interference, and reverberations often result in weakened and blurred vertebra surfaces. Previously, adaptive beamforming methods have been proposed to improve the resolution and contrast. However, most of these methods are not specialized for improving the contrast of specular targets like bones. In this paper, we propose an accumulated angle factor (AAF)-based beamforming method customized for bone surface enhancement. This approach applies a Hilbert transform on delay compensated channel data across the receive aperture. The accumulated phase change across the receive aperture is then calculated and utilized as the weight in the beamforming output. We compared our method with classical delay and sum (DAS) beamforming method and adaptive beamforming methods such as Wiener, phase coherence factor (PCF), CF, and generalized CF (GCF) beamforming. In 12 volunteer data sets, the mean contrast ratio between the vertebrae surface and the surrounding tissue for DAS, Wiener, PCF, CF, GCF, and the proposed AAF methods are 0.49, 0.64, 0.82, 0.77, 0.76, and 0.91, respectively. The contrast is significantly improved in the proposed method.

Ultrasound imaging and segmentation of bone surfaces: A review

Due to its real-time, non-radiation based three-dimensional (3D) imaging capabilities, ultrasound (US) has been incorporated into various orthopedic procedures. However, imaging artifacts, low signal-to-noise ratio (SNR) and bone boundaries appearing several mm in thickness make the analysis of US data difficult. This paper provides a review about the state-of-the-art bone segmentation and enhancement methods developed for two-dimensional (2D) and 3D US data. First, an overview for the appearance of bone surface response in B-mode data is presented. Then, classification of the proposed techniques in terms of the image information being used is provided. Specifically, the focus is given on segmentation and enhancement of B-mode US data. The review is concluded by discussing future directions of research and additional challenges which need to be overcome in order to make this imaging modality more successful in orthopedics.

Biomechanically Constrained Surface Registration: Application to MR-TRUS Fusion for Prostate Interventions

In surface-based registration for image-guided interventions, the presence of missing data can be a significant issue. This often arises with real-time imaging modalities such as ultrasound, where poor contrast can make tissue boundaries difficult to distinguish from surrounding tissue. Missing data poses two challenges: ambiguity in establishing correspondences; and extrapolation of the deformation field to those missing regions. To address these, we present a novel non-rigid registration method. For establishing correspondences, we use a probabilistic framework based on a Gaussian mixture model (GMM) that treats one surface as a potentially partial observation. To extrapolate and constrain the deformation field, we incorporate biomechanical prior knowledge in the form of a finite element model (FEM). We validate the algorithm, referred to as GMM-FEM, in the context of prostate interventions. Our method leads to a significant reduction in target registration error (TRE) compared to similar state-of-the-art registration algorithms in the case of missing data up to 30%, with a mean TRE of 2.6 mm. The method also performs well when full segmentations are available, leading to TREs that are comparable to or better than other surface-based techniques. We also analyze robustness of our approach, showing that GMM-FEM is a practical and reliable solution for surface-based registration.

Detection and visualization of dural pulsation for spine needle interventions

PURPOSE

Epidural and spinal anesthesia are common procedures that require a needle to be inserted into the patient's spine to deliver an anesthetic. Traditionally, these procedures were performed without image guidance, using only palpation to identify the correct vertebral interspace. More recently, ultrasound has seen widespread use in guiding spinal needle interventions. Dural pulsation is a valuable cue for finding a path through the vertebral interspace and for determining needle insertion depth. However, dural pulsation is challenging to detect and not perceptible in many cases. Here, a method for automatically detecting very subtle dural pulsation from live ultrasound video is presented.

METHODS

A periodic model is fit to the B-mode intenstity values through extended Kalman filtering. The fitted frequencies and amplitudes are used to detect and visualize dural pulsation. The method is validated retrospectively on synthetic and human video and used in real time on an interventional spinal phantom.

RESULTS

This method was capable of quickly identifying subtle dural pulsation and was robust to background noise and motion. The pulsation visualization reduced both the normalized path length and number of attempts required in a mock epidural procedure.

CONCLUSION

This technique is able to localize the dura and help find a clear needle trajectory to the epidural space. It can be run in real time on commercial ultrasound systems and has the potential to improve ultrasound guidance of spine needle interventions.

Local phase tensor features for 3-D ultrasound to statistical shape+pose spine model registration

Most conventional spine interventions are performed under X-ray fluoroscopy guidance. In recent years, there has been a growing interest to develop nonionizing imaging alternatives to guide these procedures. Ultrasound guidance has emerged as a leading alternative. However, a challenging problem is automatic identification of the spinal anatomy in ultrasound data. In this paper, we propose a local phase-based bone feature enhancement technique that can robustly identify the spine surface in ultrasound images. The local phase information is obtained using a gradient energy tensor filter. This information is used to construct local phase tensors in ultrasound images, which highlight the spine surface. We show that our proposed approach results in a more distinct enhancement of the bone surfaces compared to recently proposed techniques based on monogenic scale-space filters and logarithmic Gabor filters. We also demonstrate that registration accuracy of a statistical shape+pose model of the spine to 3-D ultrasound images can be significantly improved, using the proposed method, compared to those obtained using monogenic scale-space filters and logarithmic Gabor filters.

Tracked ultrasound snapshots in percutaneous pedicle screw placement navigation: a feasibility study

BACKGROUND

Computerized navigation improves the accuracy of minimally invasive pedicle screw placement during spine surgery. Such navigation, however, exposes both the patient and the staff to radiation during surgery. To avoid intraoperative exposure to radiation, tracked ultrasound snapshots-ultrasound image frames coupled with corresponding spatial positions-could be used to map preoperatively defined screw plans into the intraoperative coordinate frame. The feasibility of such an approach, however, has not yet been investigated.

QUESTIONS/PURPOSES

Are there vertebral landmarks that can be identified using tracked ultrasound snapshots? Can tracked ultrasound snapshots allow preoperative pedicle screw plans to be accurately mapped--compared with CT-derived pedicle screw plans--into the intraoperative coordinate frame in a simulated setting?

METHODS

Ultrasound visibility of registration landmarks was checked on volunteers and phantoms. An ultrasound machine with integrated electromagnetic tracking was used for tracked ultrasound acquisition. Registration was performed using 3D Slicer open-source software (www.slicer.org). Two artificial lumbar spine phantoms were used to evaluate registration accuracy of pedicle screw plans using tracked ultrasound snapshots. Registration accuracy was determined by comparing the ultrasound-derived plans with the CT-derived plans.

RESULTS

The four articular processes proved to be identifiable using tracked ultrasound snapshots. Pedicle screw plans were registered to the intraoperative coordinate system using landmarks. The registrations were sufficiently accurate in that none of the registered screw plans intersected the pedicle walls. Registered screw plan positions had an error less than 1.28 ± 1.37 mm (average ± SD) in each direction and an angle difference less than 1.92° ± 1.95° around each axis relative to the CT-derived positions.

CONCLUSIONS

Registration landmarks could be located using tracked ultrasound snapshots and permitted accurate mapping of pedicle screw plans to the intraoperative coordinate frame in a simulated setting.

CLINICAL RELEVANCE

Tracked ultrasound may allow accurate computer-navigated pedicle screw placement while avoiding ionizing radiation in the operating room; however, further studies that compare this approach with other navigation techniques are needed to confirm the practical use of this new approach.

MRI and ultrasound fusion imaging for prenatal diagnosis

OBJECTIVE

A combination of magnetic resonance imaging (MRI) images with real time high-resolution ultrasound known as fusion imaging may improve prenatal examination. This study was undertaken to evaluate the feasibility of using fusion of MRI and ultrasound (US) in prenatal imaging.

STUDY DESIGN

This study was conducted in a tertiary referral center. All patients referred for prenatal MRI were offered to undergo fusion of MRI and US examination. All cases underwent 1.5 Tesla MRI protocol including at least 3 T2-weighted planes. The Digital Imaging and Communications in Medicine volume dataset was then loaded into the US system for manual registration of the live US image and fusion imaging examination.

RESULTS

Over the study period, 24 patients underwent fusion imaging at a median gestational age of 31 (range, 24-35) weeks. Data registration, matching and then volume navigation was feasible in all cases. Fusion imaging allowed superimposing MRI and US images therefore providing with real time imaging capabilities and high tissue contrast. It also allowed adding a real time Doppler signal on MRI images. Significant fetal movement required repeat-registration in 15 (60%) cases. The average duration of the overall additional scan with fusion imaging was 10 ± 5 minutes.

CONCLUSION

The combination of fetal real time MRI and US image fusion and navigation is feasible. Multimodality fusion imaging may enable easier and more extensive prenatal diagnosis.