New prototype neuronavigation system based on preoperative imaging and intraoperative freehand ultrasound: system description and validation

Multimodal registration of ultrasound and MR images using weighted self-similarity structure vector

PROPOSE

Multimodal registration of 2D Ultrasound (US) and 3D Magnetic Resonance (MR) for fusion navigation can improve the intraoperative detection accuracy of lesion. However, multimodal registration remains a challenge because of the poor US image quality. In the study, a weighted self-similarity structure vector (WSSV) is proposed to registrate multimodal images.

METHOD

The self-similarity structure vector utilizes the normalized distance of symmetrically located patches in the neighborhood to describe the local structure information. The texture weights are extracted using the local standard deviation to reduce the speckle interference in the US images. The multimodal similarity metric is constructed by combining a self-similarity structure vector with a texture weight map.

RESULTS

Experiments were performed on US and MR images of the liver from 88 groups of data including 8 patients and 80 simulated samples. The average target registration error was reduced from 14.91 ± 3.86 mm to 4.95 ± 2.23 mm using the WSSV-based method.

CONCLUSIONS

The experimental results show that the WSSV-based registration method could robustly align the US and MR images of the liver. With further acceleration, the registration framework can be potentially applied in time-sensitive clinical settings, such as US-MR image registration in image-guided surgery.

Recent Advances in Tracking Devices for Biomedical Ultrasound Imaging Applications

With the rapid advancement of tracking technologies, the applications of tracking systems in ultrasound imaging have expanded across a wide range of fields. In this review article, we discuss the basic tracking principles, system components, performance analyses, as well as the main sources of error for popular tracking technologies that are utilized in ultrasound imaging. In light of the growing demand for object tracking, this article explores both the potential and challenges associated with different tracking technologies applied to various ultrasound imaging applications, including freehand 3D ultrasound imaging, ultrasound image fusion, ultrasound-guided intervention and treatment. Recent development in tracking technology has led to increased accuracy and intuitiveness of ultrasound imaging and navigation with less reliance on operator skills, thereby benefiting the medical diagnosis and treatment. Although commercially available tracking systems are capable of achieving sub-millimeter resolution for positional tracking and sub-degree resolution for orientational tracking, such systems are subject to a number of disadvantages, including high costs and time-consuming calibration procedures. While some emerging tracking technologies are still in the research stage, their potentials have been demonstrated in terms of the compactness, light weight, and easy integration with existing standard or portable ultrasound machines.

Ultrasound-based navigated pedicle screw insertion without intraoperative radiation: feasibility study on porcine cadavers

BACKGROUND

Navigation systems for spinal fusion surgery rely on intraoperative computed tomography (CT) or fluoroscopy imaging. Both expose patient, surgeons and operating room staff to significant amounts of radiation. Alternative methods involving intraoperative ultrasound (iUS) imaging have recently shown promise for image-to-patient registration. Yet, the feasibility and safety of iUS navigation in spinal fusion have not been demonstrated.

PURPOSE

To evaluate the accuracy of pedicle screw insertion in lumbar and thoracolumbar spinal fusion using a fully automated iUS navigation system.

STUDY DESIGN

Prospective porcine cadaver study.

METHODS

Five porcine cadavers were used to instrument the lumbar and thoracolumbar spine using posterior open surgery. During the procedure, iUS images were acquired and used to establish automatic registration between the anatomy and preoperative CT images. Navigation was performed with the preoperative CT using tracked instruments. The accuracy of the system was measured as the distance of manually collected points to the preoperative CT vertebral surface and compared against fiducial-based registration. A postoperative CT was acquired, and screw placements were manually verified. We report breach rates, as well as axial and sagittal screw deviations.

RESULTS

A total of 56 screws were inserted (5.50 mm diameter n=50, and 6.50 mm diameter n=6). Fifty-two screws were inserted safely without breach. Four screws (7.14%) presented a medial breach with an average deviation of 1.35±0.37 mm (all <2 mm). Two breaches were caused by 6.50 mm diameter screws, and two by 5.50 mm screws. For vertebrae instrumented with 5.50 mm screws, the average axial diameter of the pedicle was 9.29 mm leaving a 1.89 mm margin in the left and right pedicle. For vertebrae instrumented with 6.50 mm screws, the average axial diameter of the pedicle was 8.99 mm leaving a 1.24 mm error margin in the left and right pedicle. The average distance to the vertebral surface was 0.96 mm using iUS registration and 0.97 mm using fiducial-based registration.

CONCLUSIONS

We successfully implanted all pedicle screws in the thoracolumbar spine using the ultrasound-based navigation system. All breaches recorded were minor (<2 mm) and the breach rate (7.14%) was comparable to existing literature. More investigation is needed to evaluate consistency, reproducibility, and performance in surgical context.

CLINICAL SIGNIFICANCE

Intraoperative US-based navigation is feasible and practical for pedicle screw insertion in a porcine model. It might be used as a low-cost and radiation-free alternative to intraoperative CT and fluoroscopy in the future.

Integrated multi-modality image-guided navigation for neurosurgery: open-source software platform using state-of-the-art clinical hardware

PURPOSE

Image-guided surgery (IGS) is an integral part of modern neuro-oncology surgery. Navigated ultrasound provides the surgeon with reconstructed views of ultrasound data, but no commercial system presently permits its integration with other essential non-imaging-based intraoperative monitoring modalities such as intraoperative neuromonitoring. Such a system would be particularly useful in skull base neurosurgery.

METHODS

We established functional and technical requirements of an integrated multi-modality IGS system tailored for skull base surgery with the ability to incorporate: (1) preoperative MRI data and associated 3D volume reconstructions, (2) real-time intraoperative neurophysiological data and (3) live reconstructed 3D ultrasound. We created an open-source software platform to integrate with readily available commercial hardware. We tested the accuracy of the system's ultrasound navigation and reconstruction using a polyvinyl alcohol phantom model and simulated the use of the complete navigation system in a clinical operating room using a patient-specific phantom model.

RESULTS

Experimental validation of the system's navigated ultrasound component demonstrated accuracy of [Formula: see text] and a frame rate of 25 frames per second. Clinical simulation confirmed that system assembly was straightforward, could be achieved in a clinically acceptable time of [Formula: see text] and performed with a clinically acceptable level of accuracy.

CONCLUSION

We present an integrated open-source research platform for multi-modality IGS. The present prototype system was tailored for neurosurgery and met all minimum design requirements focused on skull base surgery. Future work aims to optimise the system further by addressing the remaining target requirements.

Evaluation of an Ultrasound-Based Navigation System for Spine Neurosurgery: A Porcine Cadaver Study

BACKGROUND

With the growing incidence of patients receiving surgical treatment for spinal metastatic tumours, there is a need for developing cost-efficient and radiation-free alternatives for spinal interventions. In this paper, we evaluate the capabilities and limitations of an image-guided neurosurgery (IGNS) system that uses intraoperative ultrasound (iUS) imaging for guidance.

METHODS

Using a lumbosacral section of a porcine cadaver, we explored the impact of CT image resolution, ultrasound depth and ultrasound frequency on system accuracy, robustness and effectiveness. Preoperative CT images with an isotropic resolution of , and were acquired. During surgery, vertebrae L1 to L6 were exposed. For each vertebra, five iUS scans were acquired using two depth parameters (5 cm and 7 cm) and two frequencies (6 MHz and 12 MHz). A total of 120 acquisition trials were evaluated. Ultrasound-based registration performance is compared to the standard alignment procedure using intraoperative CT. We report target registration error (TRE) and computation time. In addition, the scans' trajectories were analyzed to identify vertebral regions that provide the most relevant features for the alignment.

RESULTS

For all acquisitions, the median TRE ranged from 1.42 mm to 1.58 mm and the overall computation time was 9.04 s ± 1.58 s. Fourteen out of 120 iUS acquisitions (11.66%) yielded a level-to-level mismatch (and these are included in the accuracy measurements reported). No significant effect on accuracy was found with CT resolution (F (2,10) = 1.70, p = 0.232), depth (F (1,5) = 0.22, p= 0.659) nor frequency (F (1,5) = 1.02, p = 0.359). While misalignment increases linearly with the distance from the imaged vertebra, accuracy was satisfactory for directly adjacent levels. A significant relationship was found between iUS scan coverage of laminae and articular processes, and accuracy.

CONCLUSION

Intraoperative ultrasound can be used for spine surgery neuronavigation. We demonstrated that the IGNS system yield acceptable accuracy and high efficiency compared to the standard CT-based navigation procedure. The flexibility of the iUS acquisitions can have repercussions on the system performance, which are not fully identified. Further investigation is needed to understand the relationship between iUS acquisition and alignment performance.

A fast technique for hyper-echoic region separation from brain ultrasound images using patch based thresholding and cubic B-spline based contour smoothing

Ultrasound image guided brain surgery (UGBS) requires an automatic and fast image segmentation method. The level-set and active contour based algorithms have been found to be useful for obtaining topology-independent boundaries between different image regions. But slow convergence limits their use in online US image segmentation. The performance of these algorithms deteriorates on US images because of the intensity inhomogeneity. This paper proposes an effective region-driven method for the segmentation of hyper-echoic (HE) regions suppressing the hypo-echoic and anechoic regions in brain US images. An automatic threshold estimation scheme is developed with a modified Niblack's approach. The separation of the hyper-echoic and non-hyper-echoic (NHE) regions is performed by successively applying patch based intensity thresholding and boundary smoothing. First, a patch based segmentation is performed, which separates roughly the two regions. The patch based approach in this process reduces the effect of intensity heterogeneity within an HE region. An iterative boundary correction step with reducing patch size improves further the regional topology and refines the boundary regions. For avoiding the slope and curvature discontinuities and obtaining distinct boundaries between HE and NHE regions, a cubic B-spline model of curve smoothing is applied. The proposed method is 50-100 times faster than the other level-set based image segmentation algorithms. The segmentation performance and the convergence speed of the proposed method are compared with four other competing level-set based algorithms. The computational results show that the proposed segmentation approach outperforms other level-set based techniques both subjectively and objectively.

Open-source software for ultrasound-based guidance in spinal fusion surgery

Spinal instrumentation and surgical manipulations may cause loss of navigation accuracy requiring an efficient re-alignment of the patient anatomy with pre-operative images during surgery. While intra-operative ultrasound (iUS) guidance has shown clear potential to reduce surgery time, compared with clinical computed tomography (CT) guidance, rapid registration aiming to correct for patient misalignment has not been addressed. In this article, we present an open-source platform for pedicle screw navigation using iUS imaging. The alignment method is based on rigid registration of CT to iUS vertebral images and has been designed for fast and fully automatic patient re-alignment in the operating room. Two steps are involved: first, we use the iUS probe's trajectory to achieve an initial coarse registration; then, the registration transform is refined by simultaneously optimizing gradient orientation alignment and mean of iUS intensities passing through the CT-defined posterior surface of the vertebra. We evaluated our approach on a lumbosacral section of a porcine cadaver with seven vertebral levels. We achieved a median target registration error of 1.47 mm (100% success rate, defined by a target registration error <2 mm) when applying the probe's trajectory initial alignment. The approach exhibited high robustness to partial visibility of the vertebra with success rates of 89.86% and 88.57% when missing either the left or right part of the vertebra and robustness to initial misalignments with a success rate of 83.14% for random starts within ±20° rotation and ±20 mm translation. Our graphics processing unit implementation achieves an efficient registration time under 8 s, which makes the approach suitable for clinical application.

Intraoperative Imaging for High-Grade Glioma Surgery

This article discusses intraoperative imaging techniques used during high-grade glioma surgery. Gliomas can be difficult to differentiate from surrounding tissue during surgery. Intraoperative imaging helps to alleviate problems encountered during glioma surgery, such as brain shift and residual tumor. There are a variety of modalities available all of which aim to give the surgeon more information, address brain shift, identify residual tumor, and increase the extent of surgical resection. The article starts with a brief introduction followed by a review of with the latest advances in intraoperative ultrasound, intraoperative MRI, and intraoperative computed tomography.

Image-Guided Brain Surgery

In neurosurgery, the extent of resection plays a critical role, especially in the management of malignant gliomas. These tumors are characterized through a diffuse infiltration into the surrounding brain parenchyma. Delineation between tumor and normal brain parenchyma can therefore often be challenging. During the recent years, several techniques, aiming at better intraoperative tumor visualization, have been developed and implemented in the field of brain tumor surgery. In this chapter, we discuss current strategies for intraoperative imaging in brain tumor surgery, comprising conventional techniques such as neuronavigation, techniques using fluorescence-guided surgery, and further highly precise developments such as targeted fluorescence spectroscopy or Raman spectroscopy.

Enhanced Regional Functional Connectivity Indicates Seizure Onset Zone

This project aims to explore if stronger functional connectivity (FC) exists in the maximal BOLD response of EEG/fMRI analysis when it is concordant with seizure-onset-zone (SOZ). Twenty-six patients with drug-resistant focal epilepsy who had an EEG/fMRI and later underwent stereo-EEG implantation were included. Different types of IEDs were labeled in scalp EEG and IED-related maximal BOLD responses were evaluated separately, each constituting one study. After evaluating concordance between maximal BOLD and SOZ, twenty-seven studies were placed in the concordant group and eight in the discordant group. We evaluated the local connectivity and ipsilaterally distant connectivity difference between the maximal BOLD and the contralateral homotopic region. Significantly stronger local FC was found for the maximal BOLD in the concordant group (p < 0.05, Bonferroni corrected). 52% of the studies in the concordant group and 13% in the discordant group had a significant difference compared to healthy subjects (p < 0.05, uncorrected). The finding suggests that, when concordant with the SOZ, the maximal BOLD is more likely to have stronger local FC compared to its contralateral counterpart. This asymmetry in functional connectivity may help to noninvasively improve the specificity of EEG/fMRI analysis.

Deformable MRI-Ultrasound registration using correlation-based attribute matching for brain shift correction: Accuracy and generality in multi-site data

Intraoperative tissue deformation, known as brain shift, decreases the benefit of using preoperative images to guide neurosurgery. Non-rigid registration of preoperative magnetic resonance (MR) to intraoperative ultrasound (iUS) has been proposed as a means to compensate for brain shift. We focus on the initial registration from MR to predurotomy iUS. We present a method that builds on previous work to address the need for accuracy and generality of MR-iUS registration algorithms in multi-site clinical data. High-dimensional texture attributes were used instead of image intensities for image registration and the standard difference-based attribute matching was replaced with correlation-based attribute matching. A strategy that deals explicitly with the large field-of-view mismatch between MR and iUS images was proposed. Key parameters were optimized across independent MR-iUS brain tumor datasets acquired at 3 institutions, with a total of 43 tumor patients and 758 reference landmarks for evaluating the accuracy of the proposed algorithm. Despite differences in imaging protocols, patient demographics and landmark distributions, the algorithm is able to reduce landmark errors prior to registration in three data sets (5.37±4.27, 4.18±1.97 and 6.18±3.38 mm, respectively) to a consistently low level (2.28±0.71, 2.08±0.37 and 2.24±0.78 mm, respectively). This algorithm was tested against 15 other algorithms and it is competitive with the state-of-the-art on multiple datasets. We show that the algorithm has one of the lowest errors in all datasets (accuracy), and this is achieved while sticking to a fixed set of parameters for multi-site data (generality). In contrast, other algorithms/tools of similar performance need per-dataset parameter tuning (high accuracy but lower generality), and those that stick to fixed parameters have larger errors or inconsistent performance (generality but not the top accuracy). Landmark errors were further characterized according to brain regions and tumor types, a topic so far missing in the literature.

fMRI functional connectivity as an indicator of interictal epileptic discharges

•

Functional connectivity to successful EEG/fMRI response indicates higher IED rates.

•

The results hold when correcting for distance to maximum EEG-fMRI and laterality.

•

Intracranial IED rates correlate with functional connectivity to EEG/fMRI maxima.

•

Results suggest it is feasible to non-invasively infer the brain regions with IEDs.

Objective

To explore the relationship between functional connectivity and presence of interictal epileptic discharges (IEDs) in different brain regions in intracranial EEG (iEEG).

Methods

We studied 38 focal epilepsy patients who underwent simultaneous EEG/fMRI scanning and subsequent intracerebral stereo-EEG investigation. In EEG/fMRI analysis, IEDs with different spatial distributions were considered independent studies and IED-related maximal BOLD responses were evaluated. Studies with iEEG electrodes inside the maximal responses were selected and divided into three groups: Studies with 1. distinct maximal BOLD highly concordant with seizure-onset-zone (SOZ); 2. Moderate maximal BOLD concordant with SOZ; 3. maximal BOLD discordant with SOZ. Using maximal BOLD as seed, its functionally connected zone (FCZ) was determined. IED rates in iEEG channels inside and outside the FCZ were compared in the three groups. The effect of laterality and distance between channels and maximal BOLD, and correlation between functional connectivity values and IED rates were analyzed.

Results

Thirty-six studies in 25 patients were included. IED rates of intracranial EEG channels inside the FCZ were significantly higher than outside in Group 1 (p = 2.6×10−6) and Group 2 (p = 1.2×10−3) and the inside-outside difference remained after regressing distance and laterality factors. In Group 1, connectivity values were significantly correlated with IED rates in channels inside the FCZ (p < 0.05).

Significance

Our results indicate a higher probability of finding intracranial IEDs in the FCZ of SOZ-concordant maximal BOLD responses than in other regions, regardless of distance and laterality. In studies with distinct maximal BOLD, connectivity values can partially predict IED rates in intracranial EEG. It is thus feasible to non-invasively delineate brain regions that are likely to have high IED rates.

Internodular functional connectivity in heterotopia-related epilepsy

Objective

A vast network involving the nodules and overlying cortices is believed to be responsible for the epileptogenicity in gray matter heterotopia with multiple nodules, which often associated with difficult‐to‐treat epilepsy. We sought to determine if functional magnetic resonance imaging (fMRI) could detect internodular functional connectivity (FC), and if this connectivity reflects an actual synchronized neuronal activity and partakes in epileptogenicity.

Methods

We studied 16 epilepsy patients with multiple heterotopic nodules; eight underwent subsequent intracerebral EEG. We examined the internodular FC using fMRI and its correspondence with internodular synchrony of intracerebral interictal activity. We then compared the spreading speed of ictal activity between connected and unconnected nodules; and the FC among possible combinations of nodule pairs in terms of their involvement at seizure onset.

Results

Seventy nodules were studied: 83% have significant connection to at least one other nodule. Among the 49 pairs studied with intracerebral EEG, (1) synchronized interictal activity is more prevalent in fMRI‐connected pairs (P < 0.05), (2) ictal activity spreads faster between connected pairs (P < 0.0001), and (3) stronger FC was observed between pairs in which both nodules were involved at seizure onset (P < 0.01).

Interpretation

fMRI could reliably and noninvasively detect the FC between heterotopic nodules. These functional connections correspond to the synchrony of interictal epileptic activity between the nodules and to the ability of nodules to generate synchronous seizure onsets or rapid seizure spread. These findings may help in understanding the complexity of the epileptogenic network in multiple heterotopic nodules and better targeting the likely epileptogenic nodules.

The spike onset zone: The region where epileptic spikes start and from where they propagate

OBJECTIVE

To determine whether the maximum hemodynamic response to scalp interictal epileptic discharges (IEDs) corresponds to the region where IEDs originate and from where they propagate.

METHODS

We studied 19 patients who underwent first an EEG-fMRI showing responses in the gray matter, and then intracranial EEG (iEEG). We coregistered the hemodynamic responses to the iEEG electrode contacts and analyzed IEDs in the iEEG channel adjacent to a maximum response (labeled the main channel), in relation to IEDs in other channels during a widespread intracranial IED event. IEDs in the main channel were aligned at their peak, and IEDs in each channel were averaged time-locked to these instants. The beginning and peak of IEDs in the averaged trace were identified, blinded to the identity of the main channel. The latency of IEDs was computed between the earliest and all other channels.

RESULTS

The median latency of IEDs in the main channel was significantly smaller than in other channels for either the peak (15.5 vs 67.5 milliseconds, p = 0.00037) or the beginning (46.5 vs 118.4 milliseconds, p = 0.000048). The latency of IED was significantly correlated to the distance from the maximum hemodynamic response (p < 0.0001 for either the peak or the beginning).

CONCLUSION

IED adjacent to a maximum hemodynamic response, which often corresponds to the seizure onset zone, is more likely to precede IEDs in remote locations during a widespread intracranial discharge. Thus, EEG-fMRI is a unique noninvasive method to reveal the origin of IEDs, which we propose to label the spike onset zone.

Combining intraoperative ultrasound brain shift correction and augmented reality visualizations: a pilot study of eight cases

We present our work investigating the feasibility of combining intraoperative ultrasound for brain shift correction and augmented reality (AR) visualization for intraoperative interpretation of patient-specific models in image-guided neurosurgery (IGNS) of brain tumors. We combine two imaging technologies for image-guided brain tumor neurosurgery. Throughout surgical interventions, AR was used to assess different surgical strategies using three-dimensional (3-D) patient-specific models of the patient's cortex, vasculature, and lesion. Ultrasound imaging was acquired intraoperatively, and preoperative images and models were registered to the intraoperative data. The quality and reliability of the AR views were evaluated with both qualitative and quantitative metrics. A pilot study of eight patients demonstrates the feasible combination of these two technologies and their complementary features. In each case, the AR visualizations enabled the surgeon to accurately visualize the anatomy and pathology of interest for an extended period of the intervention. Inaccuracies associated with misregistration, brain shift, and AR were improved in all cases. These results demonstrate the potential of combining ultrasound-based registration with AR to become a useful tool for neurosurgeons to improve intraoperative patient-specific planning by improving the understanding of complex 3-D medical imaging data and prolonging the reliable use of IGNS.

Freehand 3-D Ultrasound Imaging: A Systematic Review

Two-dimensional ultrasound (US) imaging has been successfully used in clinical applications as a low-cost, portable and non-invasive image modality for more than three decades. Recent advances in computer science and technology illustrate the promise of the 3-D US modality as a medical imaging technique that is comparable to other prevalent modalities and that overcomes certain drawbacks of 2-D US. This systematic review covers freehand 3-D US imaging between 1970 and 2017, highlighting the current trends in research fields, the research methods, the main limitations, the leading researchers, standard assessment criteria and clinical applications. Freehand 3-D US systems are more prevalent in the academic environment, whereas in clinical applications and industrial research, most studies have focused on 3-D US transducers and improvement of hardware performance. This topic is still an interesting active area for researchers, and there remain many unsolved problems to be addressed.

A combined registration and finite element analysis method for fast estimation of intraoperative brain shift; phantom and animal model study

BACKGROUND

Finite element models for estimation of intraoperative brain shift suffer from huge computational cost. In these models, image registration and finite element analysis are two time-consuming processes.

METHODS

The proposed method is an improved version of our previously developed Finite Element Drift (FED) registration algorithm. In this work the registration process is combined with the finite element analysis. In the Combined FED (CFED), the deformation of whole brain mesh is iteratively calculated by geometrical extension of a local load vector which is computed by FED.

RESULTS

While the processing time of the FED-based method including registration and finite element analysis was about 70 s, the computation time of the CFED was about 3.2 s. The computational cost of CFED is almost 50% less than similar state of the art brain shift estimators based on finite element models.

CONCLUSIONS

The proposed combination of registration and structural analysis can make the calculation of brain deformation much faster.

Brain shift in neuronavigation of brain tumors: A review

PURPOSE

Neuronavigation based on preoperative imaging data is a ubiquitous tool for image guidance in neurosurgery. However, it is rendered unreliable when brain shift invalidates the patient-to-image registration. Many investigators have tried to explain, quantify, and compensate for this phenomenon to allow extended use of neuronavigation systems for the duration of surgery. The purpose of this paper is to present an overview of the work that has been done investigating brain shift.

METHODS

A review of the literature dealing with the explanation, quantification and compensation of brain shift is presented. The review is based on a systematic search using relevant keywords and phrases in PubMed. The review is organized based on a developed taxonomy that classifies brain shift as occurring due to physical, surgical or biological factors.

RESULTS

This paper gives an overview of the work investigating, quantifying, and compensating for brain shift in neuronavigation while describing the successes, setbacks, and additional needs in the field. An analysis of the literature demonstrates a high variability in the methods used to quantify brain shift as well as a wide range in the measured magnitude of the brain shift, depending on the specifics of the intervention. The analysis indicates the need for additional research to be done in quantifying independent effects of brain shift in order for some of the state of the art compensation methods to become useful.

CONCLUSION

This review allows for a thorough understanding of the work investigating brain shift and introduces the needs for future avenues of investigation of the phenomenon.

Applications of Ultrasound in the Resection of Brain Tumors

Neurosurgery makes use of preoperative imaging to visualize pathology, inform surgical planning, and evaluate the safety of selected approaches. The utility of preoperative imaging for neuronavigation, however, is diminished by the well-characterized phenomenon of brain shift, in which the brain deforms intraoperatively as a result of craniotomy, swelling, gravity, tumor resection, cerebrospinal fluid (CSF) drainage, and many other factors. As such, there is a need for updated intraoperative information that accurately reflects intraoperative conditions. Since 1982, intraoperative ultrasound has allowed neurosurgeons to craft and update operative plans without ionizing radiation exposure or major workflow interruption. Continued evolution of ultrasound technology since its introduction has resulted in superior imaging quality, smaller probes, and more seamless integration with neuronavigation systems. Furthermore, the introduction of related imaging modalities, such as 3-dimensional ultrasound, contrast-enhanced ultrasound, high-frequency ultrasound, and ultrasound elastography, has dramatically expanded the options available to the neurosurgeon intraoperatively. In the context of these advances, we review the current state, potential, and challenges of intraoperative ultrasound for brain tumor resection. We begin by evaluating these ultrasound technologies and their relative advantages and disadvantages. We then review three specific applications of these ultrasound technologies to brain tumor resection: (1) intraoperative navigation, (2) assessment of extent of resection, and (3) brain shift monitoring and compensation. We conclude by identifying opportunities for future directions in the development of ultrasound technologies.

User-friendly freehand ultrasound calibration using Lego bricks and automatic registration

PURPOSE

As an inexpensive, noninvasive, and portable clinical imaging modality, ultrasound (US) has been widely employed in many interventional procedures for monitoring potential tissue deformation, surgical tool placement, and locating surgical targets. The application requires the spatial mapping between 2D US images and 3D coordinates of the patient. Although positions of the devices (i.e., ultrasound transducer) and the patient can be easily recorded by a motion tracking system, the spatial relationship between the US image and the tracker attached to the US transducer needs to be estimated through an US calibration procedure. Previously, various calibration techniques have been proposed, where a spatial transformation is computed to match the coordinates of corresponding features in a physical phantom and those seen in the US scans. However, most of these methods are difficult to use for novel users.

METHODS

We proposed an ultrasound calibration method by constructing a phantom from simple Lego bricks and applying an automated multi-slice 2D-3D registration scheme without volumetric reconstruction. The method was validated for its calibration accuracy and reproducibility.

RESULTS

Our method yields a calibration accuracy of [Formula: see text] mm and a calibration reproducibility of 1.29 mm.

CONCLUSION

We have proposed a robust, inexpensive, and easy-to-use ultrasound calibration method.

Focal megalencephaly: intraoperative ultrasound imaging in epilepsy surgery

Hemimegalencephaly is a rare neuronal migration disorder that can be defined as abnormal neural and glial proliferation localized to all or part of a cerebral hemisphere. Most patients demonstrate intractable epilepsy, with early onset before 1 year of age. Surgical resection is one of the treatment options. In recent years, many advanced intraoperative techniques have been used for brain surgery for various pathologies. Intraoperative ultrasonography is a time-saving and noninvasive method for intraoperative imaging. In this report, we present the use of intraoperative ultrasonography in a patient with focal megalencephaly as an anatomical navigation with the functional navigation system, electrocorticography. In this report, we present the use of intraoperative ultrasonography in a patient with focal megalencephaly as an anatomical navigation with the functional navigation system, electrocorticography.

CustusX: an open-source research platform for image-guided therapy

Purpose

CustusX is an image-guided therapy (IGT) research platform dedicated to intraoperative navigation and ultrasound imaging. In this paper, we present CustusX as a robust, accurate, and extensible platform with full access to data and algorithms and show examples of application in technological and clinical IGT research.

Methods

CustusX has been developed continuously for more than 15 years based on requirements from clinical and technological researchers within the framework of a well-defined software quality process. The platform was designed as a layered architecture with plugins based on the CTK/OSGi framework, a superbuild that manages dependencies and features supporting the IGT workflow. We describe the use of the system in several different clinical settings and characterize major aspects of the system such as accuracy, frame rate, and latency.

Results

The validation experiments show a navigation system accuracy of \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$<$$\end{document}<1.1 mm, a frame rate of 20 fps, and latency of 285 ms for a typical setup. The current platform is extensible, user-friendly and has a streamlined architecture and quality process. CustusX has successfully been used for IGT research in neurosurgery, laparoscopic surgery, vascular surgery, and bronchoscopy.

Conclusions

CustusX is now a mature research platform for intraoperative navigation and ultrasound imaging and is ready for use by the IGT research community. CustusX is open-source and freely available at http://www.custusx.org.

New Protocol for Skin Landmark Registration in Image-Guided Neurosurgery: Technical Note

BACKGROUND

Newer versions of the commercial Medtronic StealthStation allow the use of only 8 landmark pairs for patient-to-image registration as opposed to 9 landmarks in older systems. The choice of which landmark pair to drop in these newer systems can have an effect on the quality of the patient-to-image registration.

OBJECTIVE

To investigate 4 landmark registration protocols based on 8 landmark pairs and compare the resulting registration accuracy with a 9-landmark protocol.

METHODS

Four different protocols were tested on both phantoms and patients. Two of the protocols involved using 4 ear landmarks and 4 facial landmarks and the other 2 involved using 3 ear landmarks and 5 facial landmarks. Both the fiducial registration error and target registration error were evaluated for each of the different protocols to determine any difference between them and the 9-landmark protocol.

RESULTS

No difference in fiducial registration error was found between any of the 8-landmark protocols and the 9-landmark protocol. A significant decrease (P &lt; .05) in target registration error was found when using a protocol based on 4 ear landmarks and 4 facial landmarks compared with the other protocols based on 3 ear landmarks.

CONCLUSION

When using 8 landmarks to perform the patient-to-image registration, the protocol using 4 ear landmarks and 4 facial landmarks greatly outperformed the other 8-landmark protocols and 9-landmark protocol, resulting in the lowest target registration error.

Improving recorded volume in mesial temporal lobe by optimizing stereotactic intracranial electrode implantation planning

PURPOSE

Intracranial electrodes are sometimes implanted in patients with refractory epilepsy to identify epileptic foci and propagation. Maximal recording of EEG activity from regions suspected of seizure generation is paramount. However, the location of individual contacts cannot be considered with current manual planning approaches. We propose and validate a procedure for optimizing intracranial electrode implantation planning that maximizes the recording volume, while constraining trajectories to safe paths.

METHODS

Retrospective data from 20 patients with epilepsy that had electrodes implanted in the mesial temporal lobes were studied. Clinical imaging data (CT/A and T1w MRI) were automatically segmented to obtain targets and structures to avoid. These data were used as input to the optimization procedure. Each electrode was modeled to assess risk, while individual contacts were modeled to estimate their recording capability. Ordered lists of trajectories per target were obtained. Global optimization generated the best set of electrodes. The procedure was integrated into a neuronavigation system.

RESULTS

Trajectories planned automatically covered statistically significant larger target volumes than manual plans [Formula: see text]. Median volume coverage was [Formula: see text] for automatic plans versus [Formula: see text] for manual plans. Furthermore, automatic plans remained at statistically significant safer distance to vessels [Formula: see text] and sulci [Formula: see text]. Surgeon's scores of the optimized electrode sets indicated that 95% of the automatic trajectories would be likely considered for use in a clinical setting.

CONCLUSIONS

This study suggests that automatic electrode planning for epilepsy provides safe trajectories and increases the amount of information obtained from the intracranial investigation.

Near real-time robust non-rigid registration of volumetric ultrasound images for neurosurgery

Ultrasound images are acquired before and after the resection of brain tumors to help the surgeon to localize the tumor and its extent and to minimize the amount of residual tumor after the resection. Because the brain undergoes large deformation between these two acquisitions, deformable image-based registration of these data sets is of substantial clinical importance. In this work, we present an algorithm for non-rigid registration of ultrasound images (RESOUND) that models the deformation with free-form cubic B-splines. We formulate a regularized cost function that uses normalized cross-correlation as the similarity metric. To optimize the cost function, we calculate its analytic derivative and use the stochastic gradient descent technique to achieve near real-time performance. We further propose a robust technique to minimize the effect of non-corresponding regions such as the resected tumor and possible hemorrhage in the post-resection image. Using manually labeled corresponding landmarks in the pre- and post-resection ultrasound volumes, we illustrate that our registration algorithm reduces the mean target registration error from an initial value of 3.7 to 1.5 mm. We also compare RESOUND with the previous work of Mercier et al. (2013) and illustrate that it has three important advantages: (i) it is fully automatic and does not require a manual segmentation of the tumor, (ii) it produces smaller registration errors and (iii) it is about 30 times faster. The clinical data set is available online on the BITE database website.

Automatic deformable MR-ultrasound registration for image-guided neurosurgery

In this work, we present a novel algorithm for registration of 3-D volumetric ultrasound (US) and MR using Robust PaTch-based cOrrelation Ratio (RaPTOR). RaPTOR computes local correlation ratio (CR) values on small patches and adds the CR values to form a global cost function. It is therefore invariant to large amounts of spatial intensity inhomogeneity. We also propose a novel outlier suppression technique based on the orientations of the RaPTOR gradients. Our deformation is modeled with free-form cubic B-splines. We analytically derive the derivatives of RaPTOR with respect to the transformation, i.e., the displacement of the B-spline nodes, and optimize RaPTOR using a stochastic gradient descent approach. RaPTOR is validated on MR and tracked US images of neurosurgery. Deformable registration of the US and MR images acquired, respectively, preoperation and postresection is of significant clinical significance, but challenging due to, among others, the large amount of missing correspondences between the two images. This work is also novel in that it performs automatic registration of this challenging dataset. To validate the results, we manually locate corresponding anatomical landmarks in the US and MR images of tumor resection in brain surgery. Compared to rigid registration based on the tracking system alone, RaPTOR reduces the mean initial mTRE over 13 patients from 5.9 to 2.9 mm, and the maximum initial TRE from 17.0 to 5.9 mm. Each volumetric registration using RaPTOR takes about 30 sec on a single CPU core. An important challenge in the field of medical image analysis is the shortage of publicly available dataset, which can both facilitate the advancement of new algorithms to clinical settings and provide a benchmark for comparison. To address this problem, we will make our manually located landmarks available online.

An analysis of tracking error in image-guided neurosurgery

PURPOSE

This study quantifies some of the technical and physical factors that contribute to error in image-guided interventions. Errors associated with tracking, tool calibration and registration between a physical object and its corresponding image were investigated and compared with theoretical descriptions of these errors.

METHODS

A precision milled linear testing apparatus was constructed to perform the measurements.

RESULTS

The tracking error was shown to increase in linear fashion with distance normal to the camera, and the tracking error ranged between 0.15 and 0.6 mm. The tool calibration error increased as a function of distance from the camera and the reference tool (0.2-0.8 mm). The fiducial registration error was shown to improve when more points were used up until a plateau value was reached which corresponded to the total fiducial localization error ([Formula: see text]0.8 mm). The target registration error distributions followed a [Formula: see text] distribution with the largest error and variation around fiducial points.

CONCLUSIONS

To minimize errors, tools should be calibrated as close as possible to the reference tool and camera, and tools should be used as close to the front edge of the camera throughout the intervention, with the camera pointed in the direction where accuracy is least needed during surgery.

Neuronavigation using susceptibility-weighted venography: application to deep brain stimulation and comparison with gadolinium contrast

Careful trajectory planning on preoperative vascular imaging is an essential step in deep brain stimulation (DBS) to minimize risks of hemorrhagic complications and postoperative neurological deficits. This paper compares 2 MRI methods for visualizing cerebral vasculature and planning DBS probe trajectories: a single data set T1-weighted scan with double-dose gadolinium contrast (T1w-Gd) and a multi–data set protocol consisting of a T1-weighted structural, susceptibility-weighted venography, and time-of-flight angiography (T1w-SWI-TOF). Two neurosurgeons who specialize in neuromodulation surgery planned bilateral STN DBS in 18 patients with Parkinson's disease (36 hemispheres) using each protocol separately. Planned trajectories were then evaluated across all vascular data sets (T1w-Gd, SWI, and TOF) to detect possible intersection with blood vessels along the entire path via an objective vesselness measure. The authors' results show that trajectories planned on T1w-SWI-TOF successfully avoided the cerebral vasculature imaged by conventional T1w-Gd and did not suffer from missing vascular information or imprecise data set registration. Furthermore, with appropriate planning and visualization software, trajectory corridors planned on T1w-SWI-TOF intersected significantly less fine vasculature that was not detected on the T1w-Gd (p < 0.01 within 2 mm and p < 0.001 within 4 mm of the track centerline). The proposed T1w-SWI-TOF protocol comes with minimal effects on the imaging and surgical workflow, improves vessel avoidance, and provides a safe cost-effective alternative to injection of gadolinium contrast.

Neuronavigation in the surgical management of brain tumors: current and future trends

Neuronavigation has become an ubiquitous tool in the surgical management of brain tumors. This review describes the use and limitations of current neuronavigational systems for brain tumor biopsy and resection. Methods for integrating intraoperative imaging into neuronavigational datasets developed to address the diminishing accuracy of positional information that occurs over the course of brain tumor resection are discussed. In addition, the process of integration of functional MRI and tractography into navigational models is reviewed. Finally, emerging concepts and future challenges relating to the development and implementation of experimental imaging technologies in the navigational environment are explored.

Intraoperative patient registration using volumetric true 3D ultrasound without fiducials

PURPOSE

Accurate patient registration is crucial for effective image-guidance in open cranial surgery. Typically, it is accomplished by matching skin-affixed fiducials manually identified in the operating room (OR) with their counterparts in the preoperative images, which not only consumes OR time and personnel resources but also relies on the presence (and subsequent fixation) of the fiducials during the preoperative scans (until the procedure begins). In this study, the authors present a completely automatic, volumetric image-based patient registration technique that does not rely on fiducials by registering tracked (true) 3D ultrasound (3DUS) directly with preoperative magnetic resonance (MR) images.

METHODS

Multistart registrations between binary 3DUS and MR volumes were first executed to generate an initial starting point without incorporating prior information on the US transducer contact point location or orientation for subsequent registration between grayscale 3DUS and MR via maximization of either mutual information (MI) or correlation ratio (CR). Patient registration was then computed through concatenation of spatial transformations.

RESULTS

In ten (N = 10) patient cases, an average fiducial (marker) distance error (FDE) of 5.0 mm and 4.3 mm was achieved using MI or CR registration (FDE was smaller with CR vs MI in eight of ten cases), which are comparable to values reported for typical fiducial- or surface-based patient registrations. The translational and rotational capture ranges were found to be 24.0 mm and 27.0° for binary registrations (up to 32.8 mm and 36.4°), 12.2 mm and 25.6° for MI registrations (up to 18.3 mm and 34.4°), and 22.6 mm and 40.8° for CR registrations (up to 48.5 mm and 65.6°), respectively. The execution time to complete a patient registration was 12-15 min with parallel processing, which can be significantly reduced by confining the 3DUS transducer location to the center of craniotomy in MR before registration (an execution time of 5 min is achievable).

CONCLUSIONS

Because common features deep in the brain and throughout the surgical volume of interest are used, intraoperative fiducial-less patient registration is possible on-demand, which is attractive in cases where preoperative patient registration is compromised (e.g., from loss∕movement of skin-affixed fiducials) or not possible (e.g., in cases of emergency when external fiducials were not placed in time). CR registration was more robust than MI (capture range about twice as big) and appears to be more accurate, although both methods are comparable to or better than fiducial-based registration in the patient cases evaluated. The results presented here suggest that 3DUS image-based patient registration holds promise for clinical application in the future.

A multi-modal approach to computer-assisted deep brain stimulation trajectory planning

PURPOSE

Both frame-based and frameless approaches to deep brain stimulation (DBS) require planning of insertion trajectories that mitigate hemorrhagic risk and loss of neurological function. Currently, this is done by manual inspection of multiple potential electrode trajectories on MR-imaging data. We propose and validate a method for computer-assisted DBS trajectory planning.

METHOD

Our framework integrates multi-modal MRI analysis (T1w, SWI, TOF-MRA) to compute suitable DBS trajectories that optimize the avoidance of specific critical brain structures. A cylinder model is used to process each trajectory and to evaluate complex surgical constraints described via a combination of binary and fuzzy segmented datasets. The framework automatically aggregates the multiple constraints into a unique ranking of recommended low-risk trajectories. Candidate trajectories are represented as a few well-defined cortical entry patches of best-ranked trajectories and presented to the neurosurgeon for final trajectory selection.

RESULTS

The proposed algorithm permits a search space containing over 8,000 possible trajectories to be processed in less than 20 s. A retrospective analysis on 14 DBS cases of patients with severe Parkinson's disease reveals that our framework can improve the simultaneous optimization of many pre-formulated surgical constraints. Furthermore, all automatically computed trajectories were evaluated by two neurosurgeons, were judged suitable for surgery and, in many cases, were judged preferable or equivalent to the manually planned trajectories used during the operation.

CONCLUSIONS

This work provides neurosurgeons with an intuitive and flexible decision-support system that allows objective and patient-specific optimization of DBS lead trajectories, which should improve insertion safety and reduce surgical time.