Automatic non-linear MRI-ultrasound registration for the correction of intra-operative brain deformations

Toward Estimating MRI-Ultrasound Registration Error in Image-Guided Neurosurgery

Image-guided neurosurgery allows surgeons to view their tools in relation to preoperatively acquired patient images and models. To continue using neuronavigation systems throughout operations, image registration between preoperative images [typically magnetic resonance imaging (MRI)] and intraoperative images (e.g., ultrasound) is common to account for brain shift (deformations of the brain during surgery). We implemented a method to estimate MRI-ultrasound registration errors, with the goal of enabling surgeons to quantitatively assess the performance of linear or nonlinear registrations. To the best of our knowledge, this is the first dense error estimating algorithm applied to multimodal image registrations. The algorithm is based on a previously proposed sliding-window convolutional neural network that operates on a voxelwise basis. To create training data where the true registration error is known, simulated ultrasound images were created from preoperative MRI images and artificially deformed. The model was evaluated on artificially deformed simulated ultrasound data and real ultrasound data with manually annotated landmark points. The model achieved a mean absolute error (MAE) of 0.977 ± 0.988 mm and a correlation of 0.8 ± 0.062 on the simulated ultrasound data, and an MAE of 2.24 ± 1.89 mm and a correlation of 0.246 on the real ultrasound data. We discuss concrete areas to improve the results on real ultrasound data. Our progress lays the foundation for future developments and ultimately implementation of clinical neuronavigation systems.

Image-to-Patient Registration in Computer-Assisted Surgery of Head and Neck: State-of-the-Art, Perspectives, and Challenges

Today, image-guided systems play a significant role in improving the outcome of diagnostic and therapeutic interventions. They provide crucial anatomical information during the procedure to decrease the size and the extent of the approach, to reduce intraoperative complications, and to increase accuracy, repeatability, and safety. Image-to-patient registration is the first step in image-guided procedures. It establishes a correspondence between the patient's preoperative imaging and the intraoperative data. When it comes to the head-and-neck region, the presence of many sensitive structures such as the central nervous system or the neurosensory organs requires a millimetric precision. This review allows evaluating the characteristics and the performances of different registration methods in the head-and-neck region used in the operation room from the perspectives of accuracy, invasiveness, and processing times. Our work led to the conclusion that invasive marker-based methods are still considered as the gold standard of image-to-patient registration. The surface-based methods are recommended for faster procedures and applied on the surface tissues especially around the eyes. In the near future, computer vision technology is expected to enhance these systems by reducing human errors and cognitive load in the operating room.

Precise Brain-shift Prediction by New Combination of W-Net Deep Learning for Neurosurgical Navigation

Brain tissue deformation during surgery significantly reduces the accuracy of image-guided neurosurgeries. We generated updated magnetic resonance images (uMR) in this study to compensate for brain shifts after dural opening using a convolutional neural network (CNN). This study included 248 consecutive patients who underwent craniotomy for initial intra-axial brain tumor removal and correspondingly underwent preoperative MR (pMR) and intraoperative MR (iMR) imaging. Deep learning using CNN to compensate for brain shift was performed using the pMR as input data, and iMR obtained after dural opening as the ground truth. For the tumor center (TC) and the maximum shift position (MSP), statistical analysis using the Wilcoxon signed-rank test was performed between the target registration error (TRE) for the pMR and iMR (i.e., the actual amount of brain shift) and the TRE for the uMR and iMR (i.e., residual error after compensation). The TRE at the TC decreased from 4.14 ± 2.31 mm to 2.31 ± 1.15 mm, and the TRE at the MSP decreased from 9.61 ± 3.16 mm to 3.71 ± 1.98 mm. The Wilcoxon signed-rank test of the pMR TRE and uMR TRE yielded a p-value less than 0.0001 for both the TC and MSP. Using a CNN model, we designed and implemented a new system that compensated for brain shifts after dural opening. Learning pMR and iMR with a CNN demonstrated the possibility of correcting the brain shift after dural opening.

Augmented Reality to Compensate for Navigation Inaccuracies

This study aims to report on the capability of microscope-based augmented reality (AR) to evaluate registration and navigation accuracy with extracranial and intracranial landmarks and to elaborate on its opportunities and obstacles in compensation for navigation inaccuracies. In a consecutive single surgeon series of 293 patients, automatic intraoperative computed tomography-based registration was performed delivering a high initial registration accuracy with a mean target registration error of 0.84 ± 0.36 mm. Navigation accuracy is evaluated by overlaying a maximum intensity projection or pre-segmented object outlines within the recent focal plane onto the in situ patient anatomy and compensated for by translational and/or rotational in-plane transformations. Using bony landmarks (85 cases), there was two cases where a mismatch was seen. Cortical vascular structures (242 cases) showed a mismatch in 43 cases and cortex representations (40 cases) revealed two inaccurate cases. In all cases, with detected misalignment, a successful spatial compensation was performed (mean correction: bone (6.27 ± 7.31 mm), vascular (3.00 ± 1.93 mm, 0.38° ± 1.06°), and cortex (5.31 ± 1.57 mm, 1.75° ± 2.47°)) increasing navigation accuracy. AR support allows for intermediate and straightforward monitoring of accuracy, enables compensation of spatial misalignments, and thereby provides additional safety by increasing overall accuracy.

Evaluation of MRI to Ultrasound Registration Methods for Brain Shift Correction: The CuRIOUS2018 Challenge

In brain tumor surgery, the quality and safety of the procedure can be impacted by intra-operative tissue deformation, called brain shift. Brain shift can move the surgical targets and other vital structures such as blood vessels, thus invalidating the pre-surgical plan. Intra-operative ultrasound (iUS) is a convenient and cost-effective imaging tool to track brain shift and tumor resection. Accurate image registration techniques that update pre-surgical MRI based on iUS are crucial but challenging. The MICCAI Challenge 2018 for Correction of Brain shift with Intra-Operative UltraSound (CuRIOUS2018) provided a public platform to benchmark MRI-iUS registration algorithms on newly released clinical datasets. In this work, we present the data, setup, evaluation, and results of CuRIOUS 2018, which received 6 fully automated algorithms from leading academic and industrial research groups. All algorithms were first trained with the public RESECT database, and then ranked based on a test dataset of 10 additional cases with identical data curation and annotation protocols as the RESECT database. The article compares the results of all participating teams and discusses the insights gained from the challenge, as well as future work.

Automatic and efficient MRI-US segmentations for improving intraoperative image fusion in image-guided neurosurgery

Knowledge of the exact tumor location and structures at risk in its vicinity are crucial for neurosurgical interventions. Neuronavigation systems support navigation within the patient's brain, based on preoperative MRI (preMRI). However, increasing tissue deformation during the course of tumor resection reduces navigation accuracy based on preMRI. Intraoperative ultrasound (iUS) is therefore used as real-time intraoperative imaging. Registration of preMRI and iUS remains a challenge due to different or varying contrasts in iUS and preMRI. Here, we present an automatic and efficient segmentation of B-mode US images to support the registration process. The falx cerebri and the tentorium cerebelli were identified as examples for central cerebral structures and their segmentations can serve as guiding frame for multi-modal image registration. Segmentations of the falx and tentorium were performed with an average Dice coefficient of 0.74 and an average Hausdorff distance of 12.2 mm. The subsequent registration incorporates these segmentations and increases accuracy, robustness and speed of the overall registration process compared to purely intensity-based registration. For validation an expert manually located corresponding landmarks. Our approach reduces the initial mean Target Registration Error from 16.9 mm to 3.8 mm using our intensity-based registration and to 2.2 mm with our combined segmentation and registration approach. The intensity-based registration reduced the maximum initial TRE from 19.4 mm to 5.6 mm, with the approach incorporating segmentations this is reduced to 3.0 mm. Mean volumetric intensity-based registration of preMRI and iUS took 40.5 s, including segmentations 12.0 s.

•

We demonstrate that our segmentation-based registration increases accuracy, robustness, and speed of multi-modal image registration of preoperative MRI and intraoperative ultrasound images for improving intraoperative image guided neurosurgery.

•

For this we provide a fast and efficient segmentation of central anatomical structures of the perifalcine region on ultrasound images.

•

We demonstrate the advantages of our method by comparing the results of our segmentation-based registration with the initial registration provided by the navigation system and with an intensity-based registration approach.

Advanced Ultrasound Imaging in Glioma Surgery: Beyond Gray-Scale B-mode

Introduction: Glioma surgery is aimed at obtaining maximal safe tumor resection while preserving or improving patient's neurological status. For this reason, there is growing interest for intra-operative imaging in neuro-oncological surgery. Intra-operative ultrasound (ioUS) provides the surgeon with real-time, anatomical and functional information. Despite this, in neurosurgery ioUS mainly relies only on gray-scale brightness mode (B-mode). Many other ultrasound imaging modalities, such as Fusion Imaging with pre-operative acquired magnetic resonance imaging (MRI), Doppler modes, Contrast Enhanced Ultrasound (CEUS), and elastosonography have been developed and have been extensively used in other organs. Although these modalities offer valuable real-time intra-operative information, so far their usage during neurosurgical procedures is still limited.

Purpose: To present an US-based multimodal approach for image-guidance in glioma surgery, highlighting the different features of advanced US modalities: fusion imaging with pre-operative acquired MRI for Virtual Navigation, B-mode, Doppler (power-, color-, spectral-), CEUS, and elastosonography.

Methods: We describe, in a step-by-step fashion, the applications of the most relevant advanced US modalities during different stages of surgery and their implications for surgical decision-making. Each US modality is illustrated from a technical standpoint and its application during glioma surgery is discussed.

Results: B-mode offers dynamic morphological information, which can be further implemented with fusion imaging to improve image understanding and orientation. Doppler imaging permits to evaluate anatomy and function of the vascular tree. CEUS allows to perform a real-time angiosonography, providing valuable information in regards of parenchyma and tumor vascularization and perfusion. This facilitates tumor detection and surgical strategy, also allowing to characterize tumor grade and to identify residual tumor. Elastosonography is a promising tool able to better define tumor margins, parenchymal infiltration, tumor consistency and permitting differentiation of high grade and low grade lesions.

Conclusions: Multimodal ioUS represents a valuable tool for glioma surgery being highly informative, rapid, repeatable, and real-time. It is able to differentiate low grade from high grade tumors and to provide the surgeon with relevant information for surgical decision-making. ioUS could be integrated with other intra-operative imaging and functional approaches in a synergistic manner to offer the best image guidance for each patient.

Intraoperative Imaging Modalities and Compensation for Brain Shift in Tumor Resection Surgery

Intraoperative brain shift during neurosurgical procedures is a well-known phenomenon caused by gravity, tissue manipulation, tumor size, loss of cerebrospinal fluid (CSF), and use of medication. For the use of image-guided systems, this phenomenon greatly affects the accuracy of the guidance. During the last several decades, researchers have investigated how to overcome this problem. The purpose of this paper is to present a review of publications concerning different aspects of intraoperative brain shift especially in a tumor resection surgery such as intraoperative imaging systems, quantification, measurement, modeling, and registration techniques. Clinical experience of using intraoperative imaging modalities, details about registration, and modeling methods in connection with brain shift in tumor resection surgery are the focuses of this review. In total, 126 papers regarding this topic are analyzed in a comprehensive summary and are categorized according to fourteen criteria. The result of the categorization is presented in an interactive web tool. The consequences from the categorization and trends in the future are discussed at the end of this work.

Calibrated Linear Array-Driven Photoacoustic/Ultrasound Tomography

The anisotropic resolution of linear arrays, tools that are widely used in diagnostics, can be overcome by compounding approaches. We investigated the ability of a recently developed calibration and a novel algorithm to determine the actual radial transducer array distance and its misalignment (tilt) with respect to the center of rotation in a 2-D and 3-D tomographic setup. By increasing the time-of-flight accuracy, we force in-phase summation during the reconstruction. Our setup is composed of a linear transducer and a rotation and translation axis enabling multidimensional imaging in ultrasound and photoacoustic mode. Our approach is validated on phantoms and young mice ex vivo. The results indicate that application of the proposed analytical calibration algorithms prevents image artifacts. The spatial resolution achieved was 160 and 250 μm in photoacoustic mode of 2-D and 3-D tomography, respectively.

miLBP: a robust and fast modality-independent 3D LBP for multimodal deformable registration

Purpose

Computer-assisted intervention often depends on multimodal deformable registration to provide complementary information. However, multimodal deformable registration remains a challenging task.

Methods

This paper introduces a novel robust and fast modality-independent 3D binary descriptor, called miLBP, which integrates the principle of local self-similarity with a form of local binary pattern and can robustly extract the similar geometry features from 3D volumes across different modalities. miLBP is a bit string that can be computed by simply thresholding the voxel distance. Furthermore, the descriptor similarity can be evaluated efficiently using the Hamming distance.

Results

miLBP was compared to vector-valued self-similarity context (SSC) in artificial image and clinical settings. The results show that miLBP is more robust than SSC in extracting local geometry features across modalities and achieved higher registration accuracy in different registration scenarios. Furthermore, in the most challenging registration between preoperative magnetic resonance imaging and intra-operative ultrasound images, our approach significantly outperforms the state-of-the-art methods in terms of both accuracy (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2.15\pm 1.1 \hbox { mm}$$\end{document}2.15±1.1mm) and speed (29.2 s for one case).

Conclusions

Registration performance and speed indicate that miLBP has the potential of being applied to the time-sensitive intra-operative computer-assisted intervention.

Near real-time robust non-rigid registration of volumetric ultrasound images for neurosurgery

Ultrasound images are acquired before and after the resection of brain tumors to help the surgeon to localize the tumor and its extent and to minimize the amount of residual tumor after the resection. Because the brain undergoes large deformation between these two acquisitions, deformable image-based registration of these data sets is of substantial clinical importance. In this work, we present an algorithm for non-rigid registration of ultrasound images (RESOUND) that models the deformation with free-form cubic B-splines. We formulate a regularized cost function that uses normalized cross-correlation as the similarity metric. To optimize the cost function, we calculate its analytic derivative and use the stochastic gradient descent technique to achieve near real-time performance. We further propose a robust technique to minimize the effect of non-corresponding regions such as the resected tumor and possible hemorrhage in the post-resection image. Using manually labeled corresponding landmarks in the pre- and post-resection ultrasound volumes, we illustrate that our registration algorithm reduces the mean target registration error from an initial value of 3.7 to 1.5 mm. We also compare RESOUND with the previous work of Mercier et al. (2013) and illustrate that it has three important advantages: (i) it is fully automatic and does not require a manual segmentation of the tumor, (ii) it produces smaller registration errors and (iii) it is about 30 times faster. The clinical data set is available online on the BITE database website.

Automatic deformable MR-ultrasound registration for image-guided neurosurgery

In this work, we present a novel algorithm for registration of 3-D volumetric ultrasound (US) and MR using Robust PaTch-based cOrrelation Ratio (RaPTOR). RaPTOR computes local correlation ratio (CR) values on small patches and adds the CR values to form a global cost function. It is therefore invariant to large amounts of spatial intensity inhomogeneity. We also propose a novel outlier suppression technique based on the orientations of the RaPTOR gradients. Our deformation is modeled with free-form cubic B-splines. We analytically derive the derivatives of RaPTOR with respect to the transformation, i.e., the displacement of the B-spline nodes, and optimize RaPTOR using a stochastic gradient descent approach. RaPTOR is validated on MR and tracked US images of neurosurgery. Deformable registration of the US and MR images acquired, respectively, preoperation and postresection is of significant clinical significance, but challenging due to, among others, the large amount of missing correspondences between the two images. This work is also novel in that it performs automatic registration of this challenging dataset. To validate the results, we manually locate corresponding anatomical landmarks in the US and MR images of tumor resection in brain surgery. Compared to rigid registration based on the tracking system alone, RaPTOR reduces the mean initial mTRE over 13 patients from 5.9 to 2.9 mm, and the maximum initial TRE from 17.0 to 5.9 mm. Each volumetric registration using RaPTOR takes about 30 sec on a single CPU core. An important challenge in the field of medical image analysis is the shortage of publicly available dataset, which can both facilitate the advancement of new algorithms to clinical settings and provide a benchmark for comparison. To address this problem, we will make our manually located landmarks available online.

Deformable registration of preoperative MR, pre-resection ultrasound, and post-resection ultrasound images of neurosurgery

PURPOSE

Sites that use ultrasound (US) in image-guided neurosurgery (IGNS) of brain tumors generally have three sets of imaging data: preoperative magnetic resonance (MR) image, pre-resection US, and post-resection US. The MR image is usually acquired days before the surgery, the pre-resection US is obtained after the craniotomy but before the resection, and finally, the post-resection US scan is performed after the resection of the tumor. The craniotomy and tumor resection both cause brain deformation, which significantly reduces the accuracy of the MR-US alignment.

METHOD

Three unknown transformations exist between the three sets of imaging data: MR to pre-resection US, pre- to post-resection US, and MR to post-resection US. We use two algorithms that we have recently developed to perform the first two registrations (i.e., MR to pre-resection US and pre- to post-resection US). Regarding the third registration (MR to post-resection US), we evaluate three strategies. The first method performs a registration between the MR and pre-resection US, and another registration between the pre- and post-resection US. It then composes the two transformations to register MR and post-resection US; we call this method compositional registration. The second method ignores the pre-resection US and directly registers the MR and post-resection US; we refer to this method as direct registration. The third method is a combination of the first and second: it uses the solution of the compositional registration as an initial solution for the direct registration method. We call this method group-wise registration.

RESULTS

We use data from 13 patients provided in the MNI BITE database for all of our analysis. Registration of MR and pre-resection US reduces the average of the mean target registration error (mTRE) from 4.1 to 2.4 mm. Registration of pre- and post-resection US reduces the average mTRE from 3.7 to 1.5 mm. Regarding the registration of MR and post-resection US, all three strategies reduce the mTRE. The initial average mTRE is 5.9 mm, which reduces to 3.3 mm with the compositional method, 2.9 mm with the direct technique, and 2.8 mm with the group-wise method.

CONCLUSION

Deformable registration of MR and pre- and post-resection US images significantly improves their alignment. Among the three methods proposed for registering the MR to post-resection US, the group-wise method gives the lowest TRE values. Since the running time of all registration algorithms is less than 2 min on one core of a CPU, they can be integrated into IGNS systems for interactive use during surgery.

Nonrigid registration of ultrasound and MRI using contextual conditioned mutual information

Mutual information (MI) quantifies the information that is shared between two random variables and has been widely used as a similarity metric for multi-modal and uni-modal image registration. A drawback of MI is that it only takes into account the intensity values of corresponding pixels and not of neighborhoods. Therefore, it treats images as "bag of words" and the contextual information is lost. In this work, we present Contextual Conditioned Mutual Information (CoCoMI), which conditions MI estimation on similar structures. Our rationale is that it is more likely for similar structures to undergo similar intensity transformations. The contextual analysis is performed on one of the images offline. Therefore, CoCoMI does not significantly change the registration time. We use CoCoMI as the similarity measure in a regularized cost function with a B-spline deformation field and efficiently optimize the cost function using a stochastic gradient descent method. We show that compared to the state of the art local MI based similarity metrics, CoCoMI does not distort images to enforce erroneous identical intensity transformations for different image structures. We further present the results on nonrigid registration of ultrasound (US) and magnetic resonance (MR) patient data from image-guided neurosurgery trials performed in our institute and publicly available in the BITE dataset. We show that CoCoMI performs significantly better than the state of the art similarity metrics in US to MR registration. It reduces the average mTRE over 13 patients from 4.12 mm to 2.35 mm, and the maximum mTRE from 9.38 mm to 3.22 mm.

Registration of 3D fetal neurosonography and MRI

We propose a method for registration of 3D fetal brain ultrasound with a reconstructed magnetic resonance fetal brain volume. This method, for the first time, allows the alignment of models of the fetal brain built from magnetic resonance images with 3D fetal brain ultrasound, opening possibilities to develop new, prior information based image analysis methods for 3D fetal neurosonography. The reconstructed magnetic resonance volume is first segmented using a probabilistic atlas and a pseudo ultrasound image volume is simulated from the segmentation. This pseudo ultrasound image is then affinely aligned with clinical ultrasound fetal brain volumes using a robust block-matching approach that can deal with intensity artefacts and missing features in the ultrasound images. A qualitative and quantitative evaluation demonstrates good performance of the method for our application, in comparison with other tested approaches. The intensity average of 27 ultrasound images co-aligned with the pseudo ultrasound template shows good correlation with anatomy of the fetal brain as seen in the reconstructed magnetic resonance image.

Validation of a hybrid Doppler ultrasound vessel-based registration algorithm for neurosurgery

PURPOSE

We describe and validate a novel hybrid nonlinear vessel registration algorithm for intra-operative updating of preoperative magnetic resonance (MR) images using Doppler ultrasound (US) images acquired on the dura for the correction of brain-shift and registration inaccuracies. We also introduce an US vessel appearance simulator that generates vessel images similar in appearance to that acquired with US from MR angiography data.

METHODS

Our registration uses the minimum amount of preprocessing to extract vessels from the raw volumetric images. This prevents the removal of important registration information and minimizes the introduction of artifacts that may affect robustness, while reducing the amount of extraneous information in the image to be processed, thus improving the convergence speed of the algorithm. We then completed 3 rounds of validation for our vessel registration method for robustness and accuracy using (i) a large number of synthetic trials generated with our US vessel simulator, (ii) US images acquired from a real physical phantom made from polyvinyl alcohol cryogel, and (iii) real clinical data gathered intra-operatively from 3 patients.

RESULTS

Resulting target registration errors (TRE) of less than 2.5 mm are achieved in more than 90 % of the synthetic trials when the initial TREs are less than 20 mm. TREs of less than 2 mm were achieved when the technique was applied to the physical phantom, and TREs of less than 3 mm were achieved on clinical data.

CONCLUSIONS

These test trials show that the proposed algorithm is not only accurate but also highly robust to noise and missing vessel segments when working with US images acquired in a wide range of real-world conditions.

Intra-operative 3-T MRI for paediatric brain tumours: challenges and perspectives

MRI is the ideal modality for imaging intracranial tumours. Intraoperative MRI (ioMRI) makes it possible to obtain scans during a neurosurgical operation that can aid complete macroscopic tumour resection—a major prognostic factor in the majority of brain tumours in children. Intraoperative MRI can also help limit damage to normal brain tissue. It therefore has the potential to improve the survival of children with brain tumours and to minimise morbidity, including neurological deficits. The use of ioMRI is also likely to reduce the need for second look surgery, and may reduce the need for chemotherapy and radiotherapy. Highfield MRI systems provide better anatomical information and also enable effective utilisation of advanced MRI techniques such as perfusion imaging, diffusion tensor imaging, and magnetic resonance spectroscopy. However, high-field ioMRI facilities require substantial capital investment, and careful planning is required for optimal benefit. Safe ioMRI requires meticulous attention to detail and rigorous application of magnetic field safety precautions. Interpretation of ioMRI can be challenging and requires experience and understanding of artefacts that are common in the intra-operative setting.

New prototype neuronavigation system based on preoperative imaging and intraoperative freehand ultrasound: system description and validation

PURPOSE

The aim of this report is to present IBIS (Interactive Brain Imaging System) NeuroNav, a new prototype neuronavigation system that has been developed in our research laboratory over the past decade that uses tracked intraoperative ultrasound to address surgical navigation issues related to brain shift. The unique feature of the system is its ability, when needed, to improve the initial patient-to-preoperative image alignment based on the intraoperative ultrasound data. Parts of IBIS Neuronav source code are now publicly available on-line.

METHODS

Four aspects of the system are characterized in this paper: the ultrasound probe calibration, the temporal calibration, the patient-to-image registration and the MRI-ultrasound registration. In order to characterize its real clinical precision and accuracy, the system was tested in a series of adult brain tumor cases.

RESULTS

Three metrics were computed to evaluate the precision and accuracy of the ultrasound calibration. 1) Reproducibility: 1.77 mm and 1.65 mm for the bottom corners of the ultrasound image, 2) point reconstruction precision 0.62-0.90 mm: and 3) point reconstruction accuracy: 0.49-0.74 mm. The temporal calibration error was estimated to be 0.82 ms. The mean fiducial registration error (FRE) of the homologous-point-based patient-to-MRI registration for our clinical data is 4.9 ± 1.1 mm. After the skin landmark-based registration, the mean misalignment between the ultrasound and MR images in the tumor region is 6.1 ± 3.4 mm.

CONCLUSIONS

The components and functionality of a new prototype system are described and its precision and accuracy evaluated. It was found to have an accuracy similar to other comparable systems in the literature.

Cortical mapping and frameless stereotactic navigation in the high-field intraoperative magnetic resonance imaging suite

Frameless stereotactic neuronavigation provides tracking of surgical instruments on radiographic images and orients the surgeon to tumor margins at surgery. Bipolar electrical stimulation mapping (ESM) delineates safe limits for resection of brain tumors adjacent to eloquent cortex. These standard techniques could complement the capability of intraoperative MR (iMR) imaging to evaluate for occult residual disease during surgery and promote more complete tumor removal. The use of frameless neuronavigation in the high-field iMR imaging suite requires that a few pieces of standard equipment be replaced by nonferromagnetic instruments. Specific use of ESM in a high-field iMR imaging suite has not been reported in the literature. To study whether frameless neuronavigation and electrical stimulation mapping could be successfully integrated in the high-field iMR imaging suite, the authors employed these modalities in 10 consecutive cases involving patients undergoing conscious craniotomy for primary brain tumors located in or adjacent to eloquent cortices. Equipment included a custom high-field MR imaging-compatible head holder and dynamic reference frame attachment, a standard MR imaging-compatible dynamic reference frame, a standard MR imaging machine with a table top that could be translated to a pedestal outside the 5-gauss line for the operative intervention, and standard neuronavigational and cortical stimulation equipment. Both ESM and frameless stereotactic guidance were performed outside the 5-gauss line. The presence of residual neoplasm was evaluated using iMR imaging; resection was continued until eloquent areas were encountered or iMR imaging confirmed complete removal of any residual tumor. Mapping identified essential language (5 patients), sensory (6), and motor (7) areas. The combined use of frameless stereotactic navigation, ESM, and iMR imaging resulted in complete radiographic resection in 7 cases and resection to an eloquent margin in 3 cases. Postoperative MR imaging confirmed final iMR imaging findings. No patient experienced a permanent new neurological deficit. Familiar techniques such as frameless navigation and ESM can be rapidly, inexpensively, safely, and effectively integrated into the high-field iMR imaging suite.

Software requirements for interventional MR in restorative and functional neurosurgery

Interventional MRI (iMRI) holds great promise for optimally guiding and monitoring restorative and functional neurosurgical procedures. This technology has already been used to guide ablative therapies and insert deep brain stimulation electrodes, and many future applications are envisioned. An optimized software interface is crucial for efficiently integrating the imaging data acquired during these procedures. MR systems are largely dedicated to image prescription and acquisition, whereas neuronavigation systems typically operate with previously acquired static data. An optimal software interface for iMRI requires fusion of many of the capabilities offered by these individual devices and further requires the development of tools to handle the integration and presentation of dynamically updated data.

Updating navigation with intraoperative image data

OBJECTIVES

To localize overlooked tumor remnants by updating navigation with intraoperative magnetic resonance imaging compensating for the effects of brain shift.

METHODS

In 112 patients among 805 patients that were investigated by combined use of intraoperative high-field (1.5 T) magnetic resonance imaging and navigation, mostly glioma cases (n = 85), an update of the navigation was performed. Intraoperative image data were rigidly registered with the preoperative image data, the tumor remnant was segmented, and then the initial patient registration was restored so that the registration coordinate system of the preoperative image data was applied on the intraoperative images, allowing navigation updating without intraoperative patient re-registration.

RESULTS

Navigation could be updated reliably in all cases. Potential positional shifting impairing the initial update strategy was observed only in 2 cases so that a patient re-registration was necessary. The target registration error of the initial patient registration was 1.33 +/- 0.63 mm, and registration of preoperative and intraoperative images could be performed with high accuracy, as proven by landmark checks. Updating of navigation resulted in increased resections or correction of a catheter position or biopsy sampling site in 94%. In the remaining 7 patients, the intraoperative images were used for correlation with the surgical site but without changing the surgical strategy.

CONCLUSIONS

Navigation can be reliably updated with intraoperative image data without repeated patient registration, facilitating the update procedure. Updated navigation allows achieving enlarged resections and compensates for the effects of brain shift.

Clinical validation of vessel-based registration for correction of brain-shift

In this paper, we have tested and validated a vessel-based registration technique for correction of brain-shift using retrospective clinical data from five patients: three patients with brain tumors, one patient with an aneurysm and one patient with an arteriovenous malformation. The algorithm uses vessel centerlines extracted from segmented pre-operative MRA data and intra-operative power Doppler ultrasound images to compute first a linear fit and then a thin-plate spline transform in order to achieve non-linear registration. The method was validated using (i) homologous landmarks identified in the original data, (ii) selected vessels, excluded from the fitting procedure and (iii) manually segmented, non-vascular structures. The tracking of homologous landmarks show that we are able to correct the deformation to within 1.25 mm, and the validation using excluded vessels and anatomical structures show an accuracy of 1mm. Pre-processing of the data can be completed in 30 s per dataset, and registrations can be performed in less than 30s. This makes the technique well suited for intra-operative use.

Validation of vessel-based registration for correction of brain shift

The displacement and deformation of brain tissue is a major source of error in image-guided neurosurgery systems. We have designed and implemented a method to detect and correct brain shift using pre-operative MR images and intraoperative Doppler ultrasound data and present its validation with both real and simulated data. The algorithm uses segmented vessels from both modalities, and estimates the deformation using a modified version of the iterative closest point (ICP) algorithm. We use the least trimmed squares (LTS) to reduce the number of outliers in the point matching procedure. These points are used to drive a thin-plate spline transform to achieve non-linear registration. Validation was completed in two parts. First, the technique was tested and validated using realistic simulations where the results were compared to the known deformation. The registration technique recovered 75% of the deformation in the region of interest accounting for deformations as large as 20 mm. Second, we performed a PVA-cryogel phantom study where both MR and ultrasound images of the phantom were obtained for three different deformations. The registration results based on MR data were used as a gold standard to evaluate the performance of the ultrasound based registration. On average, deformations of 7.5 mm magnitude were corrected to within 1.6 mm for the ultrasound based registration and 1.07 mm for the MR based registration.

Is the image guidance of ultrasonography beneficial for neurosurgical routine?

BACKGROUND

Intraoperative US has been widely used in neurosurgical procedures. However, images are often difficult to read. In the present study, we evaluate whether the image guidance of ultrasonography is helpful for the interpretation of US scans.

METHODS

Twenty-nine patients with tumor were operated on with the aid of intraoperative US from January to June 2005. Image-guided sonography was used in 13 cases and nonnavigated US technology in the remaining cases. We compared the 2 technologies retrospectively.

RESULTS

Although image quality was good in most cases, orientation remained difficult in 8 of the 16 patients where conventional sonography was used. With the aid of image fusion for navigated sonography, the orientation was judged superior to nonnavigated US.

CONCLUSION

In our experience, integration of the US into the navigation system facilitates anatomical understanding. Thus, we feel that this technology is beneficial for neurosurgical routine.