Robust nonrigid registration to capture brain shift from intraoperative MRI

Current Research Status of Respiratory Motion for Thorax and Abdominal Treatment: A Systematic Review

Malignant tumors have become one of the serious public health problems in human safety and health, among which the chest and abdomen diseases account for the largest proportion. Early diagnosis and treatment can effectively improve the survival rate of patients. However, respiratory motion in the chest and abdomen can lead to uncertainty in the shape, volume, and location of the tumor, making treatment of the chest and abdomen difficult. Therefore, compensation for respiratory motion is very important in clinical treatment. The purpose of this review was to discuss the research and development of respiratory movement monitoring and prediction in thoracic and abdominal surgery, as well as introduce the current research status. The integration of modern respiratory motion compensation technology with advanced sensor detection technology, medical-image-guided therapy, and artificial intelligence technology is discussed and analyzed. The future research direction of intraoperative thoracic and abdominal respiratory motion compensation should be non-invasive, non-contact, use a low dose, and involve intelligent development. The complexity of the surgical environment, the constraints on the accuracy of existing image guidance devices, and the latency of data transmission are all present technical challenges.

Comparison of physics-based deformable registration methods for image-guided neurosurgery

This paper compares three finite element-based methods used in a physics-based non-rigid registration approach and reports on the progress made over the last 15 years. Large brain shifts caused by brain tumor removal affect registration accuracy by creating point and element outliers. A combination of approximation- and geometry-based point and element outlier rejection improves the rigid registration error by 2.5 mm and meets the real-time constraints (4 min). In addition, the paper raises several questions and presents two open problems for the robust estimation and improvement of registration error in the presence of outliers due to sparse, noisy, and incomplete data. It concludes with preliminary results on leveraging Quantum Computing, a promising new technology for computationally intensive problems like Feature Detection and Block Matching in addition to finite element solver; all three account for 75% of computing time in deformable registration.

3D Bioprinting of Neurovascular Tissue Modeling with Collagen-Based Low-Viscosity Composites

In vitro neurovascular unit (NVU) models are valuable for investigating brain functions and developing drugs. However, it remains challenging to recapitulate the native architectural features and ultra-soft extracellular matrix (ECM) properties of the natural NVU. Cell-laden bioprinting is promising to prepare complex living tissues, but hard to balance the fidelity and cell growth. This study proposes a novel two-stage methodology for biomanufacturing functional 3D neurovascular constructs in vitro with low modulus of ECM. At the shaping stage, a low-viscosity alginate/collagen is printed through an embedded approach; at the culturing stage, the alginate is removed through targeted lysing. The low-viscosity and rapid crosslinking properties provide a printing resolution of ≈10 µm, and the lysis processing can decrease the hydrogels' modulus to ≈1 kPa and adjust the porosity of the microstructure, providing cells with an environment closing to the brain ECM. A 3D hollow coaxial neurovascular model is fabricated, in which the endothelial cells has expressed tight junction proteins and shown selective permeability, and the astrocytes outside of the endothelial layer are found to spread out with branches and directly interact with endothelial cells. The present study offers a promising modeling method for better understanding the NVU function and screening neuro-drugs.

Real-Time Dynamic Data Driven Deformable Registration for Image-Guided Neurosurgery: Computational Aspects

Current neurosurgical procedures utilize medical images of various modalities to enable the precise location of tumors and critical brain structures to plan accurate brain tumor resection. The difficulty of using preoperative images during the surgery is caused by the intra-operative deformation of the brain tissue (brain shift), which introduces discrepancies concerning the preoperative configuration. Intra-operative imaging allows tracking such deformations but cannot fully substitute for the quality of the pre-operative data. Dynamic Data Driven Deformable Non-Rigid Registration (D4NRR) is a complex and time-consuming image processing operation that allows the dynamic adjustment of the pre-operative image data to account for intra-operative brain shift during the surgery. This paper summarizes the computational aspects of a specific adaptive numerical approximation method and its variations for registering brain MRIs. It outlines its evolution over the last 15 years and identifies new directions for the computational aspects of the technique.

Image-to-Patient Registration in Computer-Assisted Surgery of Head and Neck: State-of-the-Art, Perspectives, and Challenges

Today, image-guided systems play a significant role in improving the outcome of diagnostic and therapeutic interventions. They provide crucial anatomical information during the procedure to decrease the size and the extent of the approach, to reduce intraoperative complications, and to increase accuracy, repeatability, and safety. Image-to-patient registration is the first step in image-guided procedures. It establishes a correspondence between the patient's preoperative imaging and the intraoperative data. When it comes to the head-and-neck region, the presence of many sensitive structures such as the central nervous system or the neurosensory organs requires a millimetric precision. This review allows evaluating the characteristics and the performances of different registration methods in the head-and-neck region used in the operation room from the perspectives of accuracy, invasiveness, and processing times. Our work led to the conclusion that invasive marker-based methods are still considered as the gold standard of image-to-patient registration. The surface-based methods are recommended for faster procedures and applied on the surface tissues especially around the eyes. In the near future, computer vision technology is expected to enhance these systems by reducing human errors and cognitive load in the operating room.

Non-Rigid Registration for High-Resolution Retinal Imaging

Adaptive optics provides improved resolution in ophthalmic imaging when retinal microstructures need to be identified, counted, and mapped. In general, multiple images are averaged to improve the signal-to-noise ratio or analyzed for temporal dynamics. Image registration by cross-correlation is straightforward for small patches; however, larger images require more sophisticated registration techniques. Strip-based registration has been used successfully for photoreceptor mosaic alignment in small patches; however, if the deformations along strips are not simple displacements, averaging can degrade the final image. We have applied a non-rigid registration technique that improves the quality of processed images for mapping cones over large image patches. In this approach, correction of local deformations compensates for local image stretching, compressing, bending, and twisting due to a number of causes. The main result of this procedure is improved definition of retinal microstructures that can be better identified and segmented. Derived metrics such as cone density, wall-to-lumen ratio, and quantification of structural modification of blood vessel walls have diagnostic value in many retinal diseases, including diabetic retinopathy and age-related macular degeneration, and their improved evaluations may facilitate early diagnostics of retinal diseases.

Themes in neuronavigation research: A machine learning topic analysis

Objective

To understand trends in neuronavigation we employed machine learning methods to perform a broad literature review which would be impractical by manual inspection.

Methods

PubMed was queried for articles with "Neuronavigation" in any field from inception-2020. Articles were designated neuronavigation-focused (NF) if "Neuronavigation" was a major MeSH. The latent dirichlet allocation topic modeling technique was used to identify themes of NF research.

Results

There were 3896 articles of which 1727 (44%) were designated as NF. Between 1999-2009 and 2010-2020, the number of NF publications experienced 80% growth. Between 2009-2014 and 2015-2020, there was a 0.3% decline. Eleven themes covered 1367 (86%) NF articles. "Resection of Eloquent Lesions" comprised the highest number of articles (243), followed by "Accuracy and Registration" (242), "Patient Outcomes" (156), "Stimulation and Mapping" (126), "Planning and Visualization" (123), "Intraoperative Tools" (104), "Placement of Ventricular Catheters" (86), "Spine Surgery" (85), "New Systems" (80), "Guided Biopsies" (61), and "Surgical Approach" (61). All topics except for "Planning and Visualization", "Intraoperative Tools", and "New Systems" exhibited a monotonic positive trend. When analyzing subcategories, there were a greater number of clinical assessments or usage of existing neuronavigation systems (77%) rather than modification or development of new apparatuses (18%).

Conclusion

NF research appears to focus on the clinical assessment of neuronavigation and to a lesser extent on the development of new systems. Although neuronavigation has made significant strides, NF research output appears to have plateaued in the last decade.

Basis for error in stereotactic and computer-assisted surgery in neurosurgical applications: literature review

Technological advancements in optoelectronic motion capture systems have allowed for the development of high-precision computer-assisted surgery (CAS) used in cranial and spinal surgical procedures. Errors generated sequentially throughout the chain of components of CAS may have cumulative effect on the accuracy of implant and instrumentation placement - potentially affecting patient outcomes. Navigational integrity and maintenance of fidelity of optoelectronic data is the cornerstone of CAS. Error reporting measures vary between studies. Understanding error generation, mechanisms of propagation, and how they relate to workflow can assist clinicians in error mitigation and improve accuracy during navigation in neurosurgical procedures. Diligence in planning, fiducial positioning, system registration, and intra-operative workflow have the potential to improve accuracy and decrease disparity between planned and final instrumentation and implant position. This study reviews the potential errors associated with each step in computer-assisted surgery and provides a basis for disparity in intrinsic accuracy versus achieved accuracy in the clinical operative environment.

Ingrained: An Automated Framework for Fusing Atomic-Scale Image Simulations into Experiments

To fully leverage the power of image simulation to corroborate and explain patterns and structures in atomic resolution microscopy, an initial correspondence between the simulation and experimental image must be established at the outset of further high accuracy simulations or calculations. Furthermore, if simulation is to be used in context of highly automated processes or high-throughput optimization, the process of finding this correspondence itself must be automated. In this work, "ingrained," an open-source automation framework which solves for this correspondence and fuses atomic resolution image simulations into the experimental images to which they correspond, is introduced. Herein, the overall "ingrained" workflow, focusing on its application to interface structure approximations, and the development of an experimentally rationalized forward model for scanning tunneling microscopy simulation are described.

Photoacoustic-MR Image Registration Based on a Co-Sparse Analysis Model to Compensate for Brain Shift

Brain shift is an important obstacle to the application of image guidance during neurosurgical interventions. There has been a growing interest in intra-operative imaging to update the image-guided surgery systems. However, due to the innate limitations of the current imaging modalities, accurate brain shift compensation continues to be a challenging task. In this study, the application of intra-operative photoacoustic imaging and registration of the intra-operative photoacoustic with pre-operative MR images are proposed to compensate for brain deformation. Finding a satisfactory registration method is challenging due to the unpredictable nature of brain deformation. In this study, the co-sparse analysis model is proposed for photoacoustic-MR image registration, which can capture the interdependency of the two modalities. The proposed algorithm works based on the minimization of mapping transform via a pair of analysis operators that are learned by the alternating direction method of multipliers. The method was evaluated using an experimental phantom and ex vivo data obtained from a mouse brain. The results of the phantom data show about 63% improvement in target registration error in comparison with the commonly used normalized mutual information method. The results proved that intra-operative photoacoustic images could become a promising tool when the brain shift invalidates pre-operative MRI.

Adaptive Physics-Based Non-Rigid Registration for Immersive Image-Guided Neuronavigation Systems

Objective: In image-guided neurosurgery, co-registered preoperative anatomical, functional, and diffusion tensor imaging can be used to facilitate a safe resection of brain tumors in eloquent areas of the brain. However, the brain deforms during surgery, particularly in the presence of tumor resection. Non-Rigid Registration (NRR) of the preoperative image data can be used to create a registered image that captures the deformation in the intraoperative image while maintaining the quality of the preoperative image. Using clinical data, this paper reports the results of a comparison of the accuracy and performance among several non-rigid registration methods for handling brain deformation. A new adaptive method that automatically removes mesh elements in the area of the resected tumor, thereby handling deformation in the presence of resection is presented. To improve the user experience, we also present a new way of using mixed reality with ultrasound, MRI, and CT.

Materials and methods: This study focuses on 30 glioma surgeries performed at two different hospitals, many of which involved the resection of significant tumor volumes. An Adaptive Physics-Based Non-Rigid Registration method (A-PBNRR) registers preoperative and intraoperative MRI for each patient. The results are compared with three other readily available registration methods: a rigid registration implemented in 3D Slicer v4.4.0; a B-Spline non-rigid registration implemented in 3D Slicer v4.4.0; and PBNRR implemented in ITKv4.7.0, upon which A-PBNRR was based. Three measures were employed to facilitate a comprehensive evaluation of the registration accuracy: (i) visual assessment, (ii) a Hausdorff Distance-based metric, and (iii) a landmark-based approach using anatomical points identified by a neurosurgeon.

Results: The A-PBNRR using multi-tissue mesh adaptation improved the accuracy of deformable registration by more than five times compared to rigid and traditional physics based non-rigid registration, and four times compared to B-Spline interpolation methods which are part of ITK and 3D Slicer. Performance analysis showed that A-PBNRR could be applied, on average, in <2 min, achieving desirable speed for use in a clinical setting.

Conclusions: The A-PBNRR method performed significantly better than other readily available registration methods at modeling deformation in the presence of resection. Both the registration accuracy and performance proved sufficient to be of clinical value in the operating room. A-PBNRR, coupled with the mixed reality system, presents a powerful and affordable solution compared to current neuronavigation systems.

SLIMM: Slice localization integrated MRI monitoring

Functional MRI (fMRI) is extremely challenging to perform in subjects who move because subject motion disrupts blood oxygenation level dependent (BOLD) signal measurement. It has become common to use retrospective framewise motion detection and censoring in fMRI studies to eliminate artifacts arising from motion. Data censoring results in significant loss of data and statistical power unless the data acquisition is extended to acquire more data not corrupted by motion. Acquiring more data than is necessary leads to longer than necessary scan duration, which is more expensive and may lead to additional subject non-compliance. Therefore, it is well established that real-time prospective motion monitoring is crucial to ensure data quality and reduce imaging costs. In addition, real-time monitoring of motion allows for feedback to the operator and the subject during the acquisition, to enable intervention to reduce the subject motion. The most widely used form of motion monitoring for fMRI is based on volume-to-volume registration (VVR), which quantifies motion as the misalignment between subsequent volumes. However, motion is not constrained to occur only at the boundaries of volume acquisition, but instead may occur at any time. Consequently, each slice of an fMRI acquisition may be displaced by motion, and assessment of whole volume to volume motion may be insensitive to both intra-volume and inter-volume motion that is revealed by displacement of the slices. We developed the first slice-by-slice self-navigated motion monitoring system for fMRI by developing a real-time slice-to-volume registration (SVR) algorithm. Our real-time SVR algorithm, which is the core of the system, uses a local image patch-based matching criterion along with a Levenberg-Marquardt optimizer, all accelerated via symmetric multi-processing, with interleaved and simultaneous multi-slice acquisition schemes. Extensive experimental results on real motion data demonstrated that our fast motion monitoring system, named Slice Localization Integrated MRI Monitoring (SLIMM), provides more accurate motion measurements than a VVR based approach. Therefore, SLIMM offers improved online motion monitoring which is particularly important in fMRI for challenging patient populations. Real-time motion monitoring is crucial for online data quality control and assurance, for enabling feedback to the subject and the operator to act to mitigate motion, and in adaptive acquisition strategies that aim to ensure enough data of sufficient quality is acquired without acquiring excess data.

A Fast Subpixel Registration Algorithm Based on Single-Step DFT Combined with Phase Correlation Constraint in Multimodality Brain Image

Multimodality brain image registration technology is the key technology to determine the accuracy and speed of brain diagnosis and treatment. In order to achieve high-precision image registration, a fast subpixel registration algorithm based on single-step DFT combined with phase correlation constraint in multimodality brain image was proposed in this paper. Firstly, the coarse positioning at the pixel level was achieved by using the downsampling cross-correlation model, which reduced the Fourier transform dimension of the cross-correlation matrix and the multiplication of the discrete Fourier transform matrix, so as to speed up the coarse registration process. Then, the improved DFT multiplier of the matrix multiplication was used in the neighborhood of the coarse point, and the subpixel fast location was achieved by the bidirectional search strategy. Qualitative and quantitative simulation experiment results show that, compared with comparison registration algorithms, our proposed algorithm could greatly reduce space and time complexity without losing accuracy.

Model-Based Image Updating for Brain Shift in Deep Brain Stimulation Electrode Placement Surgery

OBJECTIVE

The efficacy of deep brain stimulation (DBS) depends on accurate placement of electrodes. Although stereotactic frames enable co-registration of image-based surgical planning and the operative field, the accuracy of electrode placement can be degraded by intra-operative brain shift. In this study, we adapted a biomechanical model to estimate whole brain displacements from which we deformed preoperative CT (preCT) to generate an updated CT (uCT) that compensates for brain shift.

METHODS

We drove the deformation model using displacement data derived from deformation in the frontal cortical surface that occurred during the DBS intervention. We evaluated 15 patients, retrospectively, who underwent bilateral DBS surgery, and assessed the accuracy of uCT in terms of target registration error (TRE) relative to a CT acquired post-placement (postCT). We further divided subjects into large (Group L) and small (Group S) deformation groups based on a TRE threshold of 1.6mm. Anterior commissure (AC), posterior commissure (PC) and pineal gland (PG) were identified on preCT and postCT and used to quantify TREs in preCT and uCT.

RESULTS

In the group of large brain deformation, average TREs for uCT were 1.11 ± 0.13 and 1.07 ± 0.38 mm at AC and PC, respectively, compared to 1.85 ± 0.17 and 0.92 ± 0.52 mm for preCT. The model updating approach improved AC localization but did not alter TREs at PC.

CONCLUSION

This preliminary study suggests that our image updating method may compensate for brain shift around surgical targets of importance during DBS surgery, although further investigation is warranted before conclusive evidence will be available.

SIGNIFICANCE

With further development and evaluation, our model-based image updating method using intraoperative sparse data may compensate for brain shift in DBS surgery efficiently, and have utility in updating targeting coordinates.

Image Updating for Brain Shift Compensation During Resection

BACKGROUND

In open-cranial neurosurgery, preoperative magnetic resonance (pMR) images are typically coregistered for intraoperative guidance. Their accuracy can be significantly degraded by intraoperative brain deformation, especially when resection is involved.

OBJECTIVE

To produce model updated MR (uMR) images to compensate for brain shift that occurred during resection, and evaluate the performance of the image-updating process in terms of accuracy and computational efficiency.

METHODS

In 14 resection cases, intraoperative stereovision image pairs were acquired after dural opening and during resection to generate displacement maps of the surgical field. These data were assimilated by a biomechanical model to create uMR volumes of the evolving surgical field. A tracked stylus provided independent measurements of feature locations to quantify target registration errors (TREs) in the original coregistered pMR and uMR as surgery progressed.

RESULTS

Updated MR TREs were 1.66 ± 0.27 and 1.92 ± 0.49 mm in the 14 cases after dural opening and after partial resection, respectively, compared to 8.48 ± 3.74 and 8.77 ± 4.61 mm for pMR, respectively. The overall computational time for generating uMRs after partial resection was less than 10 min.

CONCLUSION

We have developed an image-updating system to compensate for brain deformation during resection using a computational model with data assimilation of displacements measured with intraoperative stereovision imaging that maintains TREs less than 2 mm on average.

Blended alginate/collagen hydrogels promote neurogenesis and neuronal maturation

Brain extracellular matrix (ECM) is complex, heterogeneous and often poorly replicated in traditional 2D cell culture systems. The development of more physiologically relevant 3D cell models capable of emulating the native ECM is of paramount importance for the study of human induced pluripotent stem cell (iPSC)-derived neurons. Due to its structural similarity with hyaluronic acid, a primary component of brain ECM, alginate is a potential biomaterial for 3D cell culture systems. However, a lack of cell adhesion motifs within the chemical structure of alginate has limited its application in neural culture systems. This study presents a simple and accessible method of incorporating collagen fibrils into an alginate hydrogel by physical mixing and controlled gelation under physiological conditions and tests the hypothesis that such a substrate could influence the behaviour of human neurons in 3D culture. Regulation of the gelation process enabled the penetration of collagen fibrils throughout the hydrogel structure as demonstrated by transmission electron microscopy. Encapsulated human iPSC-derived neurons adhered to the blended hydrogel as evidenced by the increased expression of α1, α2 and β1 integrins. Furthermore, immunofluorescence microscopy revealed that encapsulated neurons formed complex neural networks and matured into branched neurons expressing synaptophysin, a key protein involved in neurotransmission, along the neurites. Mechanical tuning of the hydrogel stiffness by modulation of the alginate ionic crosslinker concentration also influenced neuron-specific gene expression. In conclusion, we have shown that by tuning the physicochemical properties of the alginate/collagen blend it is possible to create different ECM-like microenvironments where complex mechanisms underpinning the growth and development of human neurons can be simulated and systematically investigated.

•

Alginate and collagen are blended to create a bespoke hydrogel that mimics aspects of brain ECM.

•

Encapsulated human pluripotent stem cell derived neurons adhere to the hydrogel matrix and form 3D neural networks.

•

Neuronal differentiation and maturation is promoted within the hydrogel matrix.

•

Mechanical properties of the hydrogel can be easily tuned to optimise neurogenesis.

•

The hydrogel presents a platform for studying neuronal function and dysfunction in health and disease.

Visualization of Brain Shift Corrected Functional Magnetic Resonance Imaging Data for Intraoperative Brain Mapping

Background

Brain tumor surgery requires careful balance between maximizing tumor excision and preserving eloquent cortex. In some cases, the surgeon may opt to perform an awake craniotomy including intraoperative mapping of brain function by direct cortical stimulation (DCS) to assist in surgical decision-making. Preoperatively, functional magnetic resonance imaging (fMRI) facilitates planning by identification of eloquent brain areas, helping to guide DCS and other aspects of the surgical plan. However, brain deformation (shift) limits the usefulness of preoperative fMRI during surgery. To address this, an integrated visualization method for fMRI and DCS results is developed that is intuitive for the surgeon.

Methods

An image registration pipeline was constructed to display preoperative fMRI data corrected for brain shift overlaid on images of the exposed cortical surface at the beginning and completion of DCS mapping. Preoperative fMRI and DCS data were registered for a range of misalignments, and the residual registration errors were calculated. The pipeline was validated on imaging data from five brain tumor patients who underwent awake craniotomy.

Results

Registration errors were well under 5 mm (the approximate spatial resolution of DCS) for misalignments of up to 25 mm and approximately 10–15°. For rotational misalignments up to 20°, the success rate was 95% for an error tolerance of 5 mm. Failures were negligible for rotational misalignments up to 10°. Good quality registrations were observed for all five patients.

Conclusions

A proof-of-concept image registration pipeline is presented with acceptable accuracy for intraoperative use, providing multimodality visualization with potential benefits for intraoperative brain mapping.

Tractography Verified by Intraoperative Magnetic Resonance Imaging and Subcortical Stimulation During Tumor Resection Near the Corticospinal Tract

BACKGROUND

Tractography is a popular tool for visualizing the corticospinal tract (CST). However, results may be influenced by numerous variables, eg, the selection of seeding regions of interests (ROIs) or the chosen tracking algorithm.

OBJECTIVE

To compare different variable sets by correlating tractography results with intraoperative subcortical stimulation of the CST, correcting intraoperative brain shift by the use of intraoperative MRI.

METHODS

Seeding ROIs were created by means of motor cortex segmentation, functional MRI (fMRI), and navigated transcranial magnetic stimulation (nTMS). Based on these ROIs, tractography was run for each patient using a deterministic and a probabilistic algorithm. Tractographies were processed on pre- and postoperatively acquired data.

RESULTS

Using a linear mixed effects statistical model, best correlation between subcortical stimulation intensity and the distance between tractography and stimulation sites was achieved by using the segmented motor cortex as seeding ROI and applying the probabilistic algorithm on preoperatively acquired imaging sequences. Tractographies based on fMRI or nTMS results differed very little, but with enlargement of positive nTMS sites the stimulation-distance correlation of nTMS-based tractography improved.

CONCLUSION

Our results underline that the use of tractography demands for careful interpretation of its virtual results by considering all influencing variables.

Image Registration to Compensate for EPI Distortion in Patients with Brain Tumors: An Evaluation of Tract-Specific Effects

BACKGROUND AND PURPOSE

Diffusion magnetic resonance imaging (dMRI) provides preoperative maps of neurosurgical patients' white matter tracts, but these maps suffer from echo-planar imaging (EPI) distortions caused by magnetic field inhomogeneities. In clinical neurosurgical planning, these distortions are generally not corrected and thus contribute to the uncertainty of fiber tracking. Multiple image processing pipelines have been proposed for image-registration-based EPI distortion correction in healthy subjects. In this article, we perform the first comparison of such pipelines in neurosurgical patient data.

METHODS

Five pipelines were tested in a retrospective clinical dMRI dataset of 9 patients with brain tumors. Pipelines differed in the choice of fixed and moving images and the similarity metric for image registration. Distortions were measured in two important tracts for neurosurgery, the arcuate fasciculus and corticospinal tracts.

RESULTS

Significant differences in distortion estimates were found across processing pipelines. The most successful pipeline used dMRI baseline and T2-weighted images as inputs for distortion correction. This pipeline gave the most consistent distortion estimates across image resolutions and brain hemispheres.

CONCLUSIONS

Quantitative results of mean tract distortions on the order of 1-2 mm are in line with other recent studies, supporting the potential need for distortion correction in neurosurgical planning. Novel results include significantly higher distortion estimates in the tumor hemisphere and greater effect of image resolution choice on results in the tumor hemisphere. Overall, this study demonstrates possible pitfalls and indicates that care should be taken when implementing EPI distortion correction in clinical settings.

Challenges and techniques for presurgical brain mapping with functional MRI

Functional magnetic resonance imaging (fMRI) is increasingly used for preoperative counseling and planning, and intraoperative guidance for tumor resection in the eloquent cortex. Although there have been improvements in image resolution and artifact correction, there are still limitations of this modality. In this review, we discuss clinical fMRI's applications, limitations and potential solutions. These limitations depend on the following parameters: foundations of fMRI, physiologic effects of the disease, distinctions between clinical and research fMRI, and the design of the fMRI study. We also compare fMRI to other brain mapping modalities which should be considered as alternatives or adjuncts when appropriate, and discuss intraoperative use and validation of fMRI. These concepts direct the clinical application of fMRI in neurosurgical patients.

Intraoperative Imaging Modalities and Compensation for Brain Shift in Tumor Resection Surgery

Intraoperative brain shift during neurosurgical procedures is a well-known phenomenon caused by gravity, tissue manipulation, tumor size, loss of cerebrospinal fluid (CSF), and use of medication. For the use of image-guided systems, this phenomenon greatly affects the accuracy of the guidance. During the last several decades, researchers have investigated how to overcome this problem. The purpose of this paper is to present a review of publications concerning different aspects of intraoperative brain shift especially in a tumor resection surgery such as intraoperative imaging systems, quantification, measurement, modeling, and registration techniques. Clinical experience of using intraoperative imaging modalities, details about registration, and modeling methods in connection with brain shift in tumor resection surgery are the focuses of this review. In total, 126 papers regarding this topic are analyzed in a comprehensive summary and are categorized according to fourteen criteria. The result of the categorization is presented in an interactive web tool. The consequences from the categorization and trends in the future are discussed at the end of this work.

A combined registration and finite element analysis method for fast estimation of intraoperative brain shift; phantom and animal model study

BACKGROUND

Finite element models for estimation of intraoperative brain shift suffer from huge computational cost. In these models, image registration and finite element analysis are two time-consuming processes.

METHODS

The proposed method is an improved version of our previously developed Finite Element Drift (FED) registration algorithm. In this work the registration process is combined with the finite element analysis. In the Combined FED (CFED), the deformation of whole brain mesh is iteratively calculated by geometrical extension of a local load vector which is computed by FED.

RESULTS

While the processing time of the FED-based method including registration and finite element analysis was about 70 s, the computation time of the CFED was about 3.2 s. The computational cost of CFED is almost 50% less than similar state of the art brain shift estimators based on finite element models.

CONCLUSIONS

The proposed combination of registration and structural analysis can make the calculation of brain deformation much faster.

How to image cell adhesion on soft polymers?

Here, we present a method to investigate cell adhesion on soft, non-conducting polymers that are implant candidate materials. Neuronal cells were grown on two elastomers (polydimethylsiloxane (PDMS) and Ecoflex^®) and prepared for electron microscopy. The samples were treated with osmium tetroxide (OsO₄) and uranylacetate (UrAc). Best results can be achieved when the polymers were coated with a thin iridium layer before the cell culture. This was done to emphasize the usage of soft polymers as supports for implant electrodes. A good contrast and the adhesion of the cells on soft polymers could be visualized.

Intraoperative image updating for brain shift following dural opening

OBJECTIVE Preoperative magnetic resonance images (pMR) are typically coregistered to provide intraoperative navigation, the accuracy of which can be significantly compromised by brain deformation. In this study, the authors generated updated MR images (uMR) in the operating room (OR) to compensate for brain shift due to dural opening, and evaluated the accuracy and computational efficiency of the process. METHODS In 20 open cranial neurosurgical cases, a pair of intraoperative stereovision (iSV) images was acquired after dural opening to reconstruct a 3D profile of the exposed cortical surface. The iSV surface was registered with pMR to detect cortical displacements that were assimilated by a biomechanical model to estimate whole-brain nonrigid deformation and produce uMR in the OR. The uMR views were displayed on a commercial navigation system and compared side by side with the corresponding coregistered pMR. A tracked stylus was used to acquire coordinate locations of features on the cortical surface that served as independent positions for calculating target registration errors (TREs) for the coregistered uMR and pMR image volumes. RESULTS The uMR views were visually more accurate and well aligned with the iSV surface in terms of both geometry and texture compared with pMR where misalignment was evident. The average misfit between model estimates and measured displacements was 1.80 ± 0.35 mm, compared with the average initial misfit of 7.10 ± 2.78 mm between iSV and pMR, and the average TRE was 1.60 ± 0.43 mm across the 20 patients in the uMR image volume, compared with 7.31 ± 2.82 mm on average in the pMR cases. The iSV also proved to be accurate with an average error of 1.20 ± 0.37 mm. The overall computational time required to generate the uMR views was 7-8 minutes. CONCLUSIONS This study compensated for brain deformation caused by intraoperative dural opening using computational model-based assimilation of iSV cortical surface displacements. The uMR proved to be more accurate in terms of model-data misfit and TRE in the 20 patient cases evaluated relative to pMR. The computational time was acceptable (7-8 minutes) and the process caused minimal interruption of surgical workflow.

Brain shift in neuronavigation of brain tumors: A review

PURPOSE

Neuronavigation based on preoperative imaging data is a ubiquitous tool for image guidance in neurosurgery. However, it is rendered unreliable when brain shift invalidates the patient-to-image registration. Many investigators have tried to explain, quantify, and compensate for this phenomenon to allow extended use of neuronavigation systems for the duration of surgery. The purpose of this paper is to present an overview of the work that has been done investigating brain shift.

METHODS

A review of the literature dealing with the explanation, quantification and compensation of brain shift is presented. The review is based on a systematic search using relevant keywords and phrases in PubMed. The review is organized based on a developed taxonomy that classifies brain shift as occurring due to physical, surgical or biological factors.

RESULTS

This paper gives an overview of the work investigating, quantifying, and compensating for brain shift in neuronavigation while describing the successes, setbacks, and additional needs in the field. An analysis of the literature demonstrates a high variability in the methods used to quantify brain shift as well as a wide range in the measured magnitude of the brain shift, depending on the specifics of the intervention. The analysis indicates the need for additional research to be done in quantifying independent effects of brain shift in order for some of the state of the art compensation methods to become useful.

CONCLUSION

This review allows for a thorough understanding of the work investigating brain shift and introduces the needs for future avenues of investigation of the phenomenon.

Effects of geometry and material on the insertion of very small neural electrode

For neural probes to be used chronically for years in the human body, they must provoke minimal scarring. Recently, a number of groups have reported substantially reduced scar tissue using cellular scale electrodes below 15 μm in size. This size scale is accessible to manufacturing techniques, but can be very difficult to insert in the brain for most common electrode materials. In this study, we explore the design space available to cellular scale electrodes that will self-insert into the brain. First a mathematical model is developed using beam buckling equations for different materials and geometries. Buckling mode was found to be one fixed and one hinged end resulting in a mode conditional constant of, n, 2.045. Model predicts insertion success between 90-100% for a 6.8 μm diameter electrode and was used to approximate applied force as 750 μN which is close to reference data of 780 μN [1]. Second, we developed a PVC phantom that mimics the brain's elastic modulus. This phantom was matched to insertion success data obtained from carbon fiber arrays [1]. Overall, these results enable studies to be conducted on other proposed cellular scale electrodes prior to animal testing or large scale fabrication.

A hybrid approach for fusing 4D-MRI temporal information with 3D-CT for the study of lung and lung tumor motion

PURPOSE

Accurate visualization of lung motion is important in many clinical applications, such as radiotherapy of lung cancer. Advancement in imaging modalities [e.g., computed tomography (CT) and MRI] has allowed dynamic imaging of lung and lung tumor motion. However, each imaging modality has its advantages and disadvantages. The study presented in this paper aims at generating synthetic 4D-CT dataset for lung cancer patients by combining both continuous three-dimensional (3D) motion captured by 4D-MRI and the high spatial resolution captured by CT using the authors' proposed approach.

METHODS

A novel hybrid approach based on deformable image registration (DIR) and finite element method simulation was developed to fuse a static 3D-CT volume (acquired under breath-hold) and the 3D motion information extracted from 4D-MRI dataset, creating a synthetic 4D-CT dataset.

RESULTS

The study focuses on imaging of lung and lung tumor. Comparing the synthetic 4D-CT dataset with the acquired 4D-CT dataset of six lung cancer patients based on 420 landmarks, accurate results (average error <2 mm) were achieved using the authors' proposed approach. Their hybrid approach achieved a 40% error reduction (based on landmarks assessment) over using only DIR techniques.

CONCLUSIONS

The synthetic 4D-CT dataset generated has high spatial resolution, has excellent lung details, and is able to show movement of lung and lung tumor over multiple breathing cycles.

Marker-less tracking of brain surface deformations by non-rigid registration integrating surface and vessel/sulci features

PURPOSE

To compensate for brain shift in image-guided neurosurgery, we propose a new non-rigid registration method that integrates surface and vessel/sulci feature to noninvasively track the brain surface.

METHOD

Textured brain surfaces were acquired using phase-shift three-dimensional (3D) shape measurement, which offers 2D image pixels and their corresponding 3D points directly. Measured brain surfaces were noninvasively tracked using the proposed method by minimizing a new energy function, which is a weighted combination of 3D point corresponding estimation and surface deformation constraints. Initially, the measured surfaces were divided into featured and non-featured parts using a Frangi filter. The corresponding feature/non-feature points between intraoperative brain surfaces were estimated using the closest point algorithm. Subsequently, smoothness and rigidity constraints were introduced in the energy function for a smooth surface deformation and local surface detail conservation, respectively. Our 3D shape measurement accuracy was evaluated using 20 spheres for bias and precision errors. In addition, the proposed method was evaluated based on root mean square error (RMSE) and target registration error (TRE) with five porcine brains for which deformations were produced by gravity and pushing with different displacements in both the vertical and horizontal directions.

RESULTS

The minimum and maximum bias errors were 0.32 and 0.61 mm, respectively. The minimum and maximum precision errors were 0.025 and 0.30 mm, respectively. Quantitative validation with porcine brains showed that the average RMSE and TRE were 0.1 and 0.9 mm, respectively.

CONCLUSION

The proposed method appeared to be advantageous in integrating vessels/sulci feature, robust to changes in deformation magnitude and integrated feature numbers, and feasible in compensating for brain shift deformation in surgeries.

3D-2D Deformable Image Registration Using Feature-Based Nonuniform Meshes

By using prior information of planning CT images and feature-based nonuniform meshes, this paper demonstrates that volumetric images can be efficiently registered with a very small portion of 2D projection images of a Cone-Beam Computed Tomography (CBCT) scan. After a density field is computed based on the extracted feature edges from planning CT images, nonuniform tetrahedral meshes will be automatically generated to better characterize the image features according to the density field; that is, finer meshes are generated for features. The displacement vector fields (DVFs) are specified at the mesh vertices to drive the deformation of original CT images. Digitally reconstructed radiographs (DRRs) of the deformed anatomy are generated and compared with corresponding 2D projections. DVFs are optimized to minimize the objective function including differences between DRRs and projections and the regularity. To further accelerate the above 3D-2D registration, a procedure to obtain good initial deformations by deforming the volume surface to match 2D body boundary on projections has been developed. This complete method is evaluated quantitatively by using several digital phantoms and data from head and neck cancer patients. The feature-based nonuniform meshing method leads to better results than either uniform orthogonal grid or uniform tetrahedral meshes.

4D cone-beam CT reconstruction using multi-organ meshes for sliding motion modeling

A simultaneous motion estimation and image reconstruction (SMEIR) strategy was proposed for 4D cone-beam CT (4D-CBCT) reconstruction and showed excellent results in both phantom and lung cancer patient studies. In the original SMEIR algorithm, the deformation vector field (DVF) was defined on voxel grid and estimated by enforcing a global smoothness regularization term on the motion fields. The objective of this work is to improve the computation efficiency and motion estimation accuracy of SMEIR for 4D-CBCT through developing a multi-organ meshing model. Feature-based adaptive meshes were generated to reduce the number of unknowns in the DVF estimation and accurately capture the organ shapes and motion. Additionally, the discontinuity in the motion fields between different organs during respiration was explicitly considered in the multi-organ mesh model. This will help with the accurate visualization and motion estimation of the tumor on the organ boundaries in 4D-CBCT. To further improve the computational efficiency, a GPU-based parallel implementation was designed. The performance of the proposed algorithm was evaluated on a synthetic sliding motion phantom, a 4D NCAT phantom, and four lung cancer patients. The proposed multi-organ mesh based strategy outperformed the conventional Feldkamp-Davis-Kress, iterative total variation minimization, original SMEIR and single meshing method based on both qualitative and quantitative evaluations.

Superficial vessel reconstruction with a multiview camera system

We aim at reconstructing superficial vessels of the brain. Ultimately, they will serve to guide the deformation methods to compensate for the brain shift. A pipeline for three-dimensional (3-D) vessel reconstruction using three mono-complementary metal-oxide semiconductor cameras has been developed. Vessel centerlines are manually selected in the images. Using the properties of the Hessian matrix, the centerline points are assigned direction information. For correspondence matching, a combination of methods was used. The process starts with epipolar and spatial coherence constraints (geometrical constraints), followed by relaxation labeling and an iterative filtering where the 3-D points are compared to surfaces obtained using the thin-plate spline with decreasing relaxation parameter. Finally, the points are shifted to their local centroid position. Evaluation in virtual, phantom, and experimental images, including intraoperative data from patient experiments, shows that, with appropriate camera positions, the error estimates (root-mean square error and mean error) are [Formula: see text].

Symmetric Biomechanically Guided Prone-to-Supine Breast Image Registration

Prone-to-supine breast image registration has potential application in the fields of surgical and radiotherapy planning, image guided interventions, and multi-modal cancer diagnosis, staging, and therapy response prediction. However, breast image registration of three dimensional images acquired in different patient positions is a challenging problem, due to large deformations induced to the soft breast tissue caused by the change in gravity loading. We present a symmetric, biomechanical simulation based registration framework which aligns the images in a central, virtually unloaded configuration. The breast tissue is modelled as a neo-Hookean material and gravity is considered as the main source of deformation in the original images. In addition to gravity, our framework successively applies image derived forces directly into the unloading simulation in place of a subsequent image registration step. This results in a biomechanically constrained deformation. Using a finite difference scheme avoids an explicit meshing step and enables simulations to be performed directly in the image space. The explicit time integration scheme allows the motion at the interface between chest and breast to be constrained along the chest wall. The feasibility and accuracy of the approach presented here was assessed by measuring the target registration error (TRE) using a numerical phantom with known ground truth deformations, nine clinical prone MRI and supine CT image pairs, one clinical prone-supine CT image pair and four prone-supine MRI image pairs. The registration reduced the mean TRE for the numerical phantom experiment from initially 19.3 to 0.9 mm and the combined mean TRE for all fourteen clinical data sets from 69.7 to 5.6 mm.

Clinical evaluation of a model-updated image-guidance approach to brain shift compensation: experience in 16 cases

PURPOSE

Brain shift during neurosurgical procedures must be corrected for in order to reestablish accurate alignment for successful image-guided tumor resection. Sparse-data-driven biomechanical models that predict physiological brain shift by accounting for typical deformation-inducing events such as cerebrospinal fluid drainage, hyperosmotic drugs, swelling, retraction, resection, and tumor cavity collapse are an inexpensive solution. This study evaluated the robustness and accuracy of a biomechanical model-based brain shift correction system to assist with tumor resection surgery in 16 clinical cases.

METHODS

Preoperative computation involved the generation of a patient-specific finite element model of the brain and creation of an atlas of brain deformation solutions calculated using a distribution of boundary and deformation-inducing forcing conditions (e.g., sag, tissue contraction, and tissue swelling). The optimum brain shift solution was determined using an inverse problem approach which linearly combines solutions from the atlas to match the cortical surface deformation data collected intraoperatively. The computed deformations were then used to update the preoperative images for all 16 patients.

RESULTS

The mean brain shift measured ranged on average from 2.5 to 21.3 mm, and the biomechanical model-based correction system managed to account for the bulk of the brain shift, producing a mean corrected error ranging on average from 0.7 to 4.0 mm.

CONCLUSIONS

Biomechanical models are an inexpensive means to assist intervention via correction for brain deformations that can compromise surgical navigation systems. To our knowledge, this study represents the most comprehensive clinical evaluation of a deformation correction pipeline for image-guided neurosurgery.

Volumetric Measurements of Brain Shift Using Intraoperative Cone-Beam Computed Tomography: Preliminary Study

BACKGROUND

Cerebrospinal fluid leakage and ventricular compression during open surgery may lead to brain deformation called brain shift. Brain shift may affect intraoperative navigation that is based on image-based preoperative planning. Tools to correct or predict these anatomic modifications can be important to maintain precision during open guided neurosurgery.

OBJECTIVE

To obtain a reliable intraoperative volumetric deformation vector field describing brain shift during intracranial neurosurgical procedures.

METHODS

We acquired preoperative and intraoperative cone-beam computed tomography enhanced with intravenous injection of iodine contrast. These data sets were preprocessed and elastically registered to obtain the volumetric brain shift deformation vector fields.

RESULTS

We obtained the brain shift deformation vector field in 9 cases. The deformation fields proved to be highly nonlinear, particularly around the ventricles. Interpatient variability was considerable, with a maximum deformation ranging from 8.1 to 26.6 mm and a standard deviation ranging from 0.9 to 4.9 mm.

CONCLUSION

Contrast-enhanced cone-beam computed tomography provides a feasible technique for intraoperatively determining brain shift deformation vector fields. This technique can be used perioperatively to adjust preoperative planning and coregistration during neurosurgical procedures.

A nonrigid registration method for correcting brain deformation induced by tumor resection

PURPOSE

This paper presents a nonrigid registration method to align preoperative MRI with intraoperative MRI to compensate for brain deformation during tumor resection. This method extends traditional point-based nonrigid registration in two aspects: (1) allow the input data to be incomplete and (2) simulate the underlying deformation with a heterogeneous biomechanical model.

METHODS

The method formulates the registration as a three-variable (point correspondence, deformation field, and resection region) functional minimization problem, in which point correspondence is represented by a fuzzy assign matrix; Deformation field is represented by a piecewise linear function regularized by the strain energy of a heterogeneous biomechanical model; and resection region is represented by a maximal simply connected tetrahedral mesh. A nested expectation and maximization framework is developed to simultaneously resolve these three variables.

RESULTS

To evaluate this method, the authors conducted experiments on both synthetic data and clinical MRI data. The synthetic experiment confirmed their hypothesis that the removal of additional elements from the biomechanical model can improve the accuracy of the registration. The clinical MRI experiments on 25 patients showed that the proposed method outperforms the ITK implementation of a physics-based nonrigid registration method. The proposed method improves the accuracy by 2.88 mm on average when the error is measured by a robust Hausdorff distance metric on Canny edge points, and improves the accuracy by 1.56 mm on average when the error is measured by six anatomical points.

CONCLUSIONS

The proposed method can effectively correct brain deformation induced by tumor resection.

Stereovision to MR image registration for cortical surface displacement mapping to enhance image-guided neurosurgery

PURPOSE

A surface registration method is presented to align intraoperative stereovision (iSV) with preoperative magnetic resonance (pMR) images, which utilizes both geometry and texture information to extract tissue displacements as part of the overall process of compensating for intraoperative brain deformation in order to maintain accurate neuronavigational image guidance during surgery.

METHODS

A sum-of-squared-difference rigid image registration was first executed to detect lateral shift of the cortical surface and was followed by a mutual-information-based block matching method to detect local nonrigid deformation caused by distention or collapse of the cortical surface. Ten (N = 10) surgical cases were evaluated in which an independent point measurement of a dominant cortical surface feature location was recorded with a tracked stylus in each case and compared to its surface-registered counterpart. The full three-dimensional (3D) displacement field was also extracted to drive a biomechanical brain deformation model, the results of which were reconciled with the reconstructed iSV surface as another form of evaluation.

RESULTS

Differences between the tracked stylus coordinates of cortical surface features and their surface-registered locations were 1.94 ± 0.59 mm on average across the ten cases. When the complete displacement map derived from surface registration was utilized, the resulting images generated from mechanical model updates were consistent in terms of both geometry (1-2 mm of model misfit) and texture, and were generated with less than 10 min of computational time. Analysis of the surface-registered 3D displacements indicate that the magnitude of motion ranged from 4.03 to 9.79 mm in the ten patient cases, and the amount of lateral shift was not related statistically to the direction of gravity (p = 0.73 ≫ 0.05) or the craniotomy size (p = 0.48 ≫ 0.05) at the beginning of surgery.

CONCLUSIONS

The iSV-pMR surface registration method utilizes texture and geometry information to extract both global lateral shift and local nonrigid movement of the cortical surface in 3D. The results suggest small differences exist in surface-registered locations when compared to positions measured independently with a coregistered stylus and when the full iSV surface was aligned with model-updated MR. The effectiveness and efficiency of the registration method is also minimally disruptive to surgical workflow.

Towards measuring neuroimage misalignment

To enhance neuro-navigation, high quality pre-operative images must be registered onto intra-operative configuration of the brain. Therefore evaluation of the degree to which structures may remain misaligned after registration is critically important. We consider two Hausdorff Distance (HD)-based evaluation approaches: the edge-based HD (EBHD) metric and the Robust HD (RHD) metric as well as various commonly used intensity-based similarity metrics such as Mutual Information (MI), Normalised Mutual Information (NMI), Entropy Correlation Coefficient (ECC), Kullback-Leibler Distance (KLD) and Correlation Ratio (CR). We conducted the evaluation by applying known deformations to simple sample images and real cases of brain shift. We conclude that the intensity-based similarity metrics such as MI, NMI, ECC, KLD and CR do not correlate well with actual alignment errors, and hence are not useful for assessing misalignment. On the contrary, the EBHD and the RHD metrics correlated well with actual alignment errors; however, they have been found to underestimate the actual misalignment. We also note that it is beneficial to present HD results as a percentile-HD curve rather than a single number such as the 95-percentile HD. Percentile-HD curves present the full range of alignment errors and also facilitate the comparison of results obtained using different approaches. Furthermore, the qualities that should be possessed by an ideal evaluation metric were highlighted. Future studies could focus on developing such an evaluation metric.

Characterisation and modelling of brain tissue for surgical simulation

Interactive surgical simulators capable of providing a realistic visual and haptic feedback to users are a promising technology for medical training and surgery planification. However, modelling the physical behaviour of human organs and tissues for surgery simulation remains a challenge. On the one hand, this is due to the difficulty to characterise the physical properties of biological soft tissues. On the other hand, the challenge still remains in the computation time requirements of real-time simulation required in interactive systems. Real-time surgical simulation and medical training must employ a sufficiently accurate and simple model of soft tissues in order to provide a realistic haptic and visual response. This study attempts to characterise the brain tissue at similar conditions to those that take place on surgical procedures. With this aim, porcine brain tissue is characterised, as a surrogate of human brain, on a rotational rheometer at low strain rates and large strains. In order to model the brain tissue with an adequate level of accuracy and simplicity, linear elastic, hyperelastic and quasi-linear viscoelastic models are defined. These models are simulated using the ABAQUS finite element platform and compared with the obtained experimental data.

Computing global minimizers to a constrained B-spline image registration problem from optimal l1 perturbations to block match data

PURPOSE

Block matching is a well-known strategy for estimating corresponding voxel locations between a pair of images according to an image similarity metric. Though robust to issues such as image noise and large magnitude voxel displacements, the estimated point matches are not guaranteed to be spatially accurate. However, the underlying optimization problem solved by the block matching procedure is similar in structure to the class of optimization problem associated with B-spline based registration methods. By exploiting this relationship, the authors derive a numerical method for computing a global minimizer to a constrained B-spline registration problem that incorporates the robustness of block matching with the global smoothness properties inherent to B-spline parameterization.

METHODS

The method reformulates the traditional B-spline registration problem as a basis pursuit problem describing the minimall1-perturbation to block match pairs required to produce a B-spline fitting error within a given tolerance. The sparsity pattern of the optimal perturbation then defines a voxel point cloud subset on which the B-spline fit is a global minimizer to a constrained variant of the B-spline registration problem. As opposed to traditional B-spline algorithms, the optimization step involving the actual image data is addressed by block matching.

RESULTS

The performance of the method is measured in terms of spatial accuracy using ten inhale/exhale thoracic CT image pairs (available for download atwww.dir-lab.com) obtained from the COPDgene dataset and corresponding sets of expert-determined landmark point pairs. The results of the validation procedure demonstrate that the method can achieve a high spatial accuracy on a significantly complex image set.

CONCLUSIONS

The proposed methodology is demonstrated to achieve a high spatial accuracy and is generalizable in that in can employ any displacement field parameterization described as a least squares fit to block match generated estimates. Thus, the framework allows for a wide range of image similarity block match metric and physical modeling combinations.

Near Real-Time Computer Assisted Surgery for Brain Shift Correction Using Biomechanical Models

Conventional image-guided neurosurgery relies on preoperative images to provide surgical navigational information and visualization. However, these images are no longer accurate once the skull has been opened and brain shift occurs. To account for changes in the shape of the brain caused by mechanical (e.g., gravity-induced deformations) and physiological effects (e.g., hyperosmotic drug-induced shrinking, or edema-induced swelling), updated images of the brain must be provided to the neuronavigation system in a timely manner for practical use in the operating room. In this paper, a novel preoperative and intraoperative computational processing pipeline for near real-time brain shift correction in the operating room was developed to automate and simplify the processing steps. Preoperatively, a computer model of the patient's brain with a subsequent atlas of potential deformations due to surgery is generated from diagnostic image volumes. In the case of interim gross changes between diagnosis, and surgery when reimaging is necessary, our preoperative pipeline can be generated within one day of surgery. Intraoperatively, sparse data measuring the cortical brain surface is collected using an optically tracked portable laser range scanner. These data are then used to guide an inverse modeling framework whereby full volumetric brain deformations are reconstructed from precomputed atlas solutions to rapidly match intraoperative cortical surface shift measurements. Once complete, the volumetric displacement field is used to update, i.e., deform, preoperative brain images to their intraoperative shifted state. In this paper, five surgical cases were analyzed with respect to the computational pipeline and workflow timing. With respect to postcortical surface data acquisition, the approximate execution time was 4.5 min. The total update process which included positioning the scanner, data acquisition, inverse model processing, and image deforming was ~11-13 min. In addition, easily implemented hardware, software, and workflow processes were identified for improved performance in the near future.

An ITK implementation of a physics-based non-rigid registration method for brain deformation in image-guided neurosurgery

As part of the ITK v4 project efforts, we have developed ITK filters for physics-based non-rigid registration (PBNRR), which satisfies the following requirements: account for tissue properties in the registration, improve accuracy compared to rigid registration, and reduce execution time using GPU and multi-core accelerators. The implementation has three main components: (1) Feature Point Selection, (2) Block Matching (mapped to both multi-core and GPU processors), and (3) a Robust Finite Element Solver. The use of multi-core and GPU accelerators in ITK v4 provides substantial performance improvements. For example, for the non-rigid registration of brain MRIs, the performance of the block matching filter on average is about 10 times faster when 12 hyperthreaded multi-cores are used and about 83 times faster when the NVIDIA Tesla GPU is used in Dell Workstation.