1
|
Qi Z, Jin H, Wang Q, Gan Z, Xiong R, Zhang S, Liu M, Wang J, Ding X, Chen X, Zhang J, Nimsky C, Bopp MHA. The Feasibility and Accuracy of Holographic Navigation with Laser Crosshair Simulator Registration on a Mixed-Reality Display. SENSORS (BASEL, SWITZERLAND) 2024; 24:896. [PMID: 38339612 PMCID: PMC10857152 DOI: 10.3390/s24030896] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/04/2024] [Revised: 01/21/2024] [Accepted: 01/23/2024] [Indexed: 02/12/2024]
Abstract
Addressing conventional neurosurgical navigation systems' high costs and complexity, this study explores the feasibility and accuracy of a simplified, cost-effective mixed reality navigation (MRN) system based on a laser crosshair simulator (LCS). A new automatic registration method was developed, featuring coplanar laser emitters and a recognizable target pattern. The workflow was integrated into Microsoft's HoloLens-2 for practical application. The study assessed the system's precision by utilizing life-sized 3D-printed head phantoms based on computed tomography (CT) or magnetic resonance imaging (MRI) data from 19 patients (female/male: 7/12, average age: 54.4 ± 18.5 years) with intracranial lesions. Six to seven CT/MRI-visible scalp markers were used as reference points per case. The LCS-MRN's accuracy was evaluated through landmark-based and lesion-based analyses, using metrics such as target registration error (TRE) and Dice similarity coefficient (DSC). The system demonstrated immersive capabilities for observing intracranial structures across all cases. Analysis of 124 landmarks showed a TRE of 3.0 ± 0.5 mm, consistent across various surgical positions. The DSC of 0.83 ± 0.12 correlated significantly with lesion volume (Spearman rho = 0.813, p < 0.001). Therefore, the LCS-MRN system is a viable tool for neurosurgical planning, highlighting its low user dependency, cost-efficiency, and accuracy, with prospects for future clinical application enhancements.
Collapse
Affiliation(s)
- Ziyu Qi
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany;
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (H.J.); (Q.W.); (Z.G.); (S.Z.); (M.L.); (J.W.); (X.D.); (X.C.); (J.Z.)
| | - Haitao Jin
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (H.J.); (Q.W.); (Z.G.); (S.Z.); (M.L.); (J.W.); (X.D.); (X.C.); (J.Z.)
- Medical School of Chinese PLA, Beijing 100853, China
- NCO School, Army Medical University, Shijiazhuang 050081, China
| | - Qun Wang
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (H.J.); (Q.W.); (Z.G.); (S.Z.); (M.L.); (J.W.); (X.D.); (X.C.); (J.Z.)
| | - Zhichao Gan
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (H.J.); (Q.W.); (Z.G.); (S.Z.); (M.L.); (J.W.); (X.D.); (X.C.); (J.Z.)
- Medical School of Chinese PLA, Beijing 100853, China
| | - Ruochu Xiong
- Department of Neurosurgery, Division of Medicine, Graduate School of Medical Sciences, Kanazawa University, Takara-machi 13-1, Kanazawa 920-8641, Japan;
| | - Shiyu Zhang
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (H.J.); (Q.W.); (Z.G.); (S.Z.); (M.L.); (J.W.); (X.D.); (X.C.); (J.Z.)
- Medical School of Chinese PLA, Beijing 100853, China
| | - Minghang Liu
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (H.J.); (Q.W.); (Z.G.); (S.Z.); (M.L.); (J.W.); (X.D.); (X.C.); (J.Z.)
- Medical School of Chinese PLA, Beijing 100853, China
| | - Jingyue Wang
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (H.J.); (Q.W.); (Z.G.); (S.Z.); (M.L.); (J.W.); (X.D.); (X.C.); (J.Z.)
- Medical School of Chinese PLA, Beijing 100853, China
| | - Xinyu Ding
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (H.J.); (Q.W.); (Z.G.); (S.Z.); (M.L.); (J.W.); (X.D.); (X.C.); (J.Z.)
- Medical School of Chinese PLA, Beijing 100853, China
| | - Xiaolei Chen
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (H.J.); (Q.W.); (Z.G.); (S.Z.); (M.L.); (J.W.); (X.D.); (X.C.); (J.Z.)
| | - Jiashu Zhang
- Department of Neurosurgery, First Medical Center of Chinese PLA General Hospital, Beijing 100853, China; (H.J.); (Q.W.); (Z.G.); (S.Z.); (M.L.); (J.W.); (X.D.); (X.C.); (J.Z.)
| | - Christopher Nimsky
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany;
- Center for Mind, Brain and Behavior (CMBB), 35043 Marburg, Germany
| | - Miriam H. A. Bopp
- Department of Neurosurgery, University of Marburg, Baldingerstrasse, 35043 Marburg, Germany;
- Center for Mind, Brain and Behavior (CMBB), 35043 Marburg, Germany
| |
Collapse
|
2
|
Safdar S, Zwick BF, Yu Y, Bourantas GC, Joldes GR, Warfield SK, Hyde DE, Frisken S, Kapur T, Kikinis R, Golby A, Nabavi A, Wittek A, Miller K. SlicerCBM: automatic framework for biomechanical analysis of the brain. Int J Comput Assist Radiol Surg 2023; 18:1925-1940. [PMID: 37004646 PMCID: PMC10497672 DOI: 10.1007/s11548-023-02881-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Accepted: 03/17/2023] [Indexed: 04/04/2023]
Abstract
PURPOSE Brain shift that occurs during neurosurgery disturbs the brain's anatomy. Prediction of the brain shift is essential for accurate localisation of the surgical target. Biomechanical models have been envisaged as a possible tool for such predictions. In this study, we created a framework to automate the workflow for predicting intra-operative brain deformations. METHODS We created our framework by uniquely combining our meshless total Lagrangian explicit dynamics (MTLED) algorithm for computing soft tissue deformations, open-source software libraries and built-in functions within 3D Slicer, an open-source software package widely used for medical research. Our framework generates the biomechanical brain model from the pre-operative MRI, computes brain deformation using MTLED and outputs results in the form of predicted warped intra-operative MRI. RESULTS Our framework is used to solve three different neurosurgical brain shift scenarios: craniotomy, tumour resection and electrode placement. We evaluated our framework using nine patients. The average time to construct a patient-specific brain biomechanical model was 3 min, and that to compute deformations ranged from 13 to 23 min. We performed a qualitative evaluation by comparing our predicted intra-operative MRI with the actual intra-operative MRI. For quantitative evaluation, we computed Hausdorff distances between predicted and actual intra-operative ventricle surfaces. For patients with craniotomy and tumour resection, approximately 95% of the nodes on the ventricle surfaces are within two times the original in-plane resolution of the actual surface determined from the intra-operative MRI. CONCLUSION Our framework provides a broader application of existing solution methods not only in research but also in clinics. We successfully demonstrated the application of our framework by predicting intra-operative deformations in nine patients undergoing neurosurgical procedures.
Collapse
Affiliation(s)
- Saima Safdar
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, 35 Stirling Highway, Perth, WA, Australia.
| | - Benjamin F Zwick
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, 35 Stirling Highway, Perth, WA, Australia
| | - Yue Yu
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, 35 Stirling Highway, Perth, WA, Australia
| | - George C Bourantas
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, 35 Stirling Highway, Perth, WA, Australia
- Department of Agriculture, University of Patras Nea Ktiria, 30200, Campus Mesologhi, Greece
| | - Grand R Joldes
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, 35 Stirling Highway, Perth, WA, Australia
| | - Simon K Warfield
- Computational Radiology Laboratory, Boston Children's Hospital, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
| | - Damon E Hyde
- Computational Radiology Laboratory, Boston Children's Hospital, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
| | - Sarah Frisken
- Brigham and Women's Hospital, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
| | - Tina Kapur
- Brigham and Women's Hospital, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
| | - Ron Kikinis
- Brigham and Women's Hospital, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
| | - Alexandra Golby
- Brigham and Women's Hospital, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
| | - Arya Nabavi
- Department of Neurosurgery, KRH Klinikum Nordstadt, Hannover, Germany
| | - Adam Wittek
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, 35 Stirling Highway, Perth, WA, Australia
| | - Karol Miller
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, 35 Stirling Highway, Perth, WA, Australia
- Harvard Medical School, Boston, MA, USA
| |
Collapse
|
3
|
Patient-specific solution of the electrocorticography forward problem in deforming brain. Neuroimage 2022; 263:119649. [PMID: 36167268 DOI: 10.1016/j.neuroimage.2022.119649] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2021] [Revised: 08/25/2022] [Accepted: 09/23/2022] [Indexed: 11/22/2022] Open
Abstract
Invasive intracranial electroencephalography (iEEG), or electrocorticography (ECoG), measures electric potential directly on the surface of the brain and can be used to inform treatment planning for epilepsy surgery. Combined with numerical modeling it can further improve accuracy of epilepsy surgery planning. Accurate solution of the iEEG forward problem, which is a crucial prerequisite for solving the iEEG inverse problemin epilepsy seizure onset zone localization, requires accurate representation of the patient's brain geometry and tissue electrical conductivity after implantation of electrodes. However, implantation of subdural grid electrodes causes the brain to deform, which invalidates preoperatively acquired image data. Moreover, postoperative magnetic resonance imaging (MRI) is incompatible with implanted electrodes and computed tomography (CT) has insufficient range of soft tissue contrast, which precludes both MRI and CT from being used to obtain the deformed postoperative geometry. In this paper, we present a biomechanics-based image warping procedure using preoperative MRI for tissue classification and postoperative CT for locating implanted electrodes to perform non-rigid registration of the preoperative image data to the postoperative configuration. We solve the iEEG forward problem on the predicted postoperative geometry using the finite element method (FEM) which accounts for patient-specific inhomogeneity and anisotropy of tissue conductivity. Results for the simulation of a current source in the brain show large differences in electric potential predicted by the models based on the original images and the deformed images corresponding to the brain geometry deformed by placement of invasive electrodes. Computation of the lead field matrix (useful for solution of the iEEG inverse problem) also showed significant differences between the different models. The results suggest that rapid and accurate solution of the forward problem in a deformed brain for a given patient is achievable.
Collapse
|
4
|
Wittek A, Bourantas G, Zwick BF, Joldes G, Esteban L, Miller K. Mathematical modeling and computer simulation of needle insertion into soft tissue. PLoS One 2020; 15:e0242704. [PMID: 33351854 PMCID: PMC7755224 DOI: 10.1371/journal.pone.0242704] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2020] [Accepted: 11/08/2020] [Indexed: 01/25/2023] Open
Abstract
In this study we present a kinematic approach for modeling needle insertion into soft tissues. The kinematic approach allows the presentation of the problem as Dirichlet-type (i.e. driven by enforced motion of boundaries) and therefore weakly sensitive to unknown properties of the tissues and needle-tissue interaction. The parameters used in the kinematic approach are straightforward to determine from images. Our method uses Meshless Total Lagrangian Explicit Dynamics (MTLED) method to compute soft tissue deformations. The proposed scheme was validated against experiments of needle insertion into silicone gel samples. We also present a simulation of needle insertion into the brain demonstrating the method's insensitivity to assumed mechanical properties of tissue.
Collapse
Affiliation(s)
- Adam Wittek
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, Perth, Western Australia, Australia
| | - George Bourantas
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, Perth, Western Australia, Australia
| | - Benjamin F Zwick
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, Perth, Western Australia, Australia
| | - Grand Joldes
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, Perth, Western Australia, Australia
| | - Lionel Esteban
- Commonwealth Science and Industry Research Organization CSIRO, Medical XCT Facility, Kensington, Western Australia, Australia
| | - Karol Miller
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, Perth, Western Australia, Australia
| |
Collapse
|
5
|
Jordan KM, Keshavan A, Caverzasi E, Osorio J, Papinutto N, Amirbekian B, Berger MS, Henry RG. Longitudinal Disconnection Tractograms to Investigate the Functional Consequences of White Matter Damage: An Automated Pipeline. J Neuroimaging 2020; 30:443-457. [PMID: 32436352 DOI: 10.1111/jon.12713] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2019] [Accepted: 03/27/2020] [Indexed: 11/28/2022] Open
Abstract
BACKGROUND AND PURPOSE Neurosurgical resection is one of the few opportunities researchers have to image the human brain pre- and postfocal damage. A major challenge associated with brains undergoing surgical resection is that they often do not fit brain templates most image-processing methodologies are based on. Manual intervention is required to reconcile the pathology, requiring time investment and introducing reproducibility concerns, and extreme cases must be excluded. METHODS We propose an automatic longitudinal pipeline based on High Angular Resolution Diffusion Imaging acquisitions to facilitate a Pathway Lesion Symptom Mapping analysis relating focal white matter injury to functional deficits. This two-part approach includes (i) automatic segmentation of focal white matter injury from anisotropic power differences, and (ii) modeling disconnection using tractography on the single-subject level, which specifically identifies the disconnections associated with focal white matter damage. RESULTS The advantages of this approach stem from (1) objective and automatic lesion segmentation and tractogram generation, (2) objective and precise segmentation of affected tissue likely to be associated with damage to long-range white matter pathways (defined by anisotropic power), (3) good performance even in the cases of anatomical distortions by use of nonlinear tensor-based registration, which aligns images using an approach sensitive to white matter microstructure. CONCLUSIONS Mapping a system as variable and complex as the human brain requires sample sizes much larger than the current technology can support. This pipeline can be used to execute large-scale, sufficiently powered analyses by meeting the need for an automatic approach to objectively quantify white matter disconnection.
Collapse
Affiliation(s)
- Kesshi M Jordan
- UCSF-UC Berkeley Graduate Group in Bioengineering, San Francisco, CA.,Department of Neurology, University of California, San Francisco, CA
| | - Anisha Keshavan
- UCSF-UC Berkeley Graduate Group in Bioengineering, San Francisco, CA.,Department of Neurology, University of California, San Francisco, CA
| | - Eduardo Caverzasi
- Department of Neurology, University of California, San Francisco, CA
| | - Joseph Osorio
- Division of Neurosurgery, Department of Surgery, University of California, San Diego, CA
| | - Nico Papinutto
- Department of Neurology, University of California, San Francisco, CA
| | - Bagrat Amirbekian
- UCSF-UC Berkeley Graduate Group in Bioengineering, San Francisco, CA.,Department of Neurology, University of California, San Francisco, CA
| | - Mitchel S Berger
- Department of Neurosurgery, University of California, San Francisco, CA
| | - Roland G Henry
- UCSF-UC Berkeley Graduate Group in Bioengineering, San Francisco, CA.,Department of Neurology, University of California, San Francisco, CA.,Department of Radiology and Biomedical Imaging, University of California, San Francisco, CA
| |
Collapse
|
6
|
Haouchine N, Juvekar P, Golby A, Wells WM, Cotin S, Frisken S. Alignment of Cortical Vessels viewed through the Surgical Microscope with Preoperative Imaging to Compensate for Brain Shift. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2020; 11315:113151V. [PMID: 33840881 PMCID: PMC8035814 DOI: 10.1117/12.2547620] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
Brain shift is a non-rigid deformation of brain tissue that is affected by loss of cerebrospinal fluid, tissue manipulation and gravity among other phenomena. This deformation can negatively influence the outcome of a surgical procedure since surgical planning based on pre-operative image becomes less valid. We present a novel method to compensate for brain shift that maps preoperative image data to the deformed brain during intra-operative neurosurgical procedures and thus increases the likelihood of achieving a gross total resection while decreasing the risk to healthy tissue surrounding the tumor. Through a 3D/2D non-rigid registration process, a 3D articulated model derived from pre-operative imaging is aligned onto 2D images of the vessels viewed through the surgical miscroscopic intra-operatively. The articulated 3D vessels constrain a volumetric biomechanical model of the brain to propagate cortical vessel deformation to the parenchyma and in turn to the tumor. The 3D/2D non-rigid registration is performed using an energy minimization approach that satisfies both projective and physical constraints. Our method is evaluated on real and synthetic data of human brain showing both quantitative and qualitative results and exhibiting its particular suitability for real-time surgical guidance.
Collapse
Affiliation(s)
- Nazim Haouchine
- Harvard Medical School, Boston, MA, USA
- Department of Radiology, Brigham and Women's Hospital, Boston, MA, USA
| | - Parikshit Juvekar
- Harvard Medical School, Boston, MA, USA
- Department of Neurosurgery, Brigham and Women's Hospital, Boston, MA, USA
| | - Alexandra Golby
- Harvard Medical School, Boston, MA, USA
- Department of Neurosurgery, Brigham and Women's Hospital, Boston, MA, USA
| | - William M Wells
- Harvard Medical School, Boston, MA, USA
- Department of Radiology, Brigham and Women's Hospital, Boston, MA, USA
| | | | - Sarah Frisken
- Harvard Medical School, Boston, MA, USA
- Department of Radiology, Brigham and Women's Hospital, Boston, MA, USA
| |
Collapse
|
7
|
Fan X, Roberts DW, Olson JD, Ji S, Schaewe TJ, Simon DA, Paulsen KD. Image Updating for Brain Shift Compensation During Resection. Oper Neurosurg (Hagerstown) 2019; 14:402-411. [PMID: 28658934 DOI: 10.1093/ons/opx123] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2016] [Accepted: 06/15/2017] [Indexed: 11/14/2022] Open
Abstract
BACKGROUND In open-cranial neurosurgery, preoperative magnetic resonance (pMR) images are typically coregistered for intraoperative guidance. Their accuracy can be significantly degraded by intraoperative brain deformation, especially when resection is involved. OBJECTIVE To produce model updated MR (uMR) images to compensate for brain shift that occurred during resection, and evaluate the performance of the image-updating process in terms of accuracy and computational efficiency. METHODS In 14 resection cases, intraoperative stereovision image pairs were acquired after dural opening and during resection to generate displacement maps of the surgical field. These data were assimilated by a biomechanical model to create uMR volumes of the evolving surgical field. A tracked stylus provided independent measurements of feature locations to quantify target registration errors (TREs) in the original coregistered pMR and uMR as surgery progressed. RESULTS Updated MR TREs were 1.66 ± 0.27 and 1.92 ± 0.49 mm in the 14 cases after dural opening and after partial resection, respectively, compared to 8.48 ± 3.74 and 8.77 ± 4.61 mm for pMR, respectively. The overall computational time for generating uMRs after partial resection was less than 10 min. CONCLUSION We have developed an image-updating system to compensate for brain deformation during resection using a computational model with data assimilation of displacements measured with intraoperative stereovision imaging that maintains TREs less than 2 mm on average.
Collapse
Affiliation(s)
- Xiaoyao Fan
- Thayer School of Engineering, Dartmouth College, Hanover, New Hampshire
| | - David W Roberts
- Thayer School of Engineering, Dartmouth College, Hanover, New Hampshire.,Department of Su, Geisel School of Medicine, Dartmouth College, Hanover, New Hampshire.,Norris Cotton Cancer Center, Dartmouth-Hitchcock Medical Center, Lebanon, New Hampshire.,Section of Neurosurgery, Dartmouth-Hitchcock Medical Center, Lebanon, New Hampshire
| | - Jonathan D Olson
- Thayer School of Engineering, Dartmouth College, Hanover, New Hampshire
| | - Songbai Ji
- Thayer School of Engineering, Dartmouth College, Hanover, New Hampshire.,Department of Biomedical Engineering, Worcester Polytechnic Institute, Worcester, Massachusetts
| | | | - David A Simon
- Medtronic, PLC, Brain Therapies, Neurosurgery, Louisville, Colorado
| | - Keith D Paulsen
- Thayer School of Engineering, Dartmouth College, Hanover, New Hampshire.,Department of Su, Geisel School of Medicine, Dartmouth College, Hanover, New Hampshire.,Norris Cotton Cancer Center, Dartmouth-Hitchcock Medical Center, Lebanon, New Hampshire
| |
Collapse
|
8
|
Miller K, Joldes GR, Bourantas G, Warfield S, Hyde DE, Kikinis R, Wittek A. Biomechanical modeling and computer simulation of the brain during neurosurgery. INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN BIOMEDICAL ENGINEERING 2019; 35:e3250. [PMID: 31400252 PMCID: PMC6785376 DOI: 10.1002/cnm.3250] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/21/2019] [Revised: 06/28/2019] [Accepted: 08/08/2019] [Indexed: 06/10/2023]
Abstract
Computational biomechanics of the brain for neurosurgery is an emerging area of research recently gaining in importance and practical applications. This review paper presents the contributions of the Intelligent Systems for Medicine Laboratory and its collaborators to this field, discussing the modeling approaches adopted and the methods developed for obtaining the numerical solutions. We adopt a physics-based modeling approach and describe the brain deformation in mechanical terms (such as displacements, strains, and stresses), which can be computed using a biomechanical model, by solving a continuum mechanics problem. We present our modeling approaches related to geometry creation, boundary conditions, loading, and material properties. From the point of view of solution methods, we advocate the use of fully nonlinear modeling approaches, capable of capturing very large deformations and nonlinear material behavior. We discuss finite element and meshless domain discretization, the use of the total Lagrangian formulation of continuum mechanics, and explicit time integration for solving both time-accurate and steady-state problems. We present the methods developed for handling contacts and for warping 3D medical images using the results of our simulations. We present two examples to showcase these methods: brain shift estimation for image registration and brain deformation computation for neuronavigation in epilepsy treatment.
Collapse
Affiliation(s)
- K. Miller
- Intelligent Systems for Medicine Laboratory, Department of Mechanical Engineering, The University of Western Australia, 35 Stirling Highway, Perth, WA 6009, Australia
| | - G. R. Joldes
- Intelligent Systems for Medicine Laboratory, Department of Mechanical Engineering, The University of Western Australia, 35 Stirling Highway, Perth, WA 6009, Australia
| | - G. Bourantas
- Intelligent Systems for Medicine Laboratory, Department of Mechanical Engineering, The University of Western Australia, 35 Stirling Highway, Perth, WA 6009, Australia
| | - S.K. Warfield
- Computational Radiology Laboratory, Department of Radiology, Boston Children’s Hospital and Harvard Medical School, 300 Longwood Avenue, Boston MA 02115
| | - D. E. Hyde
- Computational Radiology Laboratory, Department of Radiology, Boston Children’s Hospital and Harvard Medical School, 300 Longwood Avenue, Boston MA 02115
| | - R. Kikinis
- Surgical Planning Laboratory, Brigham and Women’s Hospital and Harvard Medical School, 45 Francis St, Boston, MA 02115
- Medical Image Computing, University of Bremen, Germany
- Fraunhofer MEVIS, Bremen, Germany
| | - A. Wittek
- Intelligent Systems for Medicine Laboratory, Department of Mechanical Engineering, The University of Western Australia, 35 Stirling Highway, Perth, WA 6009, Australia
| |
Collapse
|
9
|
Joldes G, Bourantas G, Zwick B, Chowdhury H, Wittek A, Agrawal S, Mountris K, Hyde D, Warfield SK, Miller K. Suite of meshless algorithms for accurate computation of soft tissue deformation for surgical simulation. Med Image Anal 2019; 56:152-171. [PMID: 31229760 DOI: 10.1016/j.media.2019.06.004] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2018] [Revised: 06/04/2019] [Accepted: 06/11/2019] [Indexed: 12/20/2022]
Abstract
The ability to predict patient-specific soft tissue deformations is key for computer-integrated surgery systems and the core enabling technology for a new era of personalized medicine. Element-Free Galerkin (EFG) methods are better suited for solving soft tissue deformation problems than the finite element method (FEM) due to their capability of handling large deformation while also eliminating the necessity of creating a complex predefined mesh. Nevertheless, meshless methods based on EFG formulation, exhibit three major limitations: (i) meshless shape functions using higher order basis cannot always be computed for arbitrarily distributed nodes (irregular node placement is crucial for facilitating automated discretization of complex geometries); (ii) imposition of the Essential Boundary Conditions (EBC) is not straightforward; and, (iii) numerical (Gauss) integration in space is not exact as meshless shape functions are not polynomial. This paper presents a suite of Meshless Total Lagrangian Explicit Dynamics (MTLED) algorithms incorporating a Modified Moving Least Squares (MMLS) method for interpolating scattered data both for visualization and for numerical computations of soft tissue deformation, a novel way of imposing EBC for explicit time integration, and an adaptive numerical integration procedure within the Meshless Total Lagrangian Explicit Dynamics algorithm. The appropriateness and effectiveness of the proposed methods is demonstrated using comparisons with the established non-linear procedures from commercial finite element software ABAQUS and experiments with very large deformations. To demonstrate the translational benefits of MTLED we also present a realistic brain-shift computation.
Collapse
Affiliation(s)
- Grand Joldes
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, Crawley-Perth, Western Australia 6009, Australia
| | - George Bourantas
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, Crawley-Perth, Western Australia 6009, Australia
| | - Benjamin Zwick
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, Crawley-Perth, Western Australia 6009, Australia
| | - Habib Chowdhury
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, Crawley-Perth, Western Australia 6009, Australia
| | - Adam Wittek
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, Crawley-Perth, Western Australia 6009, Australia
| | - Sudip Agrawal
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, Crawley-Perth, Western Australia 6009, Australia
| | - Konstantinos Mountris
- Aragón Institute for Engineering Research, University of Zaragoza, IIS Aragón, Spain
| | - Damon Hyde
- Computational Radiology Laboratory, Boston Children's Hospital and Harvard Medical School, Boston, Massachusetts 02115, US
| | - Simon K Warfield
- Computational Radiology Laboratory, Boston Children's Hospital and Harvard Medical School, Boston, Massachusetts 02115, US
| | - Karol Miller
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, Crawley-Perth, Western Australia 6009, Australia; Institute of Mechanics and Advanced Materials, Cardiff School of Engineering, Cardiff University, Wales, UK.
| |
Collapse
|
10
|
Prediction of brain deformations and risk of traumatic brain injury due to closed-head impact: quantitative analysis of the effects of boundary conditions and brain tissue constitutive model. Biomech Model Mechanobiol 2018; 17:1165-1185. [PMID: 29754317 DOI: 10.1007/s10237-018-1021-z] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2017] [Accepted: 04/25/2018] [Indexed: 12/31/2022]
Abstract
In this study, we investigate the effects of modelling choices for the brain-skull interface (layers of tissues between the brain and skull that determine boundary conditions for the brain) and the constitutive model of brain parenchyma on the brain responses under violent impact as predicted using computational biomechanics model. We used the head/brain model from Total HUman Model for Safety (THUMS)-extensively validated finite element model of the human body that has been applied in numerous injury biomechanics studies. The computations were conducted using a well-established nonlinear explicit dynamics finite element code LS-DYNA. We employed four approaches for modelling the brain-skull interface and four constitutive models for the brain tissue in the numerical simulations of the experiments on post-mortem human subjects exposed to violent impacts reported in the literature. The brain-skull interface models included direct representation of the brain meninges and cerebrospinal fluid, outer brain surface rigidly attached to the skull, frictionless sliding contact between the brain and skull, and a layer of spring-type cohesive elements between the brain and skull. We considered Ogden hyperviscoelastic, Mooney-Rivlin hyperviscoelastic, neo-Hookean hyperviscoelastic and linear viscoelastic constitutive models of the brain tissue. Our study indicates that the predicted deformations within the brain and related brain injury criteria are strongly affected by both the approach of modelling the brain-skull interface and the constitutive model of the brain parenchyma tissues. The results suggest that accurate prediction of deformations within the brain and risk of brain injury due to violent impact using computational biomechanics models may require representation of the meninges and subarachnoidal space with cerebrospinal fluid in the model and application of hyperviscoelastic (preferably Ogden-type) constitutive model for the brain tissue.
Collapse
|
11
|
Münnich T, Klein J, Hattingen E, Noack A, Herrmann E, Seifert V, Senft C, Forster MT. Tractography Verified by Intraoperative Magnetic Resonance Imaging and Subcortical Stimulation During Tumor Resection Near the Corticospinal Tract. Oper Neurosurg (Hagerstown) 2018; 16:197-210. [DOI: 10.1093/ons/opy062] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2017] [Accepted: 03/08/2018] [Indexed: 02/07/2023] Open
Abstract
Abstract
BACKGROUND
Tractography is a popular tool for visualizing the corticospinal tract (CST). However, results may be influenced by numerous variables, eg, the selection of seeding regions of interests (ROIs) or the chosen tracking algorithm.
OBJECTIVE
To compare different variable sets by correlating tractography results with intraoperative subcortical stimulation of the CST, correcting intraoperative brain shift by the use of intraoperative MRI.
METHODS
Seeding ROIs were created by means of motor cortex segmentation, functional MRI (fMRI), and navigated transcranial magnetic stimulation (nTMS). Based on these ROIs, tractography was run for each patient using a deterministic and a probabilistic algorithm. Tractographies were processed on pre- and postoperatively acquired data.
RESULTS
Using a linear mixed effects statistical model, best correlation between subcortical stimulation intensity and the distance between tractography and stimulation sites was achieved by using the segmented motor cortex as seeding ROI and applying the probabilistic algorithm on preoperatively acquired imaging sequences. Tractographies based on fMRI or nTMS results differed very little, but with enlargement of positive nTMS sites the stimulation-distance correlation of nTMS-based tractography improved.
CONCLUSION
Our results underline that the use of tractography demands for careful interpretation of its virtual results by considering all influencing variables.
Collapse
Affiliation(s)
- Timo Münnich
- Department of Neurosurgery, Goet-he University Hospital, Frankfurt am Main, Germany
| | - Jan Klein
- Fraunhofer MEVIS, Institute for Medical Image Computing, Bremen, Germany
| | - Elke Hattingen
- Department of Neuroradiology, Goethe University Hospital, Frankfurt am Main, Germa-ny
| | - Anika Noack
- Department of Neurosurgery, Goet-he University Hospital, Frankfurt am Main, Germany
| | - Eva Herrmann
- Institute for Biostatistics and Math-ematical Modelling, Goethe-University Hospital, Frankfurt am Main, Germany
| | - Volker Seifert
- Department of Neurosurgery, Goet-he University Hospital, Frankfurt am Main, Germany
| | - Christian Senft
- Department of Neurosurgery, Goet-he University Hospital, Frankfurt am Main, Germany
| | | |
Collapse
|
12
|
Morin F, Courtecuisse H, Reinertsen I, Le Lann F, Palombi O, Payan Y, Chabanas M. Brain-shift compensation using intraoperative ultrasound and constraint-based biomechanical simulation. Med Image Anal 2017. [DOI: 10.1016/j.media.2017.06.003] [Citation(s) in RCA: 47] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
13
|
Mohammadi A, Ahmadian A, Rabbani S, Fattahi E, Shirani S. A combined registration and finite element analysis method for fast estimation of intraoperative brain shift; phantom and animal model study. Int J Med Robot 2016; 13. [PMID: 27917580 DOI: 10.1002/rcs.1792] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2016] [Revised: 10/05/2016] [Accepted: 11/01/2016] [Indexed: 11/11/2022]
Abstract
BACKGROUND Finite element models for estimation of intraoperative brain shift suffer from huge computational cost. In these models, image registration and finite element analysis are two time-consuming processes. METHODS The proposed method is an improved version of our previously developed Finite Element Drift (FED) registration algorithm. In this work the registration process is combined with the finite element analysis. In the Combined FED (CFED), the deformation of whole brain mesh is iteratively calculated by geometrical extension of a local load vector which is computed by FED. RESULTS While the processing time of the FED-based method including registration and finite element analysis was about 70 s, the computation time of the CFED was about 3.2 s. The computational cost of CFED is almost 50% less than similar state of the art brain shift estimators based on finite element models. CONCLUSIONS The proposed combination of registration and structural analysis can make the calculation of brain deformation much faster.
Collapse
Affiliation(s)
- Amrollah Mohammadi
- Department of Medical Physics & Biomedical Engineering, School of Medicine, Tehran University of Medical Sciences, Tehran, Iran
| | - Alireza Ahmadian
- Department of Medical Physics & Biomedical Engineering, School of Medicine, Tehran University of Medical Sciences, Tehran, Iran.,Research Centre for Biomedical Technology and Robotics (RCBTR), Tehran, Iran
| | - Shahram Rabbani
- Tehran Heart Center, Tehran University of Medical Sciences, Tehran, Iran
| | - Ehsan Fattahi
- Department of Neurosurgery, School of Medicine, Tehran University of Medical Sciences, Tehran, Iran
| | - Shapour Shirani
- Tehran Heart Center, Tehran University of Medical Sciences, Tehran, Iran
| |
Collapse
|
14
|
Li M, Miller K, Joldes GR, Kikinis R, Wittek A. Biomechanical model for computing deformations for whole-body image registration: A meshless approach. INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN BIOMEDICAL ENGINEERING 2016; 32:10.1002/cnm.2771. [PMID: 26791945 PMCID: PMC4956599 DOI: 10.1002/cnm.2771] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/23/2015] [Revised: 12/06/2015] [Accepted: 01/17/2016] [Indexed: 06/05/2023]
Abstract
Patient-specific biomechanical models have been advocated as a tool for predicting deformations of soft body organs/tissue for medical image registration (aligning two sets of images) when differences between the images are large. However, complex and irregular geometry of the body organs makes generation of patient-specific biomechanical models very time-consuming. Meshless discretisation has been proposed to solve this challenge. However, applications so far have been limited to 2D models and computing single organ deformations. In this study, 3D comprehensive patient-specific nonlinear biomechanical models implemented using meshless Total Lagrangian explicit dynamics algorithms are applied to predict a 3D deformation field for whole-body image registration. Unlike a conventional approach that requires dividing (segmenting) the image into non-overlapping constituents representing different organs/tissues, the mechanical properties are assigned using the fuzzy c-means algorithm without the image segmentation. Verification indicates that the deformations predicted using the proposed meshless approach are for practical purposes the same as those obtained using the previously validated finite element models. To quantitatively evaluate the accuracy of the predicted deformations, we determined the spatial misalignment between the registered (i.e. source images warped using the predicted deformations) and target images by computing the edge-based Hausdorff distance. The Hausdorff distance-based evaluation determines that our meshless models led to successful registration of the vast majority of the image features. Copyright © 2016 John Wiley & Sons, Ltd.
Collapse
Affiliation(s)
- Mao Li
- Intelligent Systems for Medicine Laboratory, School of Mechanical and Chemical Engineering, The University of Western Australia, Perth, Australia
| | - Karol Miller
- Intelligent Systems for Medicine Laboratory, School of Mechanical and Chemical Engineering, The University of Western Australia, Perth, Australia
- Institute of Mechanics and Advanced Materials, Cardiff School of Engineering, Cardiff University, Wales, UK
| | - Grand Roman Joldes
- Intelligent Systems for Medicine Laboratory, School of Mechanical and Chemical Engineering, The University of Western Australia, Perth, Australia
| | - Ron Kikinis
- Surgical Planning Laboratory, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, USA
- Fraunhofer Institute for Medical Image Computing MEVIS and the University of Bremen, Bremen, Germany
| | - Adam Wittek
- Intelligent Systems for Medicine Laboratory, School of Mechanical and Chemical Engineering, The University of Western Australia, Perth, Australia
| |
Collapse
|
15
|
Fan X, Roberts DW, Schaewe TJ, Ji S, Holton LH, Simon DA, Paulsen KD. Intraoperative image updating for brain shift following dural opening. J Neurosurg 2016; 126:1924-1933. [PMID: 27611206 DOI: 10.3171/2016.6.jns152953] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
OBJECTIVE Preoperative magnetic resonance images (pMR) are typically coregistered to provide intraoperative navigation, the accuracy of which can be significantly compromised by brain deformation. In this study, the authors generated updated MR images (uMR) in the operating room (OR) to compensate for brain shift due to dural opening, and evaluated the accuracy and computational efficiency of the process. METHODS In 20 open cranial neurosurgical cases, a pair of intraoperative stereovision (iSV) images was acquired after dural opening to reconstruct a 3D profile of the exposed cortical surface. The iSV surface was registered with pMR to detect cortical displacements that were assimilated by a biomechanical model to estimate whole-brain nonrigid deformation and produce uMR in the OR. The uMR views were displayed on a commercial navigation system and compared side by side with the corresponding coregistered pMR. A tracked stylus was used to acquire coordinate locations of features on the cortical surface that served as independent positions for calculating target registration errors (TREs) for the coregistered uMR and pMR image volumes. RESULTS The uMR views were visually more accurate and well aligned with the iSV surface in terms of both geometry and texture compared with pMR where misalignment was evident. The average misfit between model estimates and measured displacements was 1.80 ± 0.35 mm, compared with the average initial misfit of 7.10 ± 2.78 mm between iSV and pMR, and the average TRE was 1.60 ± 0.43 mm across the 20 patients in the uMR image volume, compared with 7.31 ± 2.82 mm on average in the pMR cases. The iSV also proved to be accurate with an average error of 1.20 ± 0.37 mm. The overall computational time required to generate the uMR views was 7-8 minutes. CONCLUSIONS This study compensated for brain deformation caused by intraoperative dural opening using computational model-based assimilation of iSV cortical surface displacements. The uMR proved to be more accurate in terms of model-data misfit and TRE in the 20 patient cases evaluated relative to pMR. The computational time was acceptable (7-8 minutes) and the process caused minimal interruption of surgical workflow.
Collapse
Affiliation(s)
| | - David W Roberts
- Geisel School of Medicine, Dartmouth College, Hanover.,Norris Cotton Cancer Center, and.,Section of Neurosurgery, Dartmouth-Hitchcock Medical Center, Lebanon, New Hampshire; and
| | | | - Songbai Ji
- Thayer School of Engineering, and.,Section of Neurosurgery, Dartmouth-Hitchcock Medical Center, Lebanon, New Hampshire; and
| | | | - David A Simon
- Medtronic PLC, Surgical Technologies, Louisville, Colorado
| | - Keith D Paulsen
- Thayer School of Engineering, and.,Geisel School of Medicine, Dartmouth College, Hanover.,Norris Cotton Cancer Center, and
| |
Collapse
|
16
|
Using 3D Printing to Create Personalized Brain Models for Neurosurgical Training and Preoperative Planning. World Neurosurg 2016; 90:668-674. [PMID: 26924117 DOI: 10.1016/j.wneu.2016.02.081] [Citation(s) in RCA: 103] [Impact Index Per Article: 12.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2016] [Revised: 02/15/2016] [Accepted: 02/17/2016] [Indexed: 11/21/2022]
Abstract
BACKGROUND Three-dimensional (3D) printing holds promise for a wide variety of biomedical applications, from surgical planning, practicing, and teaching to creating implantable devices. The growth of this cheap and easy additive manufacturing technology in orthopedic, plastic, and vascular surgery has been explosive; however, its potential in the field of neurosurgery remains underexplored. A major limitation is that current technologies are unable to directly print ultrasoft materials like human brain tissue. OBJECTIVE In this technical note, the authors present a new technology to create deformable, personalized models of the human brain. METHODS The method combines 3D printing, molding, and casting to create a physiologically, anatomically, and tactilely realistic model based on magnetic resonance images. Created from soft gelatin, the model is easy to produce, cost-efficient, durable, and orders of magnitude softer than conventionally printed 3D models. The personalized brain model cost $50, and its fabrication took 24 hours. RESULTS In mechanical tests, the model stiffness (E = 25.29 ± 2.68 kPa) was 5 orders of magnitude softer than common 3D printed materials, and less than an order of magnitude stiffer than mammalian brain tissue (E = 2.64 ± 0.40 kPa). In a multicenter surgical survey, model size (100.00%), visual appearance (83.33%), and surgical anatomy (81.25%) were perceived as very realistic. The model was perceived as very useful for patient illustration (85.00%), teaching (94.44%), learning (100.00%), surgical training (95.00%), and preoperative planning (95.00%). CONCLUSIONS With minor refinements, personalized, deformable brain models created via 3D printing will improve surgical training and preoperative planning with the ultimate goal to provide accurate, customized, high-precision treatment.
Collapse
|
17
|
Computational Modeling for Enhancing Soft Tissue Image Guided Surgery: An Application in Neurosurgery. Ann Biomed Eng 2015; 44:128-38. [PMID: 26354118 DOI: 10.1007/s10439-015-1433-1] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2015] [Accepted: 08/18/2015] [Indexed: 01/14/2023]
Abstract
With the recent advances in computing, the opportunities to translate computational models to more integrated roles in patient treatment are expanding at an exciting rate. One area of considerable development has been directed towards correcting soft tissue deformation within image guided neurosurgery applications. This review captures the efforts that have been undertaken towards enhancing neuronavigation by the integration of soft tissue biomechanical models, imaging and sensing technologies, and algorithmic developments. In addition, the review speaks to the evolving role of modeling frameworks within surgery and concludes with some future directions beyond neurosurgical applications.
Collapse
|
18
|
Fan X, Roberts DW, Ji S, Hartov A, Paulsen KD. Intraoperative fiducial-less patient registration using volumetric 3D ultrasound: a prospective series of 32 neurosurgical cases. J Neurosurg 2015; 123:721-31. [PMID: 26140481 DOI: 10.3171/2014.12.jns141321] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
OBJECT Fiducial-based registration (FBR) is used widely for patient registration in image-guided neurosurgery. The authors of this study have developed an automatic fiducial-less registration (FLR) technique to find the patient-to-image transformation by directly registering 3D ultrasound (3DUS) with MR images without incorporating prior information. The purpose of the study was to evaluate the performance of the FLR technique when used prospectively in the operating room and to compare it with conventional FBR. METHODS In 32 surgical patients who underwent conventional FBR, preoperative T1-weighted MR images (pMR) with attached fiducial markers were acquired prior to surgery. After craniotomy but before dural opening, a set of 3DUS images of the brain volume was acquired. A 2-step registration process was executed immediately after image acquisition: 1) the cortical surfaces from pMR and 3DUS were segmented, and a multistart sum-of-squared-intensity-difference registration was executed to find an initial alignment between down-sampled binary pMR and 3DUS volumes; and 2) the alignment was further refined by a mutual information-based registration between full-resolution grayscale pMR and 3DUS images, and a patient-to-image transformation was subsequently extracted. RESULTS To assess the accuracy of the FLR technique, the following were quantified: 1) the fiducial distance error (FDE); and 2) the target registration error (TRE) at anterior commissure and posterior commissure locations; these were compared with conventional FBR. The results showed that although the average FDE (6.42 ± 2.05 mm) was higher than the fiducial registration error (FRE) from FBR (3.42 ± 1.37 mm), the overall TRE of FLR (2.51 ± 0.93 mm) was lower than that of FBR (5.48 ± 1.81 mm). The results agreed with the intent of the 2 registration techniques: FBR is designed to minimize the FRE, whereas FLR is designed to optimize feature alignment and hence minimize TRE. The overall computational cost of FLR was approximately 4-5 minutes and minimal user interaction was required. CONCLUSIONS Because the FLR method directly registers 3DUS with MR by matching internal image features, it proved to be more accurate than FBR in terms of TRE in the 32 patients evaluated in this study. The overall efficiency of FLR in terms of the time and personnel involved is also improved relative to FBR in the operating room, and the method does not require additional image scans immediately prior to surgery. The performance of FLR and these results suggest potential for broad clinical application.
Collapse
Affiliation(s)
| | - David W Roberts
- Geisel School of Medicine, Dartmouth College, Hanover; and.,Norris Cotton Cancer Center and.,Section of Neurosurgery, Dartmouth-Hitchcock Medical Center, Lebanon, New Hampshire
| | - Songbai Ji
- Thayer School of Engineering and.,Geisel School of Medicine, Dartmouth College, Hanover; and
| | - Alex Hartov
- Thayer School of Engineering and.,Norris Cotton Cancer Center and
| | - Keith D Paulsen
- Thayer School of Engineering and.,Geisel School of Medicine, Dartmouth College, Hanover; and.,Norris Cotton Cancer Center and
| |
Collapse
|
19
|
Fan X, Ji S, Hartov A, Roberts DW, Paulsen KD. Stereovision to MR image registration for cortical surface displacement mapping to enhance image-guided neurosurgery. Med Phys 2015; 41:102302. [PMID: 25281972 PMCID: PMC5176089 DOI: 10.1118/1.4894705] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
PURPOSE A surface registration method is presented to align intraoperative stereovision (iSV) with preoperative magnetic resonance (pMR) images, which utilizes both geometry and texture information to extract tissue displacements as part of the overall process of compensating for intraoperative brain deformation in order to maintain accurate neuronavigational image guidance during surgery. METHODS A sum-of-squared-difference rigid image registration was first executed to detect lateral shift of the cortical surface and was followed by a mutual-information-based block matching method to detect local nonrigid deformation caused by distention or collapse of the cortical surface. Ten (N = 10) surgical cases were evaluated in which an independent point measurement of a dominant cortical surface feature location was recorded with a tracked stylus in each case and compared to its surface-registered counterpart. The full three-dimensional (3D) displacement field was also extracted to drive a biomechanical brain deformation model, the results of which were reconciled with the reconstructed iSV surface as another form of evaluation. RESULTS Differences between the tracked stylus coordinates of cortical surface features and their surface-registered locations were 1.94 ± 0.59 mm on average across the ten cases. When the complete displacement map derived from surface registration was utilized, the resulting images generated from mechanical model updates were consistent in terms of both geometry (1-2 mm of model misfit) and texture, and were generated with less than 10 min of computational time. Analysis of the surface-registered 3D displacements indicate that the magnitude of motion ranged from 4.03 to 9.79 mm in the ten patient cases, and the amount of lateral shift was not related statistically to the direction of gravity (p = 0.73 ≫ 0.05) or the craniotomy size (p = 0.48 ≫ 0.05) at the beginning of surgery. CONCLUSIONS The iSV-pMR surface registration method utilizes texture and geometry information to extract both global lateral shift and local nonrigid movement of the cortical surface in 3D. The results suggest small differences exist in surface-registered locations when compared to positions measured independently with a coregistered stylus and when the full iSV surface was aligned with model-updated MR. The effectiveness and efficiency of the registration method is also minimally disruptive to surgical workflow.
Collapse
Affiliation(s)
- Xiaoyao Fan
- Thayer School of Engineering, Dartmouth College, Hanover, New Hampshire 03755
| | - Songbai Ji
- Thayer School of Engineering, Dartmouth College, Hanover, New Hampshire 03755 and Geisel School of Medicine, Dartmouth College, Hanover, New Hampshire 03755
| | - Alex Hartov
- Thayer School of Engineering, Dartmouth College, Hanover, New Hampshire 03755 and Norris Cotton Cancer Center, Lebanon, New Hampshire 03756
| | - David W Roberts
- Geisel School of Medicine, Dartmouth College, Hanover, New Hampshire 03755; Norris Cotton Cancer Center, Lebanon, New Hampshire 03756; and Dartmouth-Hitchcock Medical Center, Lebanon, New Hampshire 03756
| | - Keith D Paulsen
- Thayer School of Engineering, Dartmouth College, Hanover, New Hampshire 03755; Geisel School of Medicine, Dartmouth College, Hanover, New Hampshire 03755; Norris Cotton Cancer Center, Lebanon, New Hampshire 03756; and Dartmouth-Hitchcock Medical Center, Lebanon, New Hampshire 03756
| |
Collapse
|
20
|
Garlapati RR, Mostayed A, Joldes GR, Wittek A, Doyle B, Miller K. Towards measuring neuroimage misalignment. Comput Biol Med 2015; 64:12-23. [PMID: 26112607 DOI: 10.1016/j.compbiomed.2015.06.003] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2015] [Revised: 05/16/2015] [Accepted: 06/04/2015] [Indexed: 10/23/2022]
Abstract
To enhance neuro-navigation, high quality pre-operative images must be registered onto intra-operative configuration of the brain. Therefore evaluation of the degree to which structures may remain misaligned after registration is critically important. We consider two Hausdorff Distance (HD)-based evaluation approaches: the edge-based HD (EBHD) metric and the Robust HD (RHD) metric as well as various commonly used intensity-based similarity metrics such as Mutual Information (MI), Normalised Mutual Information (NMI), Entropy Correlation Coefficient (ECC), Kullback-Leibler Distance (KLD) and Correlation Ratio (CR). We conducted the evaluation by applying known deformations to simple sample images and real cases of brain shift. We conclude that the intensity-based similarity metrics such as MI, NMI, ECC, KLD and CR do not correlate well with actual alignment errors, and hence are not useful for assessing misalignment. On the contrary, the EBHD and the RHD metrics correlated well with actual alignment errors; however, they have been found to underestimate the actual misalignment. We also note that it is beneficial to present HD results as a percentile-HD curve rather than a single number such as the 95-percentile HD. Percentile-HD curves present the full range of alignment errors and also facilitate the comparison of results obtained using different approaches. Furthermore, the qualities that should be possessed by an ideal evaluation metric were highlighted. Future studies could focus on developing such an evaluation metric.
Collapse
Affiliation(s)
- Revanth Reddy Garlapati
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, Perth, Australia
| | - Ahmed Mostayed
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, Perth, Australia
| | - Grand Roman Joldes
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, Perth, Australia
| | - Adam Wittek
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, Perth, Australia
| | - Barry Doyle
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, Perth, Australia; Centre for Cardiovascular Science, The University of Edinburgh, Edinburgh, United Kingdom
| | - Karol Miller
- Intelligent Systems for Medicine Laboratory, The University of Western Australia, Perth, Australia; Institute of Mechanics and Advanced Materials, School of Engineering, Cardiff University, Cardiff, Wales, United Kingdom.
| |
Collapse
|
21
|
Li M, Miller K, Joldes GR, Doyle B, Garlapati RR, Kikinis R, Wittek A. Patient-specific biomechanical model as whole-body CT image registration tool. Med Image Anal 2015; 22:22-34. [PMID: 25721296 PMCID: PMC4405489 DOI: 10.1016/j.media.2014.12.008] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2013] [Revised: 08/08/2014] [Accepted: 12/13/2014] [Indexed: 10/24/2022]
Abstract
Whole-body computed tomography (CT) image registration is important for cancer diagnosis, therapy planning and treatment. Such registration requires accounting for large differences between source and target images caused by deformations of soft organs/tissues and articulated motion of skeletal structures. The registration algorithms relying solely on image processing methods exhibit deficiencies in accounting for such deformations and motion. We propose to predict the deformations and movements of body organs/tissues and skeletal structures for whole-body CT image registration using patient-specific non-linear biomechanical modelling. Unlike the conventional biomechanical modelling, our approach for building the biomechanical models does not require time-consuming segmentation of CT scans to divide the whole body into non-overlapping constituents with different material properties. Instead, a Fuzzy C-Means (FCM) algorithm is used for tissue classification to assign the constitutive properties automatically at integration points of the computation grid. We use only very simple segmentation of the spine when determining vertebrae displacements to define loading for biomechanical models. We demonstrate the feasibility and accuracy of our approach on CT images of seven patients suffering from cancer and aortic disease. The results confirm that accurate whole-body CT image registration can be achieved using a patient-specific non-linear biomechanical model constructed without time-consuming segmentation of the whole-body images.
Collapse
Affiliation(s)
- Mao Li
- Intelligent Systems for Medicine Laboratory, School of Mechanical and Chemical Engineering, The University of Western Australia, Crawley, Perth, Australia
| | - Karol Miller
- Intelligent Systems for Medicine Laboratory, School of Mechanical and Chemical Engineering, The University of Western Australia, Crawley, Perth, Australia; Institute of Mechanics and Advanced Materials, Cardiff School of Engineering, Cardiff University, Cardiff, Wales, UK
| | - Grand Roman Joldes
- Intelligent Systems for Medicine Laboratory, School of Mechanical and Chemical Engineering, The University of Western Australia, Crawley, Perth, Australia
| | - Barry Doyle
- Vascular Engineering, Intelligent Systems for Medicine Laboratory, School of Mechanical and Chemical Engineering, The University of Western Australia, Crawley, Perth, Australia; Centre for Cardiovascular Science, The University of Edinburgh, Edinburgh, UK
| | - Revanth Reddy Garlapati
- Intelligent Systems for Medicine Laboratory, School of Mechanical and Chemical Engineering, The University of Western Australia, Crawley, Perth, Australia
| | - Ron Kikinis
- Surgical Planning Laboratory, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA; Fraunhofer MEVIS, Bremen, Germany; Professor für Medical Image Computing, MZH, University of Bremen, Bremen, Germany
| | - Adam Wittek
- Intelligent Systems for Medicine Laboratory, School of Mechanical and Chemical Engineering, The University of Western Australia, Crawley, Perth, Australia.
| |
Collapse
|
22
|
Li M, Wittek A, Miller K. Efficient inverse isoparametric mapping algorithm for whole-body computed tomography registration using deformations predicted by nonlinear finite element modeling. J Biomech Eng 2015; 136:1873139. [PMID: 24828796 DOI: 10.1115/1.4027667] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2013] [Accepted: 05/14/2014] [Indexed: 11/08/2022]
Abstract
Biomechanical modeling methods can be used to predict deformations for medical image registration and particularly, they are very effective for whole-body computed tomography (CT) image registration because differences between the source and target images caused by complex articulated motions and soft tissues deformations are very large. The biomechanics-based image registration method needs to deform the source images using the deformation field predicted by finite element models (FEMs). In practice, the global and local coordinate systems are used in finite element analysis. This involves the transformation of coordinates from the global coordinate system to the local coordinate system when calculating the global coordinates of image voxels for warping images. In this paper, we present an efficient numerical inverse isoparametric mapping algorithm to calculate the local coordinates of arbitrary points within the eight-noded hexahedral finite element. Verification of the algorithm for a nonparallelepiped hexahedral element confirms its accuracy, fast convergence, and efficiency. The algorithm's application in warping of the whole-body CT using the deformation field predicted by means of a biomechanical FEM confirms its reliability in the context of whole-body CT registration.
Collapse
|