1
|
Zhang W, Yue Y, Pan H, Chen Z, Wang C, Pfister H, Wang W. Marching Windows: Scalable Mesh Generation for Volumetric Data With Multiple Materials. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2024; 30:1728-1742. [PMID: 36455093 PMCID: PMC10980537 DOI: 10.1109/tvcg.2022.3225526] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
Volumetric data abounds in medical imaging and other fields. With the improved imaging quality and the increased resolution, volumetric datasets are getting so large that the existing tools have become inadequate for processing and analyzing the data. Here we consider the problem of computing tetrahedral meshes to represent large volumetric datasets with labeled multiple materials, which are often encountered in medical imaging or microscopy optical slice tomography. Such tetrahedral meshes are a more compact and expressive geometric representation so are in demand for efficient visualization and simulation of the data, which are impossible if the original large volumetric data are used directly due to the large memory requirement. Existing methods for meshing volumetric data are not scalable for handling large datasets due to their sheer demand on excessively large run-time memory or failure to produce a tet-mesh that preserves the multi-material structure of the original volumetric data. In this article we propose a novel approach, called Marching Windows, that uses a moving window and a disk-swap strategy to reduce the run-time memory footprint, devise a new scheme that guarantees to preserve the topological structure of the original dataset, and adopt an error-guided optimization technique to improve both geometric approximation error and mesh quality. Extensive experiments show that our method is capable of processing very large volumetric datasets beyond the capability of the existing methods and producing tetrahedral meshes of high quality.
Collapse
|
2
|
Rashid T, Sultana S, Chakravarty M, Audette MA. Atlas-Based Shared-Boundary Deformable Multi-Surface Models through Multi-Material and Two-Manifold Dual Contouring. INFORMATION 2023. [DOI: 10.3390/info14040220] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/07/2023] Open
Abstract
This paper presents a multi-material dual “contouring” method used to convert a digital 3D voxel-based atlas of basal ganglia to a deformable discrete multi-surface model that supports surgical navigation for an intraoperative MRI-compatible surgical robot, featuring fast intraoperative deformation computation. It is vital that the final surface model maintain shared boundaries where appropriate so that even as the deep-brain model deforms to reflect intraoperative changes encoded in ioMRI, the subthalamic nucleus stays in contact with the substantia nigra, for example, while still providing a significantly sparser representation than the original volumetric atlas consisting of hundreds of millions of voxels. The dual contouring (DC) algorithm is a grid-based process used to generate surface meshes from volumetric data. The DC method enables the insertion of vertices anywhere inside the grid cube, as opposed to the marching cubes (MC) algorithm, which can insert vertices only on the grid edges. This multi-material DC method is then applied to initialize, by duality, a deformable multi-surface simplex model, which can be used for multi-surface atlas-based segmentation. We demonstrate our proposed method on synthetic and deep-brain atlas data, and a comparison of our method’s results with those of traditional DC demonstrates its effectiveness.
Collapse
Affiliation(s)
- Tanweer Rashid
- Neuroimage Analytics Laboratory, Glenn Biggs Institute for Alzheimer’s and Neurodegenerative Diseases, University of Texas Health Science Center at San Antonio, San Antonio, TX 78229, USA
| | - Sharmin Sultana
- Information Sciences and Technology, George Mason University, Fairfax, VA 22030, USA
| | - Mallar Chakravarty
- Brain Imaging Centre, Douglas Research Centre, Montréal, QC H4H 1R3, Canada
| | | |
Collapse
|
3
|
Palomar R, Cheikh FA, Edwin B, Beghdadhi A, Elle OJ. Surface reconstruction for planning and navigation of liver resections. Comput Med Imaging Graph 2016; 53:30-42. [DOI: 10.1016/j.compmedimag.2016.07.003] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2015] [Revised: 05/18/2016] [Accepted: 07/15/2016] [Indexed: 02/07/2023]
|
4
|
Nakao M, Taura K, Matsuda T. Deformable resection process map for intraoperative cutting guides. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2016; 2016:2554-2557. [PMID: 28268843 DOI: 10.1109/embc.2016.7591251] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
In this paper, we will introduce the concept of deformable resection process mapping as a time-varying geometric guide for soft tissue tumor resection procedures. The deformable resection process map (RPM) estimates the local appearance of vascular structures after cuts as a novel guide. The RPM can be directly generated from patient-specific medical images using volumetric resampling techniques. Since user input of some cutting points is the only requirement for generating the RPM, the developed software will be directly available for clinical use to preview surgical procedures and intraoperative workflow management without time-consuming setups or additional workloads. We used the CT images of the patients with hepatic cancer for the experiments. The performance of our method in the shape representation for a curved cut surface was compared with that of conventional shape modeling methods.
Collapse
|
5
|
Development of a finite element head model for the study of impact head injury. BIOMED RESEARCH INTERNATIONAL 2014; 2014:408278. [PMID: 25405201 PMCID: PMC4227498 DOI: 10.1155/2014/408278] [Citation(s) in RCA: 36] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/23/2014] [Revised: 08/22/2014] [Accepted: 08/22/2014] [Indexed: 11/22/2022]
Abstract
This study is aimed at developing a high quality, validated finite element (FE) human head model for traumatic brain injuries (TBI) prediction and prevention during vehicle collisions. The geometry of the FE model was based on computed tomography (CT) and magnetic resonance imaging (MRI) scans of a volunteer close to the anthropometry of a 50th percentile male. The material and structural properties were selected based on a synthesis of current knowledge of the constitutive models for each tissue. The cerebrospinal fluid (CSF) was simulated explicitly as a hydrostatic fluid by using a surface-based fluid modeling method. The model was validated in the loading condition observed in frontal impact vehicle collision. These validations include the intracranial pressure (ICP), brain motion, impact force and intracranial acceleration response, maximum von Mises stress in the brain, and maximum principal stress in the skull. Overall results obtained in the validation indicated improved biofidelity relative to previous FE models, and the change in the maximum von Mises in the brain is mainly caused by the improvement of the CSF simulation. The model may be used for improving the current injury criteria of the brain and anthropometric test devices.
Collapse
|
6
|
Nakao M, Oda Y, Taura K, Minato K. Direct volume manipulation for visualizing intraoperative liver resection process. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2014; 113:725-735. [PMID: 24440134 DOI: 10.1016/j.cmpb.2013.12.004] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/02/2012] [Revised: 12/02/2013] [Accepted: 12/09/2013] [Indexed: 06/03/2023]
Abstract
This paper introduces a new design and application for direct volume manipulation for visualizing the intraoperative liver resection process. So far, interactive volume deformation and resection have been independently handled due to the difficulty of representing elastic behavior of volumetric objects. Our framework models global shape editing and discontinuous local deformation by merging proxy geometry encoding and displacement mapping. A local-frame-based elastic model is presented to allow stable editing of the liver shape including bending and twisting while preserving the volume. Several tests using clinical CT data have confirmed the developed software and interface can represent the intraoperative state of liver and produce local views of reference vascular structures, which provides a "road map of vessels" that are key features when approaching occluded tumors during surgery.
Collapse
Affiliation(s)
- Megumi Nakao
- Graduate School of Informatics, Kyoto University, Japan.
| | - Yuya Oda
- Graduate School of Information Science, Nara Institute of Science and Technology, Japan
| | - Kojiro Taura
- Department of Hepato-Biliary-Pancreatic and Transplant Surgery, Kyoto University Hospital, Japan
| | - Kotaro Minato
- Graduate School of Information Science, Nara Institute of Science and Technology, Japan
| |
Collapse
|
7
|
Bronson J, Levine JA, Whitaker R. Lattice cleaving: a multimaterial tetrahedral meshing algorithm with guarantees. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2014; 20:223-37. [PMID: 24356365 PMCID: PMC4142801 DOI: 10.1109/tvcg.2013.115] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
We introduce a new algorithm for generating tetrahedral meshes that conform to physical boundaries in volumetric domains consisting of multiple materials. The proposed method allows for an arbitrary number of materials, produces high-quality tetrahedral meshes with upper and lower bounds on dihedral angles, and guarantees geometric fidelity. Moreover, the method is combinatoric so its implementation enables rapid mesh construction. These meshes are structured in a way that also allows grading, to reduce element counts in regions of homogeneity. Additionally, we provide proofs showing that both element quality and geometric fidelity are bounded using this approach.
Collapse
|
8
|
Abstract
We propose a new strategy for boundary conforming meshing that decouples the problem of building tetrahedra of proper size and shape from the problem of conforming to complex, non-manifold boundaries. This approach is motivated by the observation that while several methods exist for adaptive tetrahedral meshing, they typically have difficulty at geometric boundaries. The proposed strategy avoids this conflict by extracting the boundary conforming constraint into a secondary step. We first build a background mesh having a desired set of tetrahedral properties, and then use a generalized stenciling method to divide, or "cleave", these elements to get a set of conforming tetrahedra, while limiting the impacts cleaving has on element quality. In developing this new framework, we make several technical contributions including a new method for building graded tetrahedral meshes as well as a generalization of the isosurface stuffing and lattice cleaving algorithms to unstructured background meshes.
Collapse
Affiliation(s)
| | - Shankar P Sastry
- Scientific Computing and Imaging Institute, Salt Lake City, UT, U.S.A
| | | | - Ross T Whitaker
- Scientific Computing and Imaging Institute, Salt Lake City, UT, U.S.A
| |
Collapse
|
9
|
Dannhauer M, Brooks D, Tucker D, MacLeod R. A pipeline for the simulation of transcranial direct current stimulation for realistic human head models using SCIRun/BioMesh3D. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2013; 2012:5486-9. [PMID: 23367171 DOI: 10.1109/embc.2012.6347236] [Citation(s) in RCA: 34] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The current work presents a computational pipeline to simulate transcranial direct current stimulation from image based models of the head with SCIRun [15]. The pipeline contains all the steps necessary to carry out the simulations and is supported by a complete suite of open source software tools: image visualization, segmentation, mesh generation, tDCS electrode generation and efficient tDCS forward simulation.
Collapse
Affiliation(s)
- Moritz Dannhauer
- Scientific Computing and Imaging Institute, 72 So. Central Campus Drive, Salt Lake City, Utah 84112, USA. moritz atsci.utah.edu
| | | | | | | |
Collapse
|
10
|
Bronson JR, Levine JA, Whitaker RT. Lattice Cleaving: Conforming Tetrahedral Meshes of Multimaterial Domains with Bounded Quality. PROCEEDINGS. INTERNATIONAL MESHING ROUNDTABLE 2013; 2013:191-209. [PMID: 25309969 PMCID: PMC4190882 DOI: 10.1007/978-3-642-33573-0_12] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/02/2022]
Abstract
We introduce a new algorithm for generating tetrahedral meshes that conform to physical boundaries in volumetric domains consisting of multiple materials. The proposed method allows for an arbitrary number of materials, produces high-quality tetrahedral meshes with upper and lower bounds on dihedral angles, and guarantees geometric fidelity. Moreover, the method is combinatoric so its implementation enables rapid mesh construction. These meshes are structured in a way that also allows grading, in order to reduce element counts in regions of homogeneity.
Collapse
|
11
|
Bronson JR, Levine JA, Whitaker RT. Particle systems for adaptive, isotropic meshing of CAD models. ENGINEERING WITH COMPUTERS 2012; 28:331-344. [PMID: 23162181 PMCID: PMC3499137 DOI: 10.1007/s00366-012-0266-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
We present a particle-based approach for generating adaptive triangular surface and tetrahedral volume meshes from computer-aided design models. Input shapes are treated as a collection of smooth, parametric surface patches that can meet non-smoothly on boundaries. Our approach uses a hierarchical sampling scheme that places particles on features in order of increasing dimensionality. These particles reach a good distribution by minimizing an energy computed in 3D world space, with movements occurring in the parametric space of each surface patch. Rather than using a pre-computed measure of feature size, our system automatically adapts to both curvature as well as a notion of topological separation. It also enforces a measure of smoothness on these constraints to construct a sizing field that acts as a proxy to piecewise-smooth feature size. We evaluate our technique with comparisons against other popular triangular meshing techniques for this domain.
Collapse
Affiliation(s)
| | - Joshua A. Levine
- Scientific Computing and Imaging Institute, Salt Lake City, UT, USA
| | - Ross T. Whitaker
- Scientific Computing and Imaging Institute, Salt Lake City, UT, USA
| |
Collapse
|
12
|
Levine JA, Paulsen RR, Zhang Y. Mesh processing in medical-image analysis--a tutorial. IEEE COMPUTER GRAPHICS AND APPLICATIONS 2012; 32:22-28. [PMID: 24806984 DOI: 10.1109/mcg.2012.91] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
Medical-image analysis requires an understanding of sophisticated scanning modalities, constructing geometric models, building meshes to represent domains, and downstream biological applications. These four steps form an image-to-mesh pipeline. For research in this field to progress, the imaging, modeling, and simulation communities will need to work together more closely.
Collapse
|
13
|
d'Otreppe V, Boman R, Ponthot JP. Generating smooth surface meshes from multi-region medical images. INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN BIOMEDICAL ENGINEERING 2012; 28:642-660. [PMID: 25364843 DOI: 10.1002/cnm.1471] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/30/2011] [Revised: 08/01/2011] [Accepted: 08/03/2011] [Indexed: 06/04/2023]
Abstract
Thanks to advances in medical imaging technologies and numerical methods, patient-specific modelling is more and more used to improve diagnosis and to estimate the outcome of surgical interventions. It requires the extraction of the domain of interest from the medical scans of the patient, as well as the discretisation of this geometry. However, extracting smooth multi-material meshes that conform to the tissue boundaries described in the segmented image is still an active field of research. We propose to solve this issue by combining an implicit surface reconstruction method with a multi-region mesh extraction scheme. The surface reconstruction algorithm is based on multi-level partition of unity implicit surfaces, which we extended to the multi-material case. The mesh generation algorithm consists in a novel multi-domain version of the marching tetrahedra. It generates multi-region meshes as a set of triangular surface patches consistently joining each other at material junctions. This paper presents this original meshing strategy, starting from boundary points extraction from the segmented data to heterogeneous implicit surface definition, multi-region surface triangulation and mesh adaptation. Results indicate that the proposed approach produces smooth and high-quality triangular meshes with a reasonable geometric accuracy. Hence, the proposed method is well suited for subsequent volume mesh generation and finite element simulations.
Collapse
Affiliation(s)
- Vinciane d'Otreppe
- Aerospace and Mechanical Engineering Department, Non Linear Computational Mechanics, Mechanics Institute B52/3, University of Liège, Chemin des Chevreuils 1, 4000 Liège, Belgium.
| | | | | |
Collapse
|
14
|
Anderson JC, Garth C, Duchaineau MA, Joy KI. Smooth, volume-accurate material interface reconstruction. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2010; 16:802-814. [PMID: 20616395 DOI: 10.1109/tvcg.2010.17] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/29/2023]
Abstract
A new material interface reconstruction method for volume fraction data is presented. Our method is comprised of two components: first, we generate initial interface topology; then, using a combination of smoothing and volumetric forces within an active interface model, we iteratively transform the initial material interfaces into high-quality surfaces that accurately approximate the problem's volume fractions. Unlike all previous work, our new method produces material interfaces that are smooth, continuous across cell boundaries, and segment cells into regions with proper volume. These properties are critical during visualization and analysis. Generating high-quality mesh representations of material interfaces is required for accurate calculations of interface statistics, and dramatically increases the utility of material boundary visualizations.
Collapse
|
15
|
Kindlmann GL, Estépar RSJ, Smith SM, Westin CF. Sampling and visualizing creases with scale-space particles. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2009; 15:1415-24. [PMID: 19834216 PMCID: PMC2891996 DOI: 10.1109/tvcg.2009.177] [Citation(s) in RCA: 26] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
Particle systems have gained importance as a methodology for sampling implicit surfaces and segmented objects to improve mesh generation and shape analysis. We propose that particle systems have a significantly more general role in sampling structure from unsegmented data. We describe a particle system that computes samplings of crease features (i.e. ridges and valleys, as lines or surfaces) that effectively represent many anatomical structures in scanned medical data. Because structure naturally exists at a range of sizes relative to the image resolution, computer vision has developed the theory of scale-space, which considers an n-D image as an (n+1)-D stack of images at different blurring levels. Our scale-space particles move through continuous four-dimensional scale-space according to spatial constraints imposed by the crease features, a particle-image energy that draws particles towards scales of maximal feature strength, and an inter-particle energy that controls sampling density in space and scale. To make scale-space practical for large three-dimensional data, we present a spline-based interpolation across scale from a small number of pre-computed blurrings at optimally selected scales. The configuration of the particle system is visualized with tensor glyphs that display information about the local Hessian of the image, and the scale of the particle. We use scale-space particles to sample the complex three-dimensional branching structure of airways in lung CT, and the major white matter structures in brain DTI.
Collapse
Affiliation(s)
- Gordon L. Kindlmann
- Department of Computer Science and the Computation Institute, University of Chicago
| | | | - Stephen M. Smith
- Centre for Functional MRI of the Brain, John Radcliffe Hospital, Oxford University
| | - Carl-Fredrik Westin
- Department of Radiology, Brigham and Women’s Hospital, Harvard Medical School
| |
Collapse
|
16
|
Boltcheva D, Yvinec M, Boissonnat JD. Mesh Generation from 3D Multi-material Images. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION – MICCAI 2009 2009; 12:283-90. [DOI: 10.1007/978-3-642-04271-3_35] [Citation(s) in RCA: 26] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|