1
|
Arenas Esteban D, Wang D, Kadu A, Olluyn N, Sánchez-Iglesias A, Gomez-Perez A, González-Casablanca J, Nicolopoulos S, Liz-Marzán LM, Bals S. Quantitative 3D structural analysis of small colloidal assemblies under native conditions by liquid-cell fast electron tomography. Nat Commun 2024; 15:6399. [PMID: 39080248 PMCID: PMC11289127 DOI: 10.1038/s41467-024-50652-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2023] [Accepted: 07/16/2024] [Indexed: 08/02/2024] Open
Abstract
Electron tomography has become a commonly used tool to investigate the three-dimensional (3D) structure of nanomaterials, including colloidal nanoparticle assemblies. However, electron microscopy is typically done under high-vacuum conditions, requiring sample preparation for assemblies obtained by wet colloid chemistry methods. This involves solvent evaporation and deposition on a solid support, which consistently alters the nanoparticle organization. Here, we suggest using electron tomography to study nanoparticle assemblies in their original colloidal liquid environment. To address the challenges related to electron tomography in liquid, we devise a method that combines fast data acquisition in a commercial liquid-cell with a dedicated alignment and reconstruction workflow. We present the advantages of this methodology in accurately characterizing two different systems. 3D reconstructions of assemblies comprising polystyrene-capped Au nanoparticles encapsulated in polymeric shells reveal less compact and more distorted configurations for experiments performed in a liquid medium compared to their dried counterparts. A similar expansion can be observed in quantitative analysis of the surface-to-surface distances of self-assembled Au nanorods in water rather than in a vacuum, in agreement with bulk measurements. This study, therefore, emphasizes the importance of developing high-resolution characterization tools that preserve the native environment of colloidal nanostructures.
Collapse
Affiliation(s)
- Daniel Arenas Esteban
- Electron Microscopy for Materials Science (EMAT) and NANOlab Center of Excellence, University of Antwerp, Groenenborgerlaan 171, 2020, Antwerp, Belgium
| | - Da Wang
- Electron Microscopy for Materials Science (EMAT) and NANOlab Center of Excellence, University of Antwerp, Groenenborgerlaan 171, 2020, Antwerp, Belgium
- Guangdong Provincial Key Laboratory of Optical Information Materials and Technology, Institute of Electronic Paper Displays, South China Academy of Advanced Optoelectronics, South China Normal University, Guangzhou, 510006, China
| | - Ajinkya Kadu
- Electron Microscopy for Materials Science (EMAT) and NANOlab Center of Excellence, University of Antwerp, Groenenborgerlaan 171, 2020, Antwerp, Belgium
- Centrum Wiskunde & Informatica (CWI), Amsterdam, The Netherlands
| | - Noa Olluyn
- Electron Microscopy for Materials Science (EMAT) and NANOlab Center of Excellence, University of Antwerp, Groenenborgerlaan 171, 2020, Antwerp, Belgium
| | - Ana Sánchez-Iglesias
- CIC biomaGUNE, Paseo de Miramon 182, 20009, Donostia-San Sebastián, Spain
- Biomedical Research Networking Center in Bioengineering, Biomaterials, and Nanomedicine (CIBER-BBN), Paseo de Miramon 182, 20009, Donostia-San Sebastián, Spain
- Materials Physics Center, CSIC-UPV/EHU, Paseo Manuel de Lardizabal 5, 20018, Donostia-San Sebastián, Spain
| | | | | | | | - Luis M Liz-Marzán
- CIC biomaGUNE, Paseo de Miramon 182, 20009, Donostia-San Sebastián, Spain.
- Biomedical Research Networking Center in Bioengineering, Biomaterials, and Nanomedicine (CIBER-BBN), Paseo de Miramon 182, 20009, Donostia-San Sebastián, Spain.
- Ikerbasque, Basque Foundation for Science, 48013, Bilbao, Spain.
- Cinbio, Universidade de Vigo, 36310, Vigo, Spain.
| | - Sara Bals
- Electron Microscopy for Materials Science (EMAT) and NANOlab Center of Excellence, University of Antwerp, Groenenborgerlaan 171, 2020, Antwerp, Belgium.
| |
Collapse
|
2
|
Tekseth KR, Mirzaei F, Lukic B, Chattopadhyay B, Breiby DW. Multiscale drainage dynamics with Haines jumps monitored by stroboscopic 4D X-ray microscopy. Proc Natl Acad Sci U S A 2024; 121:e2305890120. [PMID: 38147554 PMCID: PMC10769832 DOI: 10.1073/pnas.2305890120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2023] [Accepted: 11/19/2023] [Indexed: 12/28/2023] Open
Abstract
Slow multiphase flow in porous media is intriguing because its underlying dynamics is almost deterministic, yet depends on a hierarchy of spatiotemporal processes. There has been great progress in the experimental study of such multiphase flows, but three-dimensional (3D) microscopy methods probing the pore-scale fluid dynamics with millisecond resolution have been lacking. Yet, it is precisely at these length and time scales that the crucial pore-filling events known as Haines jumps take place. Here, we report four-dimensional (4D) (3D + time) observations of multiphase flow in a consolidated porous medium as captured in situ by stroboscopic X-ray micro-tomography. With a total duration of 6.5 s and 2 kHz frame rate, our experiments provide unprecedented access to the multiscale liquid dynamics. Our tomography strategy relies on the fact that Haines jumps, although irregularly spaced in time, are almost deterministic, and therefore repeatable during imbibition-drainage cycling. We studied the time-dependent flow pattern in a porous medium consisting of sintered glass shards. Exploiting the repeatability, we could combine the radiographic projections recorded under different angles during successive cycles into a 3D movie, allowing us to reconstruct pore-scale events, such as Haines jumps, with a spatiotemporal resolution that is two orders of magnitude higher than was hitherto possible. This high resolution allows us to explore the detailed interfacial dynamics during drainage, including fluid-front displacements and velocities. Our experimental approach opens the way to the study of fast, yet deterministic mesoscopic processes also other than flow in porous media.
Collapse
Affiliation(s)
- Kim Robert Tekseth
- Department of Physics, Norwegian University of Science and Technology, 7491Trondheim, Norway
| | - Fazel Mirzaei
- Department of Physics, Norwegian University of Science and Technology, 7491Trondheim, Norway
| | | | - Basab Chattopadhyay
- Department of Physics, Norwegian University of Science and Technology, 7491Trondheim, Norway
| | - Dag Werner Breiby
- Department of Physics, Norwegian University of Science and Technology, 7491Trondheim, Norway
- Department of Microsystems, University of South-Eastern Norway, 3184Borre, Norway
| |
Collapse
|
3
|
Frouté L, Boigné E, Jolivet IC, Chaput E, Creux P, Ihme M, Kovscek AR. Evaluation of Electron Tomography Capabilities for Shale Imaging. MICROSCOPY AND MICROANALYSIS : THE OFFICIAL JOURNAL OF MICROSCOPY SOCIETY OF AMERICA, MICROBEAM ANALYSIS SOCIETY, MICROSCOPICAL SOCIETY OF CANADA 2023; 29:1856-1869. [PMID: 37942573 DOI: 10.1093/micmic/ozad106] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Revised: 08/14/2023] [Accepted: 09/19/2023] [Indexed: 11/10/2023]
Abstract
Despite the advantageous resolution of electron tomography (ET), reconstruction of three-dimensional (3D) images from multiple two-dimensional (2D) projections presents several challenges, including small signal-to-noise ratios, and a limited projection range. This study evaluates the capabilities of ET for thin sections of shale, a complex nanoporous medium. A numerical phantom with 1.24 nm pixel size is constructed based on the tomographic reconstruction of a Barnett shale. A dataset of 2D projection images is numerically generated from the 3D phantom and studied over a range of conditions. First, common reconstruction techniques are used to reconstruct the shale structure. The reconstruction uncertainty is quantified by comparing overall values of storage and transport metrics, as well as the misclassification of pore voxels compared to the phantom. We then select the most robust reconstruction technique and we vary the acquisition conditions to quantify the effect of artifacts. We find a strong agreement for large pores over the different acquisition workflows, while a wider variability exists for nanometer-scale features. The limited projection range and reconstruction are identified as the main experimental bottlenecks, thereby suggesting that sample thinning, advanced holders, and advanced reconstruction algorithms offer opportunities for improvement.
Collapse
Affiliation(s)
- Laura Frouté
- Department of Energy Science & Engineering, Stanford University, Stanford, CA 94305, USA
| | - Emeric Boigné
- Department of Mechanical Engineering, Stanford University, Stanford, CA 94305, USA
| | | | - Eric Chaput
- One Tech - Geosciences & Reservoir, TotalEnergies SE, 64000 Pau, France
| | - Patrice Creux
- Université de Pau et des Pays de l'Adour, E2S UPPA, CNRS, TotalEnergies, LFCR, 64012 Pau, France
| | - Matthias Ihme
- Department of Mechanical Engineering, Stanford University, Stanford, CA 94305, USA
| | - Anthony R Kovscek
- Department of Energy Science & Engineering, Stanford University, Stanford, CA 94305, USA
| |
Collapse
|
4
|
Wang D, Esteban DA, Kadu A, Sánchez-Iglesias A, Perez AG, Casablanca JG, Nicolopoulos S, Liz-Marzán LM, Bals S. Electron Tomography in Liquids: Characterizing Nanoparticle Self-Assemblies in a Relevant Environment. MICROSCOPY AND MICROANALYSIS : THE OFFICIAL JOURNAL OF MICROSCOPY SOCIETY OF AMERICA, MICROBEAM ANALYSIS SOCIETY, MICROSCOPICAL SOCIETY OF CANADA 2023; 29:1401-1402. [PMID: 37613574 DOI: 10.1093/micmic/ozad067.721] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/25/2023]
Affiliation(s)
- Da Wang
- EMAT-University of Antwerp, Antwerp, Belgium
- NANOlab Center of Excellence, University of Antwerp, Belgium
| | - Daniel Arenas Esteban
- EMAT-University of Antwerp, Antwerp, Belgium
- NANOlab Center of Excellence, University of Antwerp, Belgium
| | - Ajinkya Kadu
- EMAT-University of Antwerp, Antwerp, Belgium
- NANOlab Center of Excellence, University of Antwerp, Belgium
| | - Ana Sánchez-Iglesias
- CIC biomaGUNE, Donostia-San Sebastián, Spain
- Centro de Investigación Biomédica en Red, Bioingeniería, Biomateriales y Nanomedicina, CIBER-BBN, Donostia-San Sebastián, Spain
| | | | | | | | - Luis M Liz-Marzán
- CIC biomaGUNE, Donostia-San Sebastián, Spain
- Centro de Investigación Biomédica en Red, Bioingeniería, Biomateriales y Nanomedicina, CIBER-BBN, Donostia-San Sebastián, Spain
- Ikerbasque, Basque Foundation for Science, Bilbao, Spain
- Cinbio, Universidade de Vigo, Vigo, Spain
| | - Sara Bals
- EMAT-University of Antwerp, Antwerp, Belgium
- NANOlab Center of Excellence, University of Antwerp, Belgium
| |
Collapse
|
5
|
Craig TM, Kadu AA, Batenburg KJ, Bals S. Real-time tilt undersampling optimization during electron tomography of beam sensitive samples using golden ratio scanning and RECAST3D. NANOSCALE 2023; 15:5391-5402. [PMID: 36825781 DOI: 10.1039/d2nr07198c] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/18/2023]
Abstract
Electron tomography is a widely used technique for 3D structural analysis of nanomaterials, but it can cause damage to samples due to high electron doses and long exposure times. To minimize such damage, researchers often reduce beam exposure by acquiring fewer projections through tilt undersampling. However, this approach can also introduce reconstruction artifacts due to insufficient sampling. Therefore, it is important to determine the optimal number of projections that minimizes both beam exposure and undersampling artifacts for accurate reconstructions of beam-sensitive samples. Current methods for determining this optimal number of projections involve acquiring and post-processing multiple reconstructions with different numbers of projections, which can be time-consuming and requires multiple samples due to sample damage. To improve this process, we propose a protocol that combines golden ratio scanning and quasi-3D reconstruction to estimate the optimal number of projections in real-time during a single acquisition. This protocol was validated using simulated and realistic nanoparticles, and was successfully applied to reconstruct two beam-sensitive metal-organic framework complexes.
Collapse
Affiliation(s)
- Timothy M Craig
- Electron Microscopy for Materials Science and NANOlab Center of Excellence, University of Antwerp, Groenenborgerlaan 171, Antwerp 2020, Belgium.
| | - Ajinkya A Kadu
- Electron Microscopy for Materials Science and NANOlab Center of Excellence, University of Antwerp, Groenenborgerlaan 171, Antwerp 2020, Belgium.
- Centrum Wiskunde & Informatica, Science Park 123, Amsterdam 1098 XG, The Netherlands
| | - Kees Joost Batenburg
- Centrum Wiskunde & Informatica, Science Park 123, Amsterdam 1098 XG, The Netherlands
- Leiden Institute of Advanced Computer Science, Leiden University, Niels Bohrweg 1, 2333CA Leiden, The Netherlands
| | - Sara Bals
- Electron Microscopy for Materials Science and NANOlab Center of Excellence, University of Antwerp, Groenenborgerlaan 171, Antwerp 2020, Belgium.
| |
Collapse
|
6
|
Huang X, Barlocco I, Villa A, Kübel C, Wang D. Disclosing the leaching behaviour of Pd@CMK3 catalysts in formic acid decomposition by electron tomography. NANOSCALE ADVANCES 2023; 5:1141-1151. [PMID: 36798496 PMCID: PMC9926883 DOI: 10.1039/d2na00664b] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/28/2022] [Accepted: 12/22/2022] [Indexed: 06/18/2023]
Abstract
Supported nanocatalysts exhibit different performances in batch and fixed bed reactors for a wide range of liquid phase catalytic reactions due to differences in metal leaching. To investigate this leaching process and its influence on the catalytic performance, a quantitative 3D characterization of the particle size and the particle distribution is important to follow the structural evolution of the active metal catalysts supported on porous materials during the reaction. In this work, electron tomography has been applied to uncover leaching and redeposition of a Pd@CMK3 catalyst during formic acid decomposition in batch and fixed bed reactors. The 3D distribution of Pd NPs on the mesoporous carbon CMK3 has been determined by a quantitative tomographic analysis and the determined structural changes are correlated with the observed differences in activity and stability of formic acid decomposition using batch and fixed bed reactors.
Collapse
Affiliation(s)
- Xiaohui Huang
- Institute of Nanotechnology, Karlsruhe Institute of Technology Eggenstein-Leopoldshafen Germany
- Department of Materials and Earth Sciences, Technical University Darmstadt Darmstadt Germany
| | - Ilaria Barlocco
- Dipartimento di Chimica, Università degli Studi di Milano Via Golgi 19 20133 Milano Italy
| | - Alberto Villa
- Dipartimento di Chimica, Università degli Studi di Milano Via Golgi 19 20133 Milano Italy
| | - Christian Kübel
- Institute of Nanotechnology, Karlsruhe Institute of Technology Eggenstein-Leopoldshafen Germany
- Department of Materials and Earth Sciences, Technical University Darmstadt Darmstadt Germany
- Karlsruhe Nano Micro Facility, Karlsruhe Institute of Technology Eggenstein-Leopoldshafen Germany
| | - Di Wang
- Institute of Nanotechnology, Karlsruhe Institute of Technology Eggenstein-Leopoldshafen Germany
- Karlsruhe Nano Micro Facility, Karlsruhe Institute of Technology Eggenstein-Leopoldshafen Germany
| |
Collapse
|
7
|
Huang X, Hlushkou D, Wang D, Tallarek U, Kübel C. Quantitative analysis of mesoporous structures by electron tomography: A phantom study. Ultramicroscopy 2023; 243:113639. [DOI: 10.1016/j.ultramic.2022.113639] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2022] [Revised: 08/17/2022] [Accepted: 10/30/2022] [Indexed: 11/11/2022]
|
8
|
Qin Y, Zhang Y, Lu X, Zhao Y, Zhao X. Dual spectral limited-angle CT imaging regularized by edge-preserving diffusion and smoothing. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2023; 31:573-592. [PMID: 37038801 DOI: 10.3233/xst-221302] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2023]
Abstract
Limited-angle CT scan is an effective way for nondestructive inspection of planar objects, and various methods have been proposed accordingly. When the scanned object contains high-absorption material, such as metal, existing methods may fail due to the beam hardening of X-rays. In order to overcome this problem, we adopt a dual spectral limited-angle CT scan and propose a corresponding image reconstruction algorithm, which takes the polychromatic property of the X-ray into consideration, makes basis material images free of beam hardening artifacts and metal artifacts, and then helps depress the limited-angle artifacts. Experimental results on both simulated PCB data and real data demonstrate the effectiveness of the proposed algorithm.
Collapse
Affiliation(s)
- Yanwei Qin
- School of Mathematical Sciences, Capital Normal University, Beijing, China
- Beijing Advanced Innovation Center for Imaging Technology, Capital Normal University, Beijing, China
| | - Yinghui Zhang
- School of Mathematical Sciences, Capital Normal University, Beijing, China
- Beijing Advanced Innovation Center for Imaging Technology, Capital Normal University, Beijing, China
| | - Xin Lu
- School of Mathematical Sciences, Capital Normal University, Beijing, China
- Beijing Advanced Innovation Center for Imaging Technology, Capital Normal University, Beijing, China
| | - Yunsong Zhao
- School of Mathematical Sciences, Capital Normal University, Beijing, China
- Beijing Advanced Innovation Center for Imaging Technology, Capital Normal University, Beijing, China
- Shenzhen National Applied Mathematics Center, Southern University of Science and Technology, Shenzhen, China
| | - Xing Zhao
- School of Mathematical Sciences, Capital Normal University, Beijing, China
- Beijing Advanced Innovation Center for Imaging Technology, Capital Normal University, Beijing, China
- Shenzhen National Applied Mathematics Center, Southern University of Science and Technology, Shenzhen, China
| |
Collapse
|
9
|
Huang X, Tang Y, Kübel C, Wang D. Precisely Picking Nanoparticles by a "Nano-Scalpel" for 360° Electron Tomography. MICROSCOPY AND MICROANALYSIS : THE OFFICIAL JOURNAL OF MICROSCOPY SOCIETY OF AMERICA, MICROBEAM ANALYSIS SOCIETY, MICROSCOPICAL SOCIETY OF CANADA 2022; 28:1-8. [PMID: 36101003 DOI: 10.1017/s1431927622012247] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Electron tomography (ET) has gained increasing attention for the 3D characterization of nanoparticles. However, the missing wedge problem due to a limited tilt angle range is still the main challenge for accurate reconstruction in most experimental TEM setups. Advanced algorithms could in-paint or compensate to some extent the missing wedge artifacts, but cannot recover the missing structural information completely. 360° ET provides an option to solve this problem by tilting a needle-shaped specimen over the full tilt range and thus filling the missing information. However, sample preparation especially for fine powders to perform full-range ET is still challenging, thus limiting its application. In this work, we propose a new universal sample preparation method that enables the transfer of selected individual nanoparticle or a few separated nanoparticles by cutting a piece of carbon film supporting the specimen particles and mounting them onto the full-range tomography holder tip with the help of an easily prepared sharp tungsten tip. This method is demonstrated by 360° ET of Pt@TiO2 hollow cage catalyst showing high quality reconstruction without missing wedge.
Collapse
Affiliation(s)
- Xiaohui Huang
- Institute of Nanotechnology, Karlsruhe Institute of Technology, Hermann-von-Helmholtz-Platz 1, 76344 Eggenstein-Leopoldshafen, Germany
- Department of Materials and Earth Sciences, Technical University of Darmstadt, Alarich-Weiss-Straße 2, 64287 Darmstadt, Germany
| | - Yushu Tang
- Institute of Nanotechnology, Karlsruhe Institute of Technology, Hermann-von-Helmholtz-Platz 1, 76344 Eggenstein-Leopoldshafen, Germany
| | - Christian Kübel
- Institute of Nanotechnology, Karlsruhe Institute of Technology, Hermann-von-Helmholtz-Platz 1, 76344 Eggenstein-Leopoldshafen, Germany
- Department of Materials and Earth Sciences, Technical University of Darmstadt, Alarich-Weiss-Straße 2, 64287 Darmstadt, Germany
- Karlsruhe Nano Micro Facility (KNMF), Karlsruhe Institute of Technology, Hermann-von-Helmholtz-Platz 1, 76344 Eggenstein-Leopoldshafen, Germany
| | - Di Wang
- Institute of Nanotechnology, Karlsruhe Institute of Technology, Hermann-von-Helmholtz-Platz 1, 76344 Eggenstein-Leopoldshafen, Germany
- Karlsruhe Nano Micro Facility (KNMF), Karlsruhe Institute of Technology, Hermann-von-Helmholtz-Platz 1, 76344 Eggenstein-Leopoldshafen, Germany
| |
Collapse
|
10
|
Lee S, Kim H, Lee H, Cho S. Deep-learning-based projection-domain breast thickness estimation for shape-prior iterative image reconstruction in digital breast tomosynthesis. Med Phys 2022; 49:3670-3682. [PMID: 35297075 DOI: 10.1002/mp.15612] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2021] [Revised: 03/10/2022] [Accepted: 03/11/2022] [Indexed: 11/11/2022] Open
Abstract
BACKGROUND Digital breast tomosynthesis (DBT) is a technique that can overcome the shortcomings of conventional X-ray mammography and can be effective for the early screening of breast cancer. The compression of the breast is essential during the DBT imaging. However, since the periphery of the breast cannot be compressed to a constant value, nonuniformity of thickness and in-plane shape variation happen. These cause inconvenience in diagnosis, scatter correction, and breast density estimation. PURPOSE In this study, we propose a deep-learning-based methodology for projection-domain breast thickness estimation and demonstrate a shape-prior iterative DBT image reconstruction. METHODS We prepared the Euclidean distance map, the thickness map, and the thickness corrected image of the simulated breast projections for thickness and shape estimation. Each pixel of the Euclidean distance map denotes a distance to the closest skin-line. The thickness map is defined as a conceptual projection of ideal breast support that differentiates the inner and outer regions of the breast phantom. The thickness projection map thus represents the x-ray path lengths of a homogeneous breast phantom. We generated the thickness corrected image by dividing the projection image by the thickness map in a pixel-wise manner. We developed a convolutional neural network for thickness estimation and correction. The network utilizes a projection image and a Euclidean distance image together as a dual input. An estimated breast thickness map is then used for constructing the breast shape mask by use of the discrete algebraic reconstruction technique (DART). RESULTS The proposed network effectively corrected the breast thickness in various simulation situations. Low normalized root-mean-squared error (NRMSE; 1.976%) and high structural similarity (SSIM; 99.997%) indicated a good agreement between the network-generated thickness corrected image and the ground-truth image. Compared to the existing methods and simple single-input network, the proposed method showed outperformance in breast thickness estimation and accordingly in breast shape recovery for various numerical phantoms without provoking any significant artifact. We have demonstrated that the uniformity of voxel value has improved by the inclusion of a shape-prior for the iterative DBT reconstruction. CONCLUSIONS We presented a novel deep-learning-based breast thickness correction and a shape reconstruction method. This approach to estimating the true thickness map and the shape of the breast undergoing compression can benefit various fields such as improvement of diagnostic breast images, scatter correction, material decomposition, and breast density estimation. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Seoyoung Lee
- Department of Nuclear and Quantum Engineering, Korea Advanced Institute of Science and Technology, Daejeon, 34141, Korea
| | - Hyeongseok Kim
- KAIST Institute for Artificial Intelligence, Korea Advanced Institute of Science and Technology, Daejeon, 34141, Korea
| | - Hoyeon Lee
- Department of Radiation Oncology, Massachusetts General Hospital, Boston, 02114, USA
| | - Seungryong Cho
- Department of Nuclear and Quantum Engineering, Korea Advanced Institute of Science and Technology, Daejeon, 34141, Korea.,KAIST Institute for Artificial Intelligence, Korea Advanced Institute of Science and Technology, Daejeon, 34141, Korea.,KAIST Institutes for IT Convergence and Health Science and Technology, Korea Advanced Institute of Science and Technology, Daejeon, 34141, Korea
| |
Collapse
|
11
|
Petersen T, Zhao C, Bøjesen E, Broge N, Hata S, Liu Y, Etheridge J. Volume imaging by tracking sparse topological features in electron micrograph tilt series. Ultramicroscopy 2022; 236:113475. [DOI: 10.1016/j.ultramic.2022.113475] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2021] [Revised: 12/17/2021] [Accepted: 01/24/2022] [Indexed: 10/19/2022]
|
12
|
Zhang Z, Chen B, Xia D, Sidky EY, Pan X. Image reconstruction from data over two orthogonal arcs of limited-angular ranges. Med Phys 2022; 49:1468-1480. [PMID: 35020215 DOI: 10.1002/mp.15450] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2021] [Revised: 12/14/2021] [Accepted: 01/03/2022] [Indexed: 11/11/2022] Open
Abstract
PURPOSE Computed tomography (CT) scanning over limited-angular ranges (LARs) is of practical interest in possible reduction of imaging dose and time and in design of non-standard scans. This work aims to investigate image reconstruction for two non-overlapping arcs of LARs, and to demonstrate that they may allow more accurate image reconstruction than may a single arc of LAR. METHODS We consider a configuration with two non-overlapping arcs of LARs α1 and α2 , whose centers are separated by 90°, and refer to it as a two-orthogonal-arc configuration. Data are generated from a chest phantom with two-orthogonal-arc configurations over total angular coverage ατ = α1 + α2 ranging from 18° to 180°, and images are reconstructed subsequently by use of the directional-total-variation (DTV) algorithm. For comparison, we also consider image reconstruction for a single-arc configuration of angular range ατ . Quantitative metrics such as the normalized root-mean-square-error (nRMSE) are used for evaluation of image reconstruction accuracy. RESULTS Visual inspection and quantitative analysis of images reconstructed reveal that a two-orthogonal-arc configuration generally yields more accurate image reconstruction than does its single-arc counterpart. As total angular range ατ increases, the DTV algorithm yields image reconstruction with enhanced accuracy, as expected. Also, if ατ remains constant, the two-orthogonal-arc configuration with α1 = α2 generally leads to image reconstruction more accurate than those of two-orthogonal-arc configurations with α1 ≠ α2 , as the nRMSE of the former can be lower than that of the latter for up to more than one order of magnitude. CONCLUSIONS Appropriately designed two-orthogonal-arc configurations may be exploited for improving image-reconstruction accuracy in CT imaging with reduced angular coverage. This study may yield insights into the design of innovative CT scans for lowering scan time and radiation dose, and/or for avoiding scan collision in, e.g., C-arm CT.
Collapse
Affiliation(s)
- Zheng Zhang
- Department of Radiology, The University of Chicago, Chicago, IL, 60637, USA
| | - Buxin Chen
- Department of Radiology, The University of Chicago, Chicago, IL, 60637, USA
| | - Dan Xia
- Department of Radiology, The University of Chicago, Chicago, IL, 60637, USA
| | - Emil Y Sidky
- Department of Radiology, The University of Chicago, Chicago, IL, 60637, USA
| | - Xiaochuan Pan
- Department of Radiology, The University of Chicago, Chicago, IL, 60637, USA.,Department of Radiation and Cellular Oncology, The University of Chicago, Chicago, IL, 60637, USA
| |
Collapse
|
13
|
He Y, Ming W, Shen R, Chen J. IDART: An Improved Discrete Tomography Algorithm for Reconstructing Images With Multiple Gray Levels. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2022; 31:2608-2619. [PMID: 35316179 DOI: 10.1109/tip.2022.3152632] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
The discrete algebraic reconstruction technique has many advantages in computed tomography and electron tomography. However, the number of gray levels and the absolute gray values that should be known in advance are typically not available in experiments especially when there are many gray levels in the image. In this paper, we report an automatic discrete tomography reconstruction algorithm to improve its feasibility in practice, without needing to know these two parameters. In our algorithm, the number of gray levels is estimated by labeling the connected components in the tomogram and the absolute values of them are determined by the modal value of each domain. The proposed algorithm was extensively validated on both simulated and experimental datasets. The results show that our algorithm can accurately recover not only the morphology but also the gray levels of the interested objects, even in the images with multiple gray levels. It is demonstrated that the presented algorithm is robust for eliminating missing wedge artifacts and tolerable for noisy data.
Collapse
|
14
|
Jailin C, Roux S, Sarrut D, Rit S. Projection-based dynamic tomography. Phys Med Biol 2021; 66. [PMID: 34663759 DOI: 10.1088/1361-6560/ac309e] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2021] [Accepted: 10/18/2021] [Indexed: 11/11/2022]
Abstract
Objective. This paper proposes a 4D dynamic tomography framework that allows a moving sample to be imaged in a tomograph as well as the associated space-time kinematics to be measured with nothing more than a single conventional x-ray scan.Approach. The method exploits the consistency of the projection/reconstruction operations through a multi-scale procedure. The procedure is composed of two main parts solved alternatively: a motion-compensated reconstruction algorithm and a projection-based measurement procedure that estimates the displacement field directly on each projection.Main results. The method is applied to two studies: a numerical simulation of breathing from chest computed tomography (4D-CT) and a clinical cone-beam CT of a breathing patient acquired for image guidance of radiotherapy. The reconstructed volume, initially blurred by the motion, is cleaned from motion artifacts.Significance. Applying the proposed approach results in an improved reconstruction quality showing sharper edges and finer details.
Collapse
Affiliation(s)
- Clément Jailin
- Université Paris-Saclay, ENS Paris-Saclay, CNRS, LMT-Laboratoire de Mécanique et Technologie, F-91190, Gif-sur-Yvette, France.,GE Healthcare, F-78530 Buc, France
| | - Stéphane Roux
- Université Paris-Saclay, ENS Paris-Saclay, CNRS, LMT-Laboratoire de Mécanique et Technologie, F-91190, Gif-sur-Yvette, France
| | - David Sarrut
- Univ Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, UJM-Saint Etienne, CNRS, Inserm, CREATIS UMR 5220, U1294, F-69373, Lyon, France
| | - Simon Rit
- Univ Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, UJM-Saint Etienne, CNRS, Inserm, CREATIS UMR 5220, U1294, F-69373, Lyon, France
| |
Collapse
|
15
|
Chen B, Zhang Z, Xia D, Sidky EY, Pan X. Dual-energy CT imaging with limited-angular-range data. Phys Med Biol 2021; 66. [PMID: 34320478 DOI: 10.1088/1361-6560/ac1876] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2021] [Accepted: 07/28/2021] [Indexed: 11/12/2022]
Abstract
In dual-energy computed tomography (DECT), low- and high-kVp data are collected often over a full-angular range (FAR) of 360○. While there exists strong interest in DECT with low- and high-kVp data acquired over limited-angular ranges (LARs), there remains little investigation of image reconstruction in DECT with LAR data.Objective: We investigate image reconstruction with minimized LAR artifacts from low- and high-kVp data over LARs of ≤180○by using a directional-total-variation (DTV) algorithm.Methods: Image reconstruction from LAR data is formulated as a convex optimization problem in which data-l2is minimized with constraints on image's DTVs along orthogonal axes. We then achieve image reconstruction by applying the DTV algorithm to solve the optimization problem. We conduct numerical studies from data generated over arcs of LARs, ranging from 14○to 180○, and perform visual inspection and quantitative analysis of images reconstructed.Results: Monochromatic images of interest obtained with the DTV algorithm from LAR data show substantially reduced artifacts that are observed often in images obtained with existing algorithms. The improved image quality also leads to accurate estimation of physical quantities of interest, such as effective atomic number and iodine-contrast concentration.Conclusion: Our study reveals that from LAR data of low- and high-kVp, monochromatic images can be obtained that are visually, and physical quantities can be estimated that are quantitatively, comparable to those obtained in FAR DECT.Significance: As LAR DECT is of high practical application interest, the results acquired in the work may engender insights into the design of DECT with LAR scanning configurations of practical application significance.
Collapse
Affiliation(s)
- Buxin Chen
- Radiology, The University of Chicago, 5841 South Maryland Avenue, MC2026, Chicago, Illinois, 60637, UNITED STATES
| | - Zheng Zhang
- Radiology, The University of Chicago, Mc2016, 5841 South Maryland Avenue, Chicago, Illinois, 60637, UNITED STATES
| | - Dan Xia
- Department of Radiology, University of Chicago, 5841 South Maryland Avenue, Chicago, IL 60637, USA, CHICAGO, UNITED STATES
| | - Emil Y Sidky
- Department of Radiology, University of Chicago, 5841 South Maryland Avenue, Chicago, IL 60637, USA, Chicago, Illinois, UNITED STATES
| | - Xiaochuan Pan
- Department of Radiology, University of Chicago, 5841 South Maryland Avenue, Chicago, IL 60637, USA, Chicago, UNITED STATES
| |
Collapse
|
16
|
Sidky EY, Phillips JP, Zhou W, Ongie G, Cruz-Bastida JP, Reiser IS, Anastasio MA, Pan X. A signal detection model for quantifying overregularization in nonlinear image reconstruction. Med Phys 2021; 48:6312-6323. [PMID: 34169538 DOI: 10.1002/mp.14703] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2020] [Revised: 12/09/2020] [Accepted: 12/21/2020] [Indexed: 11/08/2022] Open
Abstract
Many useful image quality metrics for evaluating linear image reconstruction techniques do not apply to or are difficult to interpret for nonlinear image reconstruction. The vast majority of metrics employed for evaluating nonlinear image reconstruction are based on some form of global image fidelity, such as image root mean square error (RMSE). Use of such metrics can lead to overregularization in the sense that they can favor removal of subtle details in the image. To address this shortcoming, we develop an image quality metric based on signal detection that serves as a surrogate to the qualitative loss of fine image details. The metric is demonstrated in the context of a breast CT simulation, where different equal-dose configurations are considered. The configurations differ in the number of projections acquired. Image reconstruction is performed with a nonlinear algorithm based on total variation constrained least-squares (TV-LSQ). The resulting images are studied as a function of three parameters: number of views acquired, total variation constraint value, and number of iterations. The images are evaluated visually, with image RMSE, and with the proposed signal-detection-based metric. The latter uses a small signal, and computes detectability in the sinogram and in the reconstructed image. Loss of signal detectability through the image reconstruction process is taken as a quantitative measure of loss of fine details in the image. Loss of signal detectability is seen to correlate well with the blocky or patchy appearance due to overregularization with TV-LSQ, and this trend runs counter to the image RMSE metric, which tends to favor the over-regularized images. The proposed signal detection-based metric provides an image quality assessment that is complimentary to that of image RMSE. Using the two metrics in concert may yield a useful prescription for determining CT algorithm and configuration parameters when nonlinear image reconstruction is used.
Collapse
Affiliation(s)
- Emil Y Sidky
- Department of Radiology, The University of Chicago, 5841 S. Maryland Ave., Chicago, IL, 60637, USA
| | - John Paul Phillips
- Department of Radiology, The University of Chicago, 5841 S. Maryland Ave., Chicago, IL, 60637, USA
| | - Weimin Zhou
- Department of Bioengineering, University of Illinois at Urbana-Champaign, 1406 W. Green St., Urbana, IL, 61801, USA
| | - Greg Ongie
- Department of Mathematical and Statistical Sciences, Marquette University, 1313 W. Wisconsin Ave., Milwaukee, WI, 53233, USA
| | - Juan P Cruz-Bastida
- Department of Radiology, The University of Chicago, 5841 S. Maryland Ave., Chicago, IL, 60637, USA
| | - Ingrid S Reiser
- Department of Radiology, The University of Chicago, 5841 S. Maryland Ave., Chicago, IL, 60637, USA
| | - Mark A Anastasio
- Department of Bioengineering, University of Illinois at Urbana-Champaign, 1406 W. Green St., Urbana, IL, 61801, USA
| | - Xiaochuan Pan
- Department of Radiology, The University of Chicago, 5841 S. Maryland Ave., Chicago, IL, 60637, USA
| |
Collapse
|
17
|
Rasmussen PW, Sørensen HO, Bruns S, Dahl AB, Christensen AN. Improved dynamic imaging of multiphase flow by constrained tomographic reconstruction. Sci Rep 2021; 11:12501. [PMID: 34127711 PMCID: PMC8203785 DOI: 10.1038/s41598-021-91776-1] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2021] [Accepted: 05/31/2021] [Indexed: 11/09/2022] Open
Abstract
Dynamic tomography has become an important technique to study fluid flow processes in porous media. The use of laboratory X-ray tomography instruments is, however, limited by their low X-ray brilliance. The prolonged exposure times, in turn, greatly limit temporal resolution. We have developed a tomographic reconstruction algorithm that maintains high image quality, despite reducing the exposure time and the number of projections significantly. Our approach, based on the Simultaneous Iterative Reconstruction Technique, mitigates the problem of few and noisy exposures by utilising a high-quality scan of the system before the dynamic process is started. We use the high-quality scan to initialise the first time step of the dynamic reconstruction. We further constrain regions of the dynamic reconstruction with a segmentation of the static system. We test the performance of the algorithm by reconstructing the dynamics of fluid separation in a multiphase system. The algorithm is compared quantitatively and qualitatively with several other reconstruction algorithms and we show that it can maintain high image quality using only a fraction of the normally required number of projections and with a substantially larger noise level. By robustly allowing fewer projections and shorter exposure, our algorithm enables the study of faster flow processes using laboratory tomography instrumentation but it can also be used to improve the reconstruction quality of dynamic synchrotron experiments.
Collapse
Affiliation(s)
- Peter Winkel Rasmussen
- Department of Applied Mathematics and Computer Science, Technical University of Denmark, 2800, Kongens Lyngby, Denmark.
| | | | - Stefan Bruns
- Helmholtz-Zentrum Hereon, Institute for Metallic Biomaterials, 21502, Geesthacht, Germany
| | - Anders Bjorholm Dahl
- Department of Applied Mathematics and Computer Science, Technical University of Denmark, 2800, Kongens Lyngby, Denmark
| | - Anders Nymark Christensen
- Department of Applied Mathematics and Computer Science, Technical University of Denmark, 2800, Kongens Lyngby, Denmark.
| |
Collapse
|
18
|
Zhang Z, Chen B, Xia D, Sidky EY, Pan X. Directional-TV algorithm for image reconstruction from limited-angular-range data. Med Image Anal 2021; 70:102030. [PMID: 33752167 PMCID: PMC8044061 DOI: 10.1016/j.media.2021.102030] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2020] [Revised: 02/25/2021] [Accepted: 03/01/2021] [Indexed: 01/24/2023]
Abstract
Investigation of image reconstruction from data collected over a limited-angular range in X-ray CT remains a topic of active research because it may yield insight into the development of imaging workflow of practical significance. This reconstruction problem is well-known to be challenging, however, because it is highly ill-conditioned. In the work, we investigate optimization-based image reconstruction from data acquired over a limited-angular range that is considerably smaller than the angular range in short-scan CT. We first formulate the reconstruction problem as a convex optimization program with directional total-variation (TV) constraints applied to the image, and then develop an iterative algorithm, referred to as the directional-TV (DTV) algorithm for image reconstruction through solving the optimization program. We use the DTV algorithm to reconstruct images from data collected over a variety of limited-angular ranges for breast and bar phantoms of clinical- and industrial-application relevance. The study demonstrates that the DTV algorithm accurately recovers the phantoms from data generated over a significantly reduced angular range, and that it considerably diminishes artifacts observed otherwise in reconstructions of existing algorithms. We have also obtained empirical conditions on minimal-angular ranges sufficient for numerically accurate image reconstruction with the DTV algorithm.
Collapse
Affiliation(s)
- Zheng Zhang
- Department of Radiology, The University of Chicago, Chicago, IL 60637, USA
| | - Buxin Chen
- Department of Radiology, The University of Chicago, Chicago, IL 60637, USA
| | - Dan Xia
- Department of Radiology, The University of Chicago, Chicago, IL 60637, USA
| | - Emil Y Sidky
- Department of Radiology, The University of Chicago, Chicago, IL 60637, USA
| | - Xiaochuan Pan
- Department of Radiology, The University of Chicago, Chicago, IL 60637, USA; Department of Radiation and Cellular Oncology, The University of Chicago, Chicago, IL 60637, USA.
| |
Collapse
|
19
|
Gong C, Zeng L. Anisotropic structure property based image reconstruction method for limited-angle computed tomography. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2021; 29:1079-1102. [PMID: 34511479 DOI: 10.3233/xst-210954] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Limited-angle computed tomography (CT) may appear in restricted CT scans. Since the available projection data is incomplete, the images reconstructed by filtered back-projection (FBP) or algebraic reconstruction technique (ART) often encounter shading artifacts. However, using the anisotropy property of the shading artifacts that coincide with the characteristic of limited-angle CT images can reduce the shading artifacts. Considering this concept, we combine the anisotropy property of the shading artifacts with the anisotropic structure property of an image to develop a new algorithm for image reconstruction. Specifically, we propose an image reconstruction method based on adaptive weighted anisotropic total variation (AwATV). This method, termed as AwATV method for short, is designed to preserve image structures and then remove the shading artifacts. It characterizes both of above properties. The anisotropy property of the shading artifacts accounts for reducing artifacts, and the anisotropic structure property of an image accounts for preserving structures. In order to evaluate the performance of AwATV, we use the simulation projection data of FORBILD head phantom and real CT data for image reconstruction. Experimental results show that AwATV can always reconstruct images with higher SSIM and PSNR, and smaller RMSE, which means that AwATV enables to reconstruct images with higher quality in term of artifact reduction and structure preservation.
Collapse
Affiliation(s)
- Changcheng Gong
- College of Mathematics and Statistics, Chongqing Technology and Business University, Chongqing, China
- Chongqing Key Laboratory of Social Economic and Applied Statistics, Chongqing Technology and Business University, Chongqing, China
| | - Li Zeng
- College of Mathematics and Statistics, Chongqing University, Chongqing, China
- Engineering Research Center of Industrial Computed Tomography Nondestructive Testing of the Education Ministry of China, Chongqing University, Chongqing, China
| |
Collapse
|
20
|
Shi L, Qu G. A preconditioned landweber iteration scheme for the limited-angle image reconstruction. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2021; 29:1045-1063. [PMID: 34542052 DOI: 10.3233/xst-210936] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
BACKGROUND The limited-angle reconstruction problem is of both theoretical and practical importance. Due to the severe ill-posedness of the problem, it is very challenging to get a valid reconstructed result from the known small limited-angle projection data. The theoretical ill-posedness leads the normal equation AT Ax = AT b of the linear system derived by discretizing the Radon transform to be severely ill-posed, which is quantified as the large condition number of AT A. OBJECTIVE To develop and test a new valid algorithm for improving the limited-angle image reconstruction with the known appropriately small angle range from [0,π3]∼[0,π2]. METHODS We propose a reweighted method of improving the condition number of AT Ax = AT b and the corresponding preconditioned Landweber iteration scheme. The weight means multiplying AT Ax = AT b by a matrix related to AT A, and the weighting process is repeated multiple times. In the experiment, the condition number of the coefficient matrix in the reweighted linear system decreases monotonically to 1 as the weighting times approaches infinity. RESULTS The numerical experiments showed that the proposed algorithm is significantly superior to other iterative algorithms (Landweber, Cimmino, NWL-a and AEDS) and can reconstruct a valid image from the known appropriately small angle range. CONCLUSIONS The proposed algorithm is effective for the limited-angle reconstruction problem with the known appropriately small angle range.
Collapse
Affiliation(s)
- Lei Shi
- School of Science, Beijing Jiaotong University, Beijing, China
| | - Gangrong Qu
- School of Science, Beijing Jiaotong University, Beijing, China
| |
Collapse
|
21
|
LoTToR: An Algorithm for Missing-Wedge Correction of the Low-Tilt Tomographic 3D Reconstruction of a Single-Molecule Structure. Sci Rep 2020; 10:10489. [PMID: 32591588 PMCID: PMC7320192 DOI: 10.1038/s41598-020-66793-1] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2019] [Accepted: 05/27/2020] [Indexed: 01/01/2023] Open
Abstract
A single-molecule three-dimensional (3D) structure is essential for understanding the thermal vibrations and dynamics as well as the conformational changes during the chemical reaction of macromolecules. Individual-particle electron tomography (IPET) is an approach for obtaining a snap-shot 3D structure of an individual macromolecule particle by aligning the tilt series of electron tomographic (ET) images of a targeted particle through a focused iterative 3D reconstruction method. The method can reduce the influence on the 3D reconstruction from large-scale image distortion and deformation. Due to the mechanical tilt limitation, 3D reconstruction often contains missing-wedge artifacts, presented as elongation and an anisotropic resolution. Here, we report a post-processing method to correct the missing-wedge artifact. This low-tilt tomographic reconstruction (LoTToR) method contains a model-free iteration process under a set of constraints in real and reciprocal spaces. A proof of concept is conducted by using the LoTToR on a phantom, i.e., a simulated 3D reconstruction from a low-tilt series of images, including that within a tilt range of ±15°. The method is validated by using both negative-staining (NS) and cryo-electron tomography (cryo-ET) experimental data. A significantly reduced missing-wedge artifact verifies the capability of LoTToR, suggesting a new tool to support the future study of macromolecular dynamics, fluctuation and chemical activity from the viewpoint of single-molecule 3D structure determination.
Collapse
|
22
|
Coban SB, Lucka F, Palenstijn WJ, Van Loo D, Batenburg KJ. Explorative Imaging and Its Implementation at the FleX-ray Laboratory. J Imaging 2020; 6:jimaging6040018. [PMID: 34460720 PMCID: PMC8321014 DOI: 10.3390/jimaging6040018] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2020] [Revised: 03/12/2020] [Accepted: 03/25/2020] [Indexed: 01/21/2023] Open
Abstract
In tomographic imaging, the traditional process consists of an expert and an operator collecting data, the expert working on the reconstructed slices and drawing conclusions. The quality of reconstructions depends heavily on the quality of the collected data, except that, in the traditional process of imaging, the expert has very little influence over the acquisition parameters, experimental plan or the collected data. It is often the case that the expert has to draw limited conclusions from the reconstructions, or adapt a research question to data available. This method of imaging is static and sequential, and limits the potential of tomography as a research tool. In this paper, we propose a more dynamic process of imaging where experiments are tailored around a sample or the research question; intermediate reconstructions and analysis are available almost instantaneously, and expert has input at any stage of the process (including during acquisition) to improve acquisition or image reconstruction. Through various applications of 2D, 3D and dynamic 3D imaging at the FleX-ray Laboratory, we present the unexpected journey of exploration a research question undergoes, and the surprising benefits it yields.
Collapse
Affiliation(s)
- Sophia Bethany Coban
- Centrum Wiskunde & Informatica, Science Park 123, 1098 XG Amsterdam, The Netherlands; (F.L.); (W.J.P.); (K.J.B.)
- Correspondence:
| | - Felix Lucka
- Centrum Wiskunde & Informatica, Science Park 123, 1098 XG Amsterdam, The Netherlands; (F.L.); (W.J.P.); (K.J.B.)
- Centre for Medical Image Computing, University College London, London WC1E 6BT, UK
| | - Willem Jan Palenstijn
- Centrum Wiskunde & Informatica, Science Park 123, 1098 XG Amsterdam, The Netherlands; (F.L.); (W.J.P.); (K.J.B.)
| | - Denis Van Loo
- TESCAN-XRE NV, Bollebergen 2B/bus 1, 9052 Ghent, Belgium;
| | - Kees Joost Batenburg
- Centrum Wiskunde & Informatica, Science Park 123, 1098 XG Amsterdam, The Netherlands; (F.L.); (W.J.P.); (K.J.B.)
- Leiden Institute of Advanced Computer Science, Niels Bohrweg 1, 2333 CA Leiden, The Netherlands
| |
Collapse
|
23
|
Six N, De Beenhouwer J, Sijbers J. poly-DART: A discrete algebraic reconstruction technique for polychromatic X-ray CT. OPTICS EXPRESS 2019; 27:33670-33682. [PMID: 31878430 DOI: 10.1364/oe.27.033670] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/05/2019] [Accepted: 09/08/2019] [Indexed: 06/10/2023]
Abstract
The discrete algebraic reconstruction technique (DART) is a tomographic method to reconstruct images from X-ray projections in which prior knowledge on the number of object materials is exploited. In monochromatic X-ray CT (e.g., synchrotron), DART has been shown to lead to high-quality reconstructions, even with a low number of projections or a limited scanning view. However, most X-ray sources are polychromatic, leading to beam hardening effects, which significantly degrade the performance of DART. In this work, we propose a new discrete tomography algorithm, poly-DART, that exploits sparsity in the attenuation values using DART and simultaneously accounts for the polychromatic nature of the X-ray source. The results show that poly-DART leads to a vastly improved segmentation on polychromatic data obtained from Monte Carlo simulations as well as on experimental data, compared to DART.
Collapse
|
24
|
Brun F, Trapani VD, Dreossi D, Longo R, Delogu P, Rigon L. K-edge spectral computed tomography with a photon counting detector and discrete reconstruction. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2019; 2018:5245-5248. [PMID: 30441521 DOI: 10.1109/embc.2018.8513425] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
X-ray K-Edge Subtraction Computed Tomography (KES-CT) is based on the acquisition of two images at different energies, one below and one above the Kedge of a contrast agent. KES-CT is mainly performed at synchrotron facilities where a tunable monochromatic X-ray beam is available. Thanks to innovative Photon Counting Xray Detectors (PCXDs), it would be desirable to collect the two images in a single shot with a conventional polychromatic Xray spectrum. This approach, sometimes called spectral-CT or color-CT eliminates the risk of misregistration due to motion between consecutive acquisitions and it should allow for scans with much lower doses of contrast medium. Spectral CT is considered very promising but its practical application is being hampered by several practical issues, one of these being the charge sharing affecting the energy resolution of PCXDs. However, latest generations of PCXDs implement hardware solutions to cope with the charge sharing effects, thus allowing sharper color sensitivity. This work presents a K-edge spectral CT imaging preliminary protocol based on the Pixirad-I/PixieIII detector where discrete tomography is used to present the reconstructed slices as color images. Results show that when a solution for the charge sharing issue is considered and refined reconstruction methods are applied, accurate K-edge subtraction imaging with conventional sources can be performed.
Collapse
|
25
|
Muntoni AP, Rojas RDH, Braunstein A, Pagnani A, Pérez Castillo I. Nonconvex image reconstruction via expectation propagation. Phys Rev E 2019; 100:032134. [PMID: 31639925 DOI: 10.1103/physreve.100.032134] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2018] [Indexed: 06/10/2023]
Abstract
The problem of efficiently reconstructing tomographic images can be mapped into a Bayesian inference problem over the space of pixels densities. Solutions to this problem are given by pixels assignments that are compatible with tomographic measurements and maximize a posterior probability density. This maximization can be performed with standard local optimization tools when the log-posterior is a convex function, but it is generally intractable when introducing realistic nonconcave priors that reflect typical images features such as smoothness or sharpness. We introduce a new method to reconstruct images obtained from Radon projections by using expectation propagation, which allows us to approximate the intractable posterior. We show, by means of extensive simulations, that, compared to state-of-the-art algorithms for this task, expectation propagation paired with very simple but non-log-concave priors is often able to reconstruct images up to a smaller error while using a lower amount of information per pixel. We provide estimates for the critical rate of information per pixel above which recovery is error-free by means of simulations on ensembles of phantom and real images.
Collapse
Affiliation(s)
- Anna Paola Muntoni
- Department of Applied Science and Technologies (DISAT), Politecnico di Torino, Corso Duca Degli Abruzzi 24, Torino, Italy
- Laboratoire de Physique de l'Ecole Normale Supérieure, ENS, Université PSL, CNRS, Sorbonne Université, Université de Paris, F-75005, Paris, France
- Sorbonne Université, CNRS, Institut de Biologie Paris-Seine, Laboratory of Computational and Quantitative Biology, F-75005, Paris, France
| | | | - Alfredo Braunstein
- Department of Applied Science and Technologies (DISAT), Politecnico di Torino, Corso Duca Degli Abruzzi 24, Torino, Italy
- Italian Institute for Genomic Medicine (form. HuGeF) SP142 km 3.95 - 10060 Candiolo, Italy
- INFN Sezione di Torino, Via P. Giuria 1, I-10125 Torino, Italy
- Collegio Carlo Alberto, Piazza Vincenzo Arbarello, 8 - 10122 Torino, Italy
| | - Andrea Pagnani
- Department of Applied Science and Technologies (DISAT), Politecnico di Torino, Corso Duca Degli Abruzzi 24, Torino, Italy
- Italian Institute for Genomic Medicine (form. HuGeF) SP142 km 3.95 - 10060 Candiolo, Italy
- INFN Sezione di Torino, Via P. Giuria 1, I-10125 Torino, Italy
| | - Isaac Pérez Castillo
- Departamento de Física Cuántica y Fótonica, Instituto de Física, UNAM, P. O. Box 20-364, 01000 Cd. Mx., México
- London Mathematical Laboratory, 8 Margravine Gardens, W6 8RH London, United Kingdom
| |
Collapse
|
26
|
Guo Y, Aveyard R, Rieger B. A Multichannel Cross-Modal Fusion Framework for Electron Tomography. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2019; 28:4206-4218. [PMID: 30908226 DOI: 10.1109/tip.2019.2907461] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
In this paper, we present a multichannel cross-modal fusion algorithm to combine two complementary modalities in electron tomography: X-ray spectroscopy and scanning transmission electron microscopy (STEM). The former reveals compositions with high elemental specificity but low signal-to-noise ratio (SNR), while the latter characterizes the structure with high SNR but little chemical information. We use a multivariate regression to build a cross-modal fusion framework for these two modalities to simultaneously achieve high elemental specificity and high SNR for a target element chosen from the sample under study. Specifically, we first compute three-dimensional tomograms from tilt-series datasets of X-ray and STEM using different reconstruction algorithms. Then, we generate many feature images from each tomogram. Finally, we adopt partial least squares regression to assess the connection between these feature images and the reconstruction of the target element. Based on the simulated and experimental datasets of semiconductor devices, we demonstrate that our algorithm can not only produce continuous edges, homogeneous foreground, and clean background in its element-specific reconstructions but also can more accurately preserve fine structures than state-of-the-art tomography techniques. Moreover, we show that it can deliver results with high fidelity even for X-ray datasets with limited tilts or low counts. This property is highly desired in the semiconductor industry where acquisition time and sample damage are essential.
Collapse
|
27
|
Song H, Yang Y, Geng J, Gu Z, Zou J, Yu C. Electron Tomography: A Unique Tool Solving Intricate Hollow Nanostructures. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2019; 31:e1801564. [PMID: 30160340 DOI: 10.1002/adma.201801564] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/09/2018] [Revised: 06/05/2018] [Indexed: 06/08/2023]
Abstract
Innovations in nanofabrication have expedited advances in hollow-structured nanomaterials with increasing complexity, which, at the same time, set challenges for the precise determination of their intriguing and complicated 3D configurations. Conventional transmission electron microscopy (TEM) analysis typically yields 2D projections of 3D objects, which in some cases is insufficient to reflect the genuine architectures of these 3D nano-objects, providing misleading information. Advanced analytical approaches such as focused ion beam (FIB) and ultramicrotomy enable the real slicing of nanomaterials, realizing the direct observation of inner structures but with limited spatial discrimination. Electron tomography (ET) is a technique that retrieves spatial information from a series of 2D electron projections at different tilt angles. As a unique and powerful tool kit, this technique has experienced great advances in its application in materials science, resolving the intricate 3D nanostructures. Here, the exceptional capability of the ET technique in the structural, chemical, and quantitative analysis of hollow-structured nanomaterials is discussed in detail. The distinct information derived from ET analysis is highlighted and compared with conventional analysis methods. Along with the advances in microscopy technologies, the state-of-the-art ET technique offers great opportunities and promise in the development of hollow nanomaterials.
Collapse
Affiliation(s)
- Hao Song
- Australian Institute for Bioengineering and Nanotechnology, The University of Queensland, Brisbane, QLD, 4072, Australia
| | - Yannan Yang
- Australian Institute for Bioengineering and Nanotechnology, The University of Queensland, Brisbane, QLD, 4072, Australia
| | - Jing Geng
- Australian Institute for Bioengineering and Nanotechnology, The University of Queensland, Brisbane, QLD, 4072, Australia
| | - Zhengying Gu
- Australian Institute for Bioengineering and Nanotechnology, The University of Queensland, Brisbane, QLD, 4072, Australia
| | - Jin Zou
- Materials Engineering and Centre for Microscopy and Microanalysis, The University of Queensland, Brisbane, QLD, 4072, Australia
| | - Chengzhong Yu
- Australian Institute for Bioengineering and Nanotechnology, The University of Queensland, Brisbane, QLD, 4072, Australia
| |
Collapse
|
28
|
Choi S, Lee S, Jo Y, Yoo D, Kim D, Lee B. Optimal binary representation via non-convex optimization on tomographic displays. OPTICS EXPRESS 2019; 27:24362-24381. [PMID: 31510326 DOI: 10.1364/oe.27.024362] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/20/2019] [Accepted: 08/04/2019] [Indexed: 06/10/2023]
Abstract
There have been many recent developments in 3D display technology to provide correct accommodation cues over an extended focus range. To this end, those displays rely on scene decomposition algorithms to reproduce accurate occlusion boundaries as well asretinal defocus blur. Recently, tomographic displays have been proposed with improved trade-offs of focus range, spatial resolution, and exit-pupil. The advantage of the system partly stems from a high-speed backlight modulation system based on a digital micromirror device, which only supports 1-bit images. However, its inherent binary constraint hinders achieving the optimal scene decomposition, thus leaving boundary artifacts. In this work, we present a technique for synthesizing optimal imagery of general 3D scenes with occlusion on tomographic displays. Requiring no prior knowledge of the scene geometry, our technique addresses the blending issue via non-convex optimization, inspired by recent studies in discrete tomography. Also, we present a general framework for this rendering algorithm and demonstrate the utility of the technique for volumetric display systems with binary representation.
Collapse
|
29
|
On-the-Fly Machine Learning for Improving Image Resolution in Tomography. APPLIED SCIENCES-BASEL 2019. [DOI: 10.3390/app9122445] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
In tomography, the resolution of the reconstructed 3D volume is inherently limited by the pixel resolution of the detector and optical phenomena. Machine learning has demonstrated powerful capabilities for super-resolution in several imaging applications. Such methods typically rely on the availability of high-quality training data for a series of similar objects. In many applications of tomography, existing machine learning methods cannot be used because scanning such a series of similar objects is either impossible or infeasible. In this paper, we propose a novel technique for improving the resolution of tomographic volumes that is based on the assumption that the local structure is similar throughout the object. Therefore, our approach does not require a training set of similar objects. The technique combines a specially designed scanning procedure with a machine learning method for super-resolution imaging. We demonstrate the effectiveness of our approach using both simulated and experimental data. The results show that the proposed method is able to significantly improve resolution of tomographic reconstructions.
Collapse
|
30
|
Liu J, Liang Z, Guan Y, Wei W, Bai H, Chen L, Liu G, Tian Y. A modified discrete tomography for improving the reconstruction of unknown multi-gray-level material in the `missing wedge' situation. JOURNAL OF SYNCHROTRON RADIATION 2018; 25:1847-1859. [PMID: 30407198 DOI: 10.1107/s1600577518013681] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/13/2018] [Accepted: 09/25/2018] [Indexed: 06/08/2023]
Abstract
Full angular rotational projections cannot always be acquired in tomographic reconstructions because of the limited space in the experimental setup, leading to the `missing wedge' situation. In this paper, a recovering `missing wedge' discrete algebraic reconstruction technique algorithm (rmwDART) has been proposed to solve the `missing wedge' problem and improve the quality of the three-dimensional reconstruction without prior knowledge of the material component's number or the material's values. By using oversegmentation, boundary extraction and mathematical morphological operations, `missing wedge' artifact areas can be located. Then, in the iteration process, by updating the located areas and regions, high-quality reconstructions can be obtained from the simulations, and the reconstructed images based on the rmwDART algorithm can be obtained from soft X-ray nano-computed tomography experiments. The results showed that there is the potential for discrete tomography.
Collapse
Affiliation(s)
- Jianhong Liu
- National Synchrotron Radiation Laboratory, University of Science and Technology of China, 3#222, No. 42 Hezuohua South Road, Hefei, Anhui 230029, People's Republic of China
| | - Zhiting Liang
- National Synchrotron Radiation Laboratory, University of Science and Technology of China, 3#222, No. 42 Hezuohua South Road, Hefei, Anhui 230029, People's Republic of China
| | - Yong Guan
- National Synchrotron Radiation Laboratory, University of Science and Technology of China, 3#222, No. 42 Hezuohua South Road, Hefei, Anhui 230029, People's Republic of China
| | - Wenbin Wei
- National Synchrotron Radiation Laboratory, University of Science and Technology of China, 3#222, No. 42 Hezuohua South Road, Hefei, Anhui 230029, People's Republic of China
| | - Haobo Bai
- National Synchrotron Radiation Laboratory, University of Science and Technology of China, 3#222, No. 42 Hezuohua South Road, Hefei, Anhui 230029, People's Republic of China
| | - Liang Chen
- National Synchrotron Radiation Laboratory, University of Science and Technology of China, 3#222, No. 42 Hezuohua South Road, Hefei, Anhui 230029, People's Republic of China
| | - Gang Liu
- National Synchrotron Radiation Laboratory, University of Science and Technology of China, 3#222, No. 42 Hezuohua South Road, Hefei, Anhui 230029, People's Republic of China
| | - Yangchao Tian
- National Synchrotron Radiation Laboratory, University of Science and Technology of China, 3#222, No. 42 Hezuohua South Road, Hefei, Anhui 230029, People's Republic of China
| |
Collapse
|
31
|
Iterative and discrete reconstruction in the evaluation of the rabbit model of osteoarthritis. Sci Rep 2018; 8:12051. [PMID: 30104576 PMCID: PMC6089934 DOI: 10.1038/s41598-018-30334-8] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2018] [Accepted: 07/23/2018] [Indexed: 11/09/2022] Open
Abstract
Micro-computed tomography (µCT) is a standard method for bone morphometric evaluation. However, the scan time can be long and the radiation dose during the scan may have adverse effects on test subjects, therefore both of them should be minimized. This could be achieved by applying iterative reconstruction (IR) on sparse projection data, as IR is capable of producing reconstructions of sufficient image quality with less projection data than the traditional algorithm requires. In this work, the performance of three IR algorithms was assessed for quantitative bone imaging from low-resolution data in the evaluation of the rabbit model of osteoarthritis. Subchondral bone images were reconstructed with a conjugate gradient least squares algorithm, a total variation regularization scheme, and a discrete algebraic reconstruction technique to obtain quantitative bone morphometry, and the results obtained in this manner were compared with those obtained from the reference reconstruction. Our approaches were sufficient to identify changes in bone structure in early osteoarthritis, and these changes were preserved even when minimal data were provided for the reconstruction. Thus, our results suggest that IR algorithms give reliable performance with sparse projection data, thereby recommending them for use in µCT studies where time and radiation exposure are preferably minimized.
Collapse
|
32
|
Dynamic Tomographic Reconstruction of Deforming Volumes. MATERIALS 2018; 11:ma11081395. [PMID: 30096947 PMCID: PMC6119884 DOI: 10.3390/ma11081395] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/17/2018] [Revised: 08/03/2018] [Accepted: 08/06/2018] [Indexed: 12/20/2022]
Abstract
The motion of a sample while being scanned in a tomograph prevents its proper volume reconstruction. In the present study, a procedure is proposed that aims at estimating both the kinematics of the sample and its standard 3D imaging from a standard acquisition protocol (no more projection than for a rigid specimen). The proposed procedure is a staggered two-step algorithm where the volume is first reconstructed using a “Dynamic Reconstruction” technique, a variant of Algebraic Reconstruction Technique (ART) compensating for a “frozen” determination of the motion, followed by a Projection-based Digital Volume Correlation (P-DVC) algorithm that estimates the space/time displacement field, with a “frozen” microstructure and shape of the sample. Additionally, this procedure is combined with a multi-scale approach that is essential for a proper separation between motion and microstructure. A proof-of-concept of the validity and performance of this approach is proposed based on two virtual examples. The studied cases involve a small number of projections, large strains, up to 25%, and noise.
Collapse
|
33
|
Vlasov VV, Konovalov AB, Kolchugin SV. Hybrid algorithm for few-views computed tomography of strongly absorbing media: algebraic reconstruction, TV-regularization, and adaptive segmentation. JOURNAL OF ELECTRONIC IMAGING 2018; 27:1. [DOI: 10.1117/1.jei.27.4.043006] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/10/2023]
Affiliation(s)
- Vitaly V. Vlasov
- Russian Federal Nuclear Center—Zababakhin Institute of Applied Physics, Chelyabinsk Region
| | - Alexander B. Konovalov
- Russian Federal Nuclear Center—Zababakhin Institute of Applied Physics, Chelyabinsk Region
| | - Sergey V. Kolchugin
- Russian Federal Nuclear Center—Zababakhin Institute of Applied Physics, Chelyabinsk Region
| |
Collapse
|
34
|
Zhao Y, Xu J, Li H, Zhang P. Edge information diffusion based reconstruction (EIDR) for cone beam computed laminography. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2018; 27:4663-4675. [PMID: 29994209 DOI: 10.1109/tip.2018.2845098] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Computed laminography (CL) is a prospective nondestructive testing technique for flat object inspection in industrial applications. However, CL image reconstruction is a challenging task because incomplete projection data are acquired from the CL scan. When a conventional computed tomography (CT) reconstruction method is applied to cone beam CL data, the vertical edges (singularities in the z-direction) in the reconstructed image would be blurred. On the contrary, the horizontal edges (singularities within slices) can be quite accurately reconstructed. Based on this key observation, an edge information diffusion method is developed, which fixes the horizontal edges and propagates their values within the slices. An effective CL reconstruction method is then proposed for flat object inspection by combining the edge information diffusion procedure, which plays the role of regularization, with conventional CT image reconstruction algorithms. Experiments on both simulated data and real data are performed to verify the effectiveness of the proposed method. The results show that the proposed method can effectively suppress the inter-slice aliasing and blurring caused by incompleteness of the CL scan data, and that it outperforms other state-of-the-art methods.
Collapse
|
35
|
Evaluation of noise and blur effects with SIRT-FISTA-TV reconstruction algorithm: Application to fast environmental transmission electron tomography. Ultramicroscopy 2018; 189:109-123. [DOI: 10.1016/j.ultramic.2018.03.022] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2017] [Revised: 03/21/2018] [Accepted: 03/28/2018] [Indexed: 11/21/2022]
|
36
|
Wang Z, Herremans E, Janssen S, Cantre D, Verboven P, Nicolaï B. Visualizing 3D Food Microstructure Using Tomographic Methods: Advantages and Disadvantages. Annu Rev Food Sci Technol 2018; 9:323-343. [DOI: 10.1146/annurev-food-030117-012639] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Affiliation(s)
- Zi Wang
- Postharvest Group, Division MeBioS, KU Leuven, 3001 Leuven, Belgium
| | - Els Herremans
- Postharvest Group, Division MeBioS, KU Leuven, 3001 Leuven, Belgium
| | - Siem Janssen
- Postharvest Group, Division MeBioS, KU Leuven, 3001 Leuven, Belgium
| | - Dennis Cantre
- Postharvest Group, Division MeBioS, KU Leuven, 3001 Leuven, Belgium
| | - Pieter Verboven
- Postharvest Group, Division MeBioS, KU Leuven, 3001 Leuven, Belgium
| | - Bart Nicolaï
- Postharvest Group, Division MeBioS, KU Leuven, 3001 Leuven, Belgium
- Flanders Centre of Postharvest Technology, VCBT, 3001 Leuven, Belgium
| |
Collapse
|
37
|
Haffner-Staton E, LA Rocca A, Fay MW. Progress towards a methodology for high throughput 3D reconstruction of soot nanoparticles via electron tomography. J Microsc 2018; 270:272-289. [PMID: 29336490 PMCID: PMC6849582 DOI: 10.1111/jmi.12680] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2017] [Revised: 12/14/2017] [Accepted: 12/19/2017] [Indexed: 11/27/2022]
Abstract
The aim of this work is to make progress towards the development of 3D reconstruction as a legitimate alternative to traditional 2D characterization of soot. Time constraints are the greatest opposition to its implementation, as currently reconstruction of a single soot particle takes around 5-6 h to complete. As such, the accuracy and detail gains are currently insufficient to challenge 2D characterization of a representative sample (e.g. 200 particles). This work is a consideration of the optimization of the steps included within the computational reconstruction and manual segmentation of soot particles. Our optimal process reduced the time required by over 70% in comparison to a typical procedure, whilst producing models with no appreciable decrease in quality.
Collapse
Affiliation(s)
- E Haffner-Staton
- Department of Mechanical Materials and Manufacturing Engineering, The University of Nottingham, University Park, Nottingham, NG7 2RD, U.K
| | - A LA Rocca
- Department of Mechanical Materials and Manufacturing Engineering, The University of Nottingham, University Park, Nottingham, NG7 2RD, U.K
| | - M W Fay
- Department of Mechanical Materials and Manufacturing Engineering, The University of Nottingham, University Park, Nottingham, NG7 2RD, U.K.,Nanoscale and Microscale Research Centre, The University of Nottingham, University Park, Nottingham, NG7 2RD, U.K
| |
Collapse
|
38
|
Van de Casteele E, Perilli E, Van Aarle W, Reynolds KJ, Sijbers J. Discrete tomography in an in vivo small animal bone study. J Bone Miner Metab 2018; 36:40-53. [PMID: 28243794 DOI: 10.1007/s00774-017-0815-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/18/2016] [Accepted: 01/10/2017] [Indexed: 10/20/2022]
Abstract
This study aimed at assessing the feasibility of a discrete algebraic reconstruction technique (DART) to be used in in vivo small animal bone studies. The advantage of discrete tomography is the possibility to reduce the amount of X-ray projection images, which makes scans faster and implies also a significant reduction of radiation dose, without compromising the reconstruction results. Bone studies are ideal for being performed with discrete tomography, due to the relatively small number of attenuation coefficients contained in the image [namely three: background (air), soft tissue and bone]. In this paper, a validation is made by comparing trabecular bone morphometric parameters calculated from images obtained by using DART and the commonly used standard filtered back-projection (FBP). Female rats were divided into an ovariectomized (OVX) and a sham-operated group. In vivo micro-CT scanning of the tibia was done at baseline and at 2, 4, 8 and 12 weeks after surgery. The cross-section images were reconstructed using first the full set of projection images and afterwards reducing them in number to a quarter and one-sixth (248, 62, 42 projection images, respectively). For both reconstruction methods, similar changes in morphometric parameters were observed over time: bone loss for OVX and bone growth for sham-operated rats, although for DART the actual values were systematically higher (bone volume fraction) or lower (structure model index) compared to FBP, depending on the morphometric parameter. The DART algorithm was, however, more robust when using fewer projection images, where the standard FBP reconstruction was more prone to noise, showing a significantly bigger deviation from the morphometric parameters obtained using all projection images. This study supports the use of DART as a potential alternative method to FBP in X-ray micro-CT animal studies, in particular, when the number of projections has to be drastically minimized, which directly reduces scanning time and dose.
Collapse
Affiliation(s)
- Elke Van de Casteele
- iMinds, VisionLab, Department of Physics, University of Antwerp (CDE), Universiteitsplein 1, Building N, 2610, Antwerp, Belgium.
| | - Egon Perilli
- Medical Device Research Institute, School of Computer Science, Engineering and Mathematics, Flinders University, GPO Box 2100, Adelaide, SA, 5001, Australia
| | - Wim Van Aarle
- iMinds, VisionLab, Department of Physics, University of Antwerp (CDE), Universiteitsplein 1, Building N, 2610, Antwerp, Belgium
| | - Karen J Reynolds
- Medical Device Research Institute, School of Computer Science, Engineering and Mathematics, Flinders University, GPO Box 2100, Adelaide, SA, 5001, Australia
| | - Jan Sijbers
- iMinds, VisionLab, Department of Physics, University of Antwerp (CDE), Universiteitsplein 1, Building N, 2610, Antwerp, Belgium
| |
Collapse
|
39
|
Wang Z, Chen Y, Zhang J, Li L, Wan X, Liu Z, Sun F, Zhang F. ICON-MIC: Implementing a CPU/MIC Collaboration Parallel Framework for ICON on Tianhe-2 Supercomputer. J Comput Biol 2017; 25:270-281. [PMID: 29185807 DOI: 10.1089/cmb.2017.0151] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Electron tomography (ET) is an important technique for studying the three-dimensional structures of the biological ultrastructure. Recently, ET has reached sub-nanometer resolution for investigating the native and conformational dynamics of macromolecular complexes by combining with the sub-tomogram averaging approach. Due to the limited sampling angles, ET reconstruction typically suffers from the "missing wedge" problem. Using a validation procedure, iterative compressed-sensing optimized nonuniform fast Fourier transform (NUFFT) reconstruction (ICON) demonstrates its power in restoring validated missing information for a low-signal-to-noise ratio biological ET dataset. However, the huge computational demand has become a bottleneck for the application of ICON. In this work, we implemented a parallel acceleration technology ICON-many integrated core (MIC) on Xeon Phi cards to address the huge computational demand of ICON. During this step, we parallelize the element-wise matrix operations and use the efficient summation of a matrix to reduce the cost of matrix computation. We also developed parallel versions of NUFFT on MIC to achieve a high acceleration of ICON by using more efficient fast Fourier transform (FFT) calculation. We then proposed a hybrid task allocation strategy (two-level load balancing) to improve the overall performance of ICON-MIC by making full use of the idle resources on Tianhe-2 supercomputer. Experimental results using two different datasets show that ICON-MIC has high accuracy in biological specimens under different noise levels and a significant acceleration, up to 13.3 × , compared with the CPU version. Further, ICON-MIC has good scalability efficiency and overall performance on Tianhe-2 supercomputer.
Collapse
Affiliation(s)
- Zihao Wang
- 1 High Performance Computer Research Center, Institute of Computing Technology , Chinese Academy of Sciences, Beijing, China .,2 University of Chinese Academy of Sciences , Beijing, China .,6 These authors contributed equally to this work
| | - Yu Chen
- 1 High Performance Computer Research Center, Institute of Computing Technology , Chinese Academy of Sciences, Beijing, China .,2 University of Chinese Academy of Sciences , Beijing, China .,6 These authors contributed equally to this work
| | - Jingrong Zhang
- 1 High Performance Computer Research Center, Institute of Computing Technology , Chinese Academy of Sciences, Beijing, China .,2 University of Chinese Academy of Sciences , Beijing, China
| | - Lun Li
- 1 High Performance Computer Research Center, Institute of Computing Technology , Chinese Academy of Sciences, Beijing, China .,3 School of Mathematical Sciences, University of Chinese Academy of Sciences , Beijing, China
| | - Xiaohua Wan
- 1 High Performance Computer Research Center, Institute of Computing Technology , Chinese Academy of Sciences, Beijing, China
| | - Zhiyong Liu
- 1 High Performance Computer Research Center, Institute of Computing Technology , Chinese Academy of Sciences, Beijing, China
| | - Fei Sun
- 2 University of Chinese Academy of Sciences , Beijing, China .,4 National Key Laboratory of Biomacromolecules, CAS Center for Excellence in Biomacromolecules, Institute of Biophysics , Chinese Academy of Sciences, Beijing, China .,5 Center for Biological Imaging, Institute of Biophysics , Chinese Academy of Sciences, Beijing, China
| | - Fa Zhang
- 1 High Performance Computer Research Center, Institute of Computing Technology , Chinese Academy of Sciences, Beijing, China
| |
Collapse
|
40
|
A Survey of the Use of Iterative Reconstruction Algorithms in Electron Microscopy. BIOMED RESEARCH INTERNATIONAL 2017; 2017:6482567. [PMID: 29312997 PMCID: PMC5623807 DOI: 10.1155/2017/6482567] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 09/16/2016] [Accepted: 03/09/2017] [Indexed: 11/18/2022]
Abstract
One of the key steps in Electron Microscopy is the tomographic reconstruction of a three-dimensional (3D) map of the specimen being studied from a set of two-dimensional (2D) projections acquired at the microscope. This tomographic reconstruction may be performed with different reconstruction algorithms that can be grouped into several large families: direct Fourier inversion methods, back-projection methods, Radon methods, or iterative algorithms. In this review, we focus on the latter family of algorithms, explaining the mathematical rationale behind the different algorithms in this family as they have been introduced in the field of Electron Microscopy. We cover their use in Single Particle Analysis (SPA) as well as in Electron Tomography (ET).
Collapse
|
41
|
Demircan-Tureyen E, Kamasak ME. A discretized tomographic image reconstruction based upon total variation regularization. Biomed Signal Process Control 2017. [DOI: 10.1016/j.bspc.2017.03.015] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
42
|
Chen Y, Wang Z, Zhang J, Li L, Wan X, Sun F, Zhang F. Accelerating electron tomography reconstruction algorithm ICON with GPU. BIOPHYSICS REPORTS 2017; 3:36-42. [PMID: 28781999 PMCID: PMC5516007 DOI: 10.1007/s41048-017-0041-z] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2017] [Accepted: 04/07/2017] [Indexed: 10/30/2022] Open
Abstract
Electron tomography (ET) plays an important role in studying in situ cell ultrastructure in three-dimensional space. Due to limited tilt angles, ET reconstruction always suffers from the "missing wedge" problem. With a validation procedure, iterative compressed-sensing optimized NUFFT reconstruction (ICON) demonstrates its power in the restoration of validated missing information for low SNR biological ET dataset. However, the huge computational demand has become a major problem for the application of ICON. In this work, we analyzed the framework of ICON and classified the operations of major steps of ICON reconstruction into three types. Accordingly, we designed parallel strategies and implemented them on graphics processing units (GPU) to generate a parallel program ICON-GPU. With high accuracy, ICON-GPU has a great acceleration compared to its CPU version, up to 83.7×, greatly relieving ICON's dependence on computing resource.
Collapse
Affiliation(s)
- Yu Chen
- Key Laboratory of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, 100190 China.,University of Chinese Academy of Sciences, Beijing, 100049 China
| | - Zihao Wang
- Key Laboratory of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, 100190 China.,University of Chinese Academy of Sciences, Beijing, 100049 China
| | - Jingrong Zhang
- Key Laboratory of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, 100190 China.,University of Chinese Academy of Sciences, Beijing, 100049 China
| | - Lun Li
- Key Laboratory of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, 100190 China.,School of Mathematical Sciences, University of Chinese Academy of Sciences, Beijing, 100049 China
| | - Xiaohua Wan
- Key Laboratory of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, 100190 China
| | - Fei Sun
- University of Chinese Academy of Sciences, Beijing, 100049 China.,National Key Laboratory of Biomacromolecules, CAS Center for Excellence in Biomacromolecules, Institute of Biophysics, Chinese Academy of Sciences, Beijing, 100101 China.,Center for Biological Imaging, Institute of Biophysics, Chinese Academy of Sciences, Beijing, 100101 China
| | - Fa Zhang
- Key Laboratory of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, 100190 China
| |
Collapse
|
43
|
Vegas-Sánchez-Ferrero G, Ledesma-Carbayo MJ, Washko GR, San José Estépar R. Statistical characterization of noise for spatial standardization of CT scans: Enabling comparison with multiple kernels and doses. Med Image Anal 2017. [PMID: 28622587 DOI: 10.1016/j.media.2017.06.001] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
Computerized tomography (CT) is a widely adopted modality for analyzing directly or indirectly functional, biological and morphological processes by means of the image characteristics. However, the potential utilization of the information obtained from CT images is often limited when considering the analysis of quantitative information involving different devices, acquisition protocols or reconstruction algorithms. Although CT scanners are calibrated as a part of the imaging workflow, the calibration is circumscribed to global reference values and does not circumvent problems that are inherent to the imaging modality. One of them is the lack of noise stationarity, which makes quantitative biomarkers extracted from the images less robust and stable. Some methodologies have been proposed for the assessment of non-stationary noise in reconstructed CT scans. However, those methods focused on the non-stationarity only due to the reconstruction geometry and are mainly based on the propagation of the variance of noise throughout the whole reconstruction process. Additionally, the philosophy followed in the state-of-the-art methods is based on the reduction of noise, but not in the standardization of it. This means that, even if the noise is reduced, the statistics of the signal remain non-stationary, which is insufficient to enable comparisons between different acquisitions with different statistical characteristics. In this work, we propose a statistical characterization of noise in reconstructed CT scans that leads to a versatile statistical model that effectively characterizes different doses, reconstruction kernels, and devices. The statistical model is generalized to deal with the partial volume effect via a localized mixture model that also describes the non-stationarity of noise. Finally, we propose a stabilization scheme to achieve stationary variance. The validation of the proposed methodology was performed with a physical phantom and clinical CT scans acquired with different configurations (kernels, doses, algorithms including iterative reconstruction). The results confirmed its suitability to enable comparisons with different doses, and acquisition protocols.
Collapse
Affiliation(s)
- Gonzalo Vegas-Sánchez-Ferrero
- Applied Chest Imaging Laboratory (ACIL), Brigham and Women's Hospital, Harvard Medical School, 1249, Boylston St., Boston, MA 02115 USA; Biomedical Image Technologies Laboratory (BIT), ETSI Telecomunicacion, Universidad Politecnica de Madrid, and CIBER-BBN, Madrid, Spain.
| | - Maria J Ledesma-Carbayo
- Biomedical Image Technologies Laboratory (BIT), ETSI Telecomunicacion, Universidad Politecnica de Madrid, and CIBER-BBN, Madrid, Spain
| | - George R Washko
- Applied Chest Imaging Laboratory (ACIL), Brigham and Women's Hospital, Harvard Medical School, 1249, Boylston St., Boston, MA 02115 USA
| | - Raúl San José Estépar
- Applied Chest Imaging Laboratory (ACIL), Brigham and Women's Hospital, Harvard Medical School, 1249, Boylston St., Boston, MA 02115 USA
| |
Collapse
|
44
|
|
45
|
Ramos-Llorden G, den Dekker AJ, Sijbers J. Partial Discreteness: A Novel Prior for Magnetic Resonance Image Reconstruction. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:1041-1053. [PMID: 28026759 DOI: 10.1109/tmi.2016.2645122] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/22/2023]
Abstract
An important factor influencing the quality of magnetic resonance (MR) images is the reconstruction method that is employed, and specifically, the type of prior knowledge that is exploited during reconstruction. In this work, we introduce a new type of prior knowledge, partial discreteness (PD), where a small number of regions in the image are assumed to be homogeneous and can be well represented by a constant magnitude. In particular, we mathematically formalize the partial discreteness property based on a Gaussian Mixture Model (GMM) and derive a partial discreteness image representation that characterizes the salient features of partially discrete images: a constant intensity in homogeneous areas and texture in heterogeneous areas. The partial discreteness representation is then used to construct a novel prior dedicated to the reconstruction of partially discrete MR images. The strength of the proposed prior is demonstrated on various simulated and real k-space data-based experiments with partially discrete images. Results demonstrate that the PD algorithm performs competitively with state-of-the-art reconstruction methods, being flexible and easy to implement.
Collapse
|
46
|
Zhuge X, Jinnai H, Dunin-Borkowski RE, Migunov V, Bals S, Cool P, Bons AJ, Batenburg KJ. Automated discrete electron tomography – Towards routine high-fidelity reconstruction of nanomaterials. Ultramicroscopy 2017; 175:87-96. [DOI: 10.1016/j.ultramic.2017.01.009] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2016] [Revised: 12/29/2016] [Accepted: 01/21/2017] [Indexed: 11/27/2022]
|
47
|
Öktem O, Chen C, Domaniç NO, Ravikumar P, Bajaj C. SHAPE BASED IMAGE RECONSTRUCTION USING LINEARIZED DEFORMATIONS. INVERSE PROBLEMS 2017; 33:035004. [PMID: 28855745 PMCID: PMC5573282 DOI: 10.1088/1361-6420/aa55af] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
We introduce a reconstruction framework that can account for shape related a priori information in ill-posed linear inverse problems in imaging. It is a variational scheme that uses a shape functional defined using deformable templates machinery from shape theory. As proof of concept, we apply the proposed shape based reconstruction to 2D tomography with very sparse measurements, and demonstrate strong empirical results.
Collapse
Affiliation(s)
- Ozan Öktem
- Department of Mathematics, KTH - Royal Institute of Technology, 100 44 Stockholm, Sweden
| | - Chong Chen
- Department of Mathematics, KTH - Royal Institute of Technology, 100 44 Stockholm, Sweden and LSEC, Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing 100190, China
| | - Nevzat Onur Domaniç
- Department of Computer Science, University of Texas at Austin, Austin, TX 78712, USA
| | - Pradeep Ravikumar
- Department of Computer Science, University of Texas at Austin, Austin, TX 78712, USA
| | - Chandrajit Bajaj
- Department of Computer Science, University of Texas at Austin, Austin, TX 78712, USA
| |
Collapse
|
48
|
Bicer T, Gürsoy D, Andrade VD, Kettimuthu R, Scullin W, Carlo FD, Foster IT. Trace: a high-throughput tomographic reconstruction engine for large-scale datasets. ADVANCED STRUCTURAL AND CHEMICAL IMAGING 2017; 3:6. [PMID: 28261544 PMCID: PMC5313579 DOI: 10.1186/s40679-017-0040-7] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/29/2016] [Accepted: 01/17/2017] [Indexed: 11/10/2022]
Abstract
BACKGROUND Modern synchrotron light sources and detectors produce data at such scale and complexity that large-scale computation is required to unleash their full power. One of the widely used imaging techniques that generates data at tens of gigabytes per second is computed tomography (CT). Although CT experiments result in rapid data generation, the analysis and reconstruction of the collected data may require hours or even days of computation time with a medium-sized workstation, which hinders the scientific progress that relies on the results of analysis. METHODS We present Trace, a data-intensive computing engine that we have developed to enable high-performance implementation of iterative tomographic reconstruction algorithms for parallel computers. Trace provides fine-grained reconstruction of tomography datasets using both (thread-level) shared memory and (process-level) distributed memory parallelization. Trace utilizes a special data structure called replicated reconstruction object to maximize application performance. We also present the optimizations that we apply to the replicated reconstruction objects and evaluate them using tomography datasets collected at the Advanced Photon Source. RESULTS Our experimental evaluations show that our optimizations and parallelization techniques can provide 158× speedup using 32 compute nodes (384 cores) over a single-core configuration and decrease the end-to-end processing time of a large sinogram (with 4501 × 1 × 22,400 dimensions) from 12.5 h to <5 min per iteration. CONCLUSION The proposed tomographic reconstruction engine can efficiently process large-scale tomographic data using many compute nodes and minimize reconstruction times.
Collapse
Affiliation(s)
- Tekin Bicer
- Mathematics and Computer Science Division, Argonne National Laboratory, 9700 South Cass Ave., Lemont, IL 60439 USA
| | - Doğa Gürsoy
- X-Ray Science Division, Advanced Photon Source, Argonne National Laboratory, 9700 South Cass Ave., Lemont, IL 60439 USA
| | - Vincent De Andrade
- X-Ray Science Division, Advanced Photon Source, Argonne National Laboratory, 9700 South Cass Ave., Lemont, IL 60439 USA
| | - Rajkumar Kettimuthu
- Mathematics and Computer Science Division, Argonne National Laboratory, 9700 South Cass Ave., Lemont, IL 60439 USA
- Computation Institute, University of Chicago and Argonne National Laboratory, 5735 South Ellis Ave., Chicago, IL 60637 USA
| | - William Scullin
- Argonne Leadership Computing Facility, Argonne National Laboratory, 9700 South Cass Ave., Lemont, IL 60439 USA
| | - Francesco De Carlo
- X-Ray Science Division, Advanced Photon Source, Argonne National Laboratory, 9700 South Cass Ave., Lemont, IL 60439 USA
| | - Ian T. Foster
- Mathematics and Computer Science Division, Argonne National Laboratory, 9700 South Cass Ave., Lemont, IL 60439 USA
- Computation Institute, University of Chicago and Argonne National Laboratory, 5735 South Ellis Ave., Chicago, IL 60637 USA
- Department of Computer Science, University of Chicago, 5801 South Ellis Ave., Chicago, IL 60637 USA
| |
Collapse
|
49
|
Sanders T, Gelb A, Platte RB, Arslan I, Landskron K. Recovering fine details from under-resolved electron tomography data using higher order total variation ℓ 1 regularization. Ultramicroscopy 2017; 174:97-105. [PMID: 28064041 DOI: 10.1016/j.ultramic.2016.12.020] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2016] [Revised: 11/30/2016] [Accepted: 12/21/2016] [Indexed: 10/20/2022]
Abstract
Over the last decade or so, reconstruction methods using ℓ1 regularization, often categorized as compressed sensing (CS) algorithms, have significantly improved the capabilities of high fidelity imaging in electron tomography. The most popular ℓ1 regularization approach within electron tomography has been total variation (TV) regularization. In addition to reducing unwanted noise, TV regularization encourages a piecewise constant solution with sparse boundary regions. In this paper we propose an alternative ℓ1 regularization approach for electron tomography based on higher order total variation (HOTV). Like TV, the HOTV approach promotes solutions with sparse boundary regions. In smooth regions however, the solution is not limited to piecewise constant behavior. We demonstrate that this allows for more accurate reconstruction of a broader class of images - even those for which TV was designed for - particularly when dealing with pragmatic tomographic sampling patterns and very fine image features. We develop results for an electron tomography data set as well as a phantom example, and we also make comparisons with discrete tomography approaches.
Collapse
Affiliation(s)
- Toby Sanders
- School of Mathematical and Statistical Sciences, Arizona State University, United States.
| | - Anne Gelb
- Department of Mathematics, Dartmouth College, United States
| | - Rodrigo B Platte
- School of Mathematical and Statistical Sciences, Arizona State University, United States
| | - Ilke Arslan
- Fundamental and Computational Sciences Directorate, Pacific Northwest National Laboratory, United States
| | - Kai Landskron
- Department of Chemistry, Lehigh University, United States
| |
Collapse
|
50
|
Pelt DM, De Andrade V. Improved tomographic reconstruction of large-scale real-world data by filter optimization. ADVANCED STRUCTURAL AND CHEMICAL IMAGING 2016; 2:17. [PMID: 28003954 PMCID: PMC5135727 DOI: 10.1186/s40679-016-0033-y] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/23/2016] [Accepted: 11/22/2016] [Indexed: 11/10/2022]
Abstract
In advanced tomographic experiments, large detector sizes and large numbers of acquired datasets can make it difficult to process the data in a reasonable time. At the same time, the acquired projections are often limited in some way, for example having a low number of projections or a low signal-to-noise ratio. Direct analytical reconstruction methods are able to produce reconstructions in very little time, even for large-scale data, but the quality of these reconstructions can be insufficient for further analysis in cases with limited data. Iterative reconstruction methods typically produce more accurate reconstructions, but take significantly more time to compute, which limits their usefulness in practice. In this paper, we present the application of the SIRT-FBP method to large-scale real-world tomographic data. The SIRT-FBP method is able to accurately approximate the simultaneous iterative reconstruction technique (SIRT) method by the computationally efficient filtered backprojection (FBP) method, using precomputed experiment-specific filters. We specifically focus on the many implementation details that are important for application on large-scale real-world data, and give solutions to common problems that occur with experimental data. We show that SIRT-FBP filters can be computed in reasonable time, even for large problem sizes, and that precomputed filters can be reused for future experiments. Reconstruction results are given for three different experiments, and are compared with results of popular existing methods. The results show that the SIRT-FBP method is able to accurately approximate iterative reconstructions of experimental data. Furthermore, they show that, in practice, the SIRT-FBP method can produce more accurate reconstructions than standard direct analytical reconstructions with popular filters, without increasing the required computation time.
Collapse
Affiliation(s)
- Daniël M Pelt
- Lawrence Berkeley National Laboratory, 1 Cyclotron Road, Berkeley, CA 94720 USA ; Computational Imaging Group, Centrum Wiskunde & Informatica, Science Park 123, 1098 XG Amsterdam, The Netherlands
| | - Vincent De Andrade
- Advanced Photon Source, Argonne National Laboratory, 9700 South Cass Avenue, Lemont, IL 60439 USA
| |
Collapse
|