1
|
Alekseychuk VO, Kupsch A, Plotzki D, Bellon C, Bruno G. Simulation-Assisted Augmentation of Missing Wedge and Region-of-Interest Computed Tomography Data. J Imaging 2023; 10:11. [PMID: 38248996 PMCID: PMC10817004 DOI: 10.3390/jimaging10010011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2023] [Revised: 12/19/2023] [Accepted: 12/22/2023] [Indexed: 01/23/2024] Open
Abstract
This study reports a strategy to use sophisticated, realistic X-ray Computed Tomography (CT) simulations to reduce Missing Wedge (MW) and Region-of-Interest (RoI) artifacts in FBP (Filtered Back-Projection) reconstructions. A 3D model of the object is used to simulate the projections that include the missing information inside the MW and outside the RoI. Such information augments the experimental projections, thereby drastically improving the reconstruction results. An X-ray CT dataset of a selected object is modified to mimic various degrees of RoI and MW problems. The results are evaluated in comparison to a standard FBP reconstruction of the complete dataset. In all cases, the reconstruction quality is significantly improved. Small inclusions present in the scanned object are better localized and quantified. The proposed method has the potential to improve the results of any CT reconstruction algorithm.
Collapse
Affiliation(s)
- Vladimir O. Alekseychuk
- Institute of Computer Vision & Remote Sensing, Technical University Berlin, Marchstr. 23, 10587 Berlin, Germany;
- Vision in X Industrial Imaging GmbH, Johann-Hittorf-Str. 8, 12489 Berlin, Germany
| | - Andreas Kupsch
- Bundesanstalt für Materialforschung und -Prüfung (BAM), Unter den Eichen 87, 12205 Berlin, Germany; (D.P.); (G.B.)
| | - David Plotzki
- Bundesanstalt für Materialforschung und -Prüfung (BAM), Unter den Eichen 87, 12205 Berlin, Germany; (D.P.); (G.B.)
- Felix Bloch Institute for Solid State Physics, University Leipzig, 04103 Leipzig, Germany
| | - Carsten Bellon
- Bundesanstalt für Materialforschung und -Prüfung (BAM), Unter den Eichen 87, 12205 Berlin, Germany; (D.P.); (G.B.)
| | - Giovanni Bruno
- Bundesanstalt für Materialforschung und -Prüfung (BAM), Unter den Eichen 87, 12205 Berlin, Germany; (D.P.); (G.B.)
- Institute of Physics and Astronomy, University Potsdam, Karl-Liebknecht-Str. 24–25, 14476 Potsdam, Germany
| |
Collapse
|
2
|
Clark DP, Badea CT. MCR toolkit: A GPU-based toolkit for multi-channel reconstruction of preclinical and clinical x-ray CT data. Med Phys 2023; 50:4775-4796. [PMID: 37285215 PMCID: PMC10756497 DOI: 10.1002/mp.16532] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2022] [Revised: 05/07/2023] [Accepted: 05/19/2023] [Indexed: 06/08/2023] Open
Abstract
BACKGROUND The advancement of x-ray CT into the domains of photon counting spectral imaging and dynamic cardiac and perfusion imaging has created many new challenges and opportunities for clinicians and researchers. To address challenges such as dose constraints and scanning times while capitalizing on opportunities such as multi-contrast imaging and low-dose coronary angiography, these multi-channel imaging applications require a new generation of CT reconstruction tools. These new tools should exploit the relationships between imaging channels during reconstruction to set new image quality standards while serving as a platform for direct translation between the preclinical and clinical domains. PURPOSE We outline and demonstrate a new Multi-Channel Reconstruction (MCR) Toolkit for GPU-based analytical and iterative reconstruction of preclinical and clinical multi-energy and dynamic x-ray CT data. To promote open science, open-source distribution of the Toolkit will coincide with the release of this publication (GPL v3; gitlab.oit.duke.edu/dpc18/mcr-toolkit-public). METHODS The MCR Toolkit source code is implemented in C/C++ and NVIDIA's CUDA GPU programming interface, with scripting support from MATLAB and Python. The Toolkit implements matched, separable footprint CT reconstruction operators for projection and backprojection in two geometries: planar, cone-beam CT (CBCT) and 3rd generation, cylindrical multi-detector row CT (MDCT). Analytical reconstruction is performed using filtered backprojection (FBP) for circular CBCT, weighted FBP (WFBP) for helical CBCT, and cone-parallel projection rebinning followed by WFBP for MDCT. Arbitrary combinations of energy and temporal channels are iteratively reconstructed under a generalized multi-channel signal model for joint reconstruction. We solve this generalized model algebraically using the split Bregman optimization method and the BiCGSTAB(l) linear solver interchangeably for both CBCT and MDCT data. Rank-sparse kernel regression (RSKR) and patch-based singular value thresholding (pSVT) are used to regularize the energy and time dimensions, respectively. Under a Gaussian noise model, regularization parameters are estimated automatically from the input data, dramatically reducing algorithm complexity for end users. Multi-GPU parallelization of the reconstruction operators is supported to manage reconstruction times. RESULTS Denoising with RSKR and pSVT and post-reconstruction material decomposition are illustrated with preclinical and clinical cardiac photon-counting (PC)CT data. A digital MOBY mouse phantom with cardiac motion is used to illustrate single energy (SE), multi-energy (ME), time resolved (TR), and combined multi-energy and time-resolved (METR) helical, CBCT reconstruction. A fixed set of projection data is used across all reconstruction cases to demonstrate the Toolkit's robustness to increasing data dimensionality. Identical reconstruction code is applied to in vivo cardiac PCCT data acquired in a mouse model of atherosclerosis (METR). Clinical cardiac CT reconstruction is illustrated using the XCAT phantom and the DukeSim CT simulator, while dual-source, dual-energy CT reconstruction is illustrated for data acquired with a Siemens Flash scanner. Benchmarking results with NVIDIA RTX 8000 GPU hardware demonstrate 61%-99% efficiency in scaling computation from one to four GPUs for these reconstruction problems. CONCLUSIONS The MCR Toolkit provides a robust solution for temporal and spectral x-ray CT reconstruction problems and was built from the ground up to facilitate translation of CT research and development between preclinical and clinical applications.
Collapse
Affiliation(s)
- Darin P. Clark
- Quantitative Imaging and Analysis Lab, Department of Radiology, Duke University, Durham, North Carolina, USA
- Center for Virtual Imaging Trials, Carl E. Ravin Advanced Imaging Laboratories, Department of Radiology, Duke University, Durham, North Carolina, USA
| | - Cristian T. Badea
- Quantitative Imaging and Analysis Lab, Department of Radiology, Duke University, Durham, North Carolina, USA
| |
Collapse
|
3
|
Maier J, Nitschke M, Choi JH, Gold G, Fahrig R, Eskofier BM, Maier A. Rigid and Non-Rigid Motion Compensation in Weight-Bearing CBCT of the Knee Using Simulated Inertial Measurements. IEEE Trans Biomed Eng 2022; 69:1608-1619. [PMID: 34714730 PMCID: PMC9134858 DOI: 10.1109/tbme.2021.3123673] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
OBJECTIVE Involuntary subject motion is the main source of artifacts in weight-bearing cone-beam CT of the knee. To achieve image quality for clinical diagnosis, the motion needs to be compensated. We propose to use inertial measurement units (IMUs) attached to the leg for motion estimation. METHODS We perform a simulation study using real motion recorded with an optical tracking system. Three IMU-based correction approaches are evaluated, namely rigid motion correction, non-rigid 2D projection deformation and non-rigid 3D dynamic reconstruction. We present an initialization process based on the system geometry. With an IMU noise simulation, we investigate the applicability of the proposed methods in real applications. RESULTS All proposed IMU-based approaches correct motion at least as good as a state-of-the-art marker-based approach. The structural similarity index and the root mean squared error between motion-free and motion corrected volumes are improved by 24-35% and 78-85%, respectively, compared with the uncorrected case. The noise analysis shows that the noise levels of commercially available IMUs need to be improved by a factor of 105 which is currently only achieved by specialized hardware not robust enough for the application. CONCLUSION Our simulation study confirms the feasibility of this novel approach and defines improvements necessary for a real application. SIGNIFICANCE The presented work lays the foundation for IMU-based motion compensation in cone-beam CT of the knee and creates valuable insights for future developments.
Collapse
|
4
|
Fan F, Kreher B, Keil H, Maier A, Huang Y. Fiducial marker recovery and detection from severely truncated data in navigation assisted spine surgery. Med Phys 2022; 49:2914-2930. [PMID: 35305271 DOI: 10.1002/mp.15617] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2021] [Revised: 02/16/2022] [Accepted: 03/06/2022] [Indexed: 11/11/2022] Open
Abstract
PURPOSE Fiducial markers are commonly used in navigation assisted minimally invasive spine surgery and they help transfer image coordinates into real world coordinates. In practice, these markers might be located outside the field-of-view (FOV) of C-arm cone-beam computed tomography (CBCT) systems used in intraoperative surgeries, due to the limited detector sizes. As a consequence, reconstructed markers in CBCT volumes suffer from artifacts and have distorted shapes, which sets an obstacle for navigation. METHODS In this work, we propose two fiducial marker detection methods: direct detection from distorted markers (direct method) and detection after marker recovery (recovery method). For direct detection from distorted markers in reconstructed volumes, an efficient automatic marker detection method using two neural networks and a conventional circle detection algorithm is proposed. For marker recovery, a task-specific data preparation strategy is proposed to recover markers from severely truncated data. Afterwards, a conventional marker detection algorithm is applied for position detection. The networks in both methods are trained based on simulated data. For the direct method, 6800 images and 10000 images are generated respectively to train the U-Net and ResNet50. For the recovery method, the training set includes 1360 images for FBPConvNet and Pix2pixGAN. The simulated data set with 166 markers and 4 cadaver cases with real fiducials are used for evaluation. RESULTS The two methods are evaluated on simulated data and real cadaver data. The direct method achieves 100% detection rates within 1 mm detection error on simulated data with normal truncation and simulated data with heavier noise, but only detect 94.6% markers in extremely severe truncation case. The recovery method detects all the markers successfully in three test data sets and around 95% markers are detected within 0.5 mm error. For real cadaver data, both methods achieve 100% marker detection rates with mean registration error below 0.2 mm. CONCLUSIONS Our experiments demonstrate that the direct method is capable of detecting distorted markers accurately and the recovery method with the task-specific data preparation strategy has high robustness and generalizability on various data sets. The task-specific data preparation is able to reconstruct structures of interest outside the FOV from severely truncated data better than conventional data preparation. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Fuxin Fan
- Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, 91058, Germany
| | | | - Holger Keil
- Department of Trauma and Orthopedic Surgery, Universitätsklinikum Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, 91054, Germany
| | - Andreas Maier
- Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, 91058, Germany
| | - Yixing Huang
- Department of Radiation Oncology, Universitätsklinikum Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, 91054, Germany
| |
Collapse
|
5
|
Rabbani H, Teyfouri N, Jabbari I. Low-dose cone-beam computed tomography reconstruction through a fast three-dimensional compressed sensing method based on the three-dimensional pseudo-polar fourier transform. JOURNAL OF MEDICAL SIGNALS & SENSORS 2022; 12:8-24. [PMID: 35265461 PMCID: PMC8804585 DOI: 10.4103/jmss.jmss_114_21] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2019] [Revised: 04/24/2021] [Accepted: 08/20/2021] [Indexed: 12/02/2022]
Abstract
Background: Reconstruction of high quality two dimensional images from fan beam computed tomography (CT) with a limited number of projections is already feasible through Fourier based iterative reconstruction method. However, this article is focused on a more complicated reconstruction of three dimensional (3D) images in a sparse view cone beam computed tomography (CBCT) by utilizing Compressive Sensing (CS) based on 3D pseudo polar Fourier transform (PPFT). Method: In comparison with the prevalent Cartesian grid, PPFT re gridding is potent to remove rebinning and interpolation errors. Furthermore, using PPFT based radon transform as the measurement matrix, reduced the computational complexity. Results: In order to show the computational efficiency of the proposed method, we compare it with an algebraic reconstruction technique and a CS type algorithm. We observed convergence in <20 iterations in our algorithm while others would need at least 50 iterations for reconstructing a qualified phantom image. Furthermore, using a fast composite splitting algorithm solver in each iteration makes it a fast CBCT reconstruction algorithm. The algorithm will minimize a linear combination of three terms corresponding to a least square data fitting, Hessian (HS) Penalty and l1 norm wavelet regularization. We named it PP-based compressed sensing-HS-W. In the reconstruction range of 120 projections around the 360° rotation, the image quality is visually similar to reconstructed images by Feldkamp-Davis-Kress algorithm using 720 projections. This represents a high dose reduction. Conclusion: The main achievements of this work are to reduce the radiation dose without degrading the image quality. Its ability in removing the staircase effect, preserving edges and regions with smooth intensity transition, and producing high-resolution, low-noise reconstruction results in low-dose level are also shown.
Collapse
|
6
|
Zavala-Mondragon LA, de With PHN, van der Sommen F. Image Noise Reduction Based on a Fixed Wavelet Frame and CNNs Applied to CT. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2021; 30:9386-9401. [PMID: 34757905 DOI: 10.1109/tip.2021.3125489] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Radiation exposure in CT imaging leads to increased patient risk. This motivates the pursuit of reduced-dose scanning protocols, in which noise reduction processing is indispensable to warrant clinically acceptable image quality. Convolutional Neural Networks (CNNs) have received significant attention as an alternative for conventional noise reduction and are able to achieve state-of-the art results. However, the internal signal processing in such networks is often unknown, leading to sub-optimal network architectures. The need for better signal preservation and more transparency motivates the use of Wavelet Shrinkage Networks (WSNs), in which the Encoding-Decoding (ED) path is the fixed wavelet frame known as Overcomplete Haar Wavelet Transform (OHWT) and the noise reduction stage is data-driven. In this work, we considerably extend the WSN framework by focusing on three main improvements. First, we simplify the computation of the OHWT that can be easily reproduced. Second, we update the architecture of the shrinkage stage by further incorporating knowledge of conventional wavelet shrinkage methods. Finally, we extensively test its performance and generalization, by comparing it with the RED and FBPConvNet CNNs. Our results show that the proposed architecture achieves similar performance to the reference in terms of MSSIM (0.667, 0.662 and 0.657 for DHSN2, FBPConvNet and RED, respectively) and achieves excellent quality when visualizing patches of clinically important structures. Furthermore, we demonstrate the enhanced generalization and further advantages of the signal flow, by showing two additional potential applications, in which the new DHSN2 is used as regularizer: (1) iterative reconstruction and (2) ground-truth free training of the proposed noise reduction architecture. The presented results prove that the tight integration of signal processing and deep learning leads to simpler models with improved generalization.
Collapse
|
7
|
Zhang T, Zhao S, Ma X, Cuadros AP, Zhao Q, Arce GR. Nonlinear reconstruction of coded spectral X-ray CT based on material decomposition. OPTICS EXPRESS 2021; 29:19319-19339. [PMID: 34266043 DOI: 10.1364/oe.426732] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/01/2021] [Accepted: 05/28/2021] [Indexed: 06/13/2023]
Abstract
Coded spectral X-ray computed tomography (CT) based on K-edge filtered illumination is a cost-effective approach to acquire both 3-dimensional structure of objects and their material composition. This approach allows sets of incomplete rays from sparse views or sparse rays with both spatial and spectral encoding to effectively reduce the inspection duration or radiation dose, which is of significance in biological imaging and medical diagnostics. However, reconstruction of spectral CT images from compressed measurements is a nonlinear and ill-posed problem. This paper proposes a material-decomposition-based approach to directly solve the reconstruction problem, without estimating the energy-binned sinograms. This approach assumes that the linear attenuation coefficient map of objects can be decomposed into a few basis materials that are separable in the spectral and space domains. The nonlinear problem is then converted to the reconstruction of the mass density maps of the basis materials. The dimensionality of the optimization variables is thus effectively reduced to overcome the ill-posedness. An alternating minimization scheme is used to solve the reconstruction with regularizations of weighted nuclear norm and total variation. Compared to the state-of-the-art reconstruction method for coded spectral CT, the proposed method can significantly improve the reconstruction quality. It is also capable of reconstructing the spectral CT images at two additional energy bins from the same set of measurements, thus providing more spectral information of the object.
Collapse
|
8
|
Maier J, Maier A, Eskofier B, Fahrig R, Choi JH. 3D Non-Rigid Alignment of Low-Dose Scans Allows to Correct for Saturation in Lower Extremity Cone-Beam CT. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2021; 9:71821-71831. [PMID: 34141516 PMCID: PMC8208599 DOI: 10.1109/access.2021.3079368] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Detector saturation in cone-beam computed tomography occurs when an object of highly varying shape and material composition is imaged using an automatic exposure control (AEC) system. When imaging a subject's knees, high beam energy ensures the visibility of internal structures but leads to overexposure in less dense border regions. In this work, we propose to use an additional low-dose scan to correct the saturation artifacts of AEC scans. Overexposed pixels are identified in the projection images of the AEC scan using histogram-based thresholding. The saturation-free pixels from the AEC scan are combined with the skin border pixels of the low-dose scan prior to volumetric reconstruction. To compensate for patient motion between the two scans, a 3D non-rigid alignment of the projection images in a backward-forward-projection process based on fiducial marker positions is proposed. On numerical simulations, the projection combination improved the structural similarity index measure from 0.883 to 0.999. Further evaluations were performed on two in vivo subject knee acquisitions, one without and one with motion between the AEC and low-dose scans. Saturation-free reference images were acquired using a beam attenuator. The proposed method could qualitatively restore the information of peripheral tissue structures. Applying the 3D non-rigid alignment made it possible to use the projection images with inter-scan subject motion for projection image combination. The increase in radiation exposure due to the additional low-dose scan was found to be negligibly low. The presented methods allow simple but effective correction of saturation artifacts.
Collapse
Affiliation(s)
- Jennifer Maier
- Pattern Recognition Laboratory, Department of Computer Science, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91058 Erlangen, Germany
- Machine Learning and Data Analytics Laboratory, Department of Computer Science, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91052 Erlangen, Germany
| | - Andreas Maier
- Pattern Recognition Laboratory, Department of Computer Science, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91058 Erlangen, Germany
| | - Bjoern Eskofier
- Machine Learning and Data Analytics Laboratory, Department of Computer Science, Friedrich-Alexander-Universität Erlangen-Nürnberg, 91052 Erlangen, Germany
| | | | - Jang-Hwan Choi
- Division of Mechanical and Biomedical Engineering, Graduate Program in System Health Science and Engineering, Ewha Womans University, Seoul 03760, South Korea
| |
Collapse
|
9
|
Regodić M, Bardosi Z, Freysinger W. Automated fiducial marker detection and localization in volumetric computed tomography images: a three-step hybrid approach with deep learning. J Med Imaging (Bellingham) 2021; 8:025002. [PMID: 33937439 PMCID: PMC8080060 DOI: 10.1117/1.jmi.8.2.025002] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2020] [Accepted: 03/31/2021] [Indexed: 11/21/2022] Open
Abstract
Purpose: Automating fiducial detection and localization in the patient’s pre-operative images can lead to better registration accuracy, reduced human errors, and shorter intervention time. Most current approaches are optimized for a single marker type, mainly spherical adhesive markers. A fully automated algorithm is proposed and evaluated for screw and spherical titanium fiducials, typically used in high-accurate frameless surgical navigation. Approach: The algorithm builds on previous approaches with morphological functions and pose estimation algorithms. A 3D convolutional neural network (CNN) is proposed for the fiducial classification task and evaluated for both traditional closed-set and emerging open-set classifiers. A proposed digital ground-truth experiment, with cone-beam computed tomography (CBCT) imaging software, is performed to determine the localization accuracy of the algorithm. The localized fiducial positions in the CBCT images by the presented algorithm were compared to the actual known positions in the virtual phantom models. The difference represents the fiducial localization error (FLE). Results: A total of 241 screws, 151 spherical fiducials, and 1550 other structures are identified with the best true positive rate 95.9% for screw and 99.3% for spherical fiducials at 8.7% and 3.4% false positive rate, respectively. The best achieved FLE mean and its standard deviation for a screw and spherical marker are 58 (14) and 14 (6) μm, respectively. Conclusions: Accurate marker detection and localization were achieved, with spherical fiducials being superior to screws. Large marker volume and smaller voxel size yield significantly smaller FLEs. Attenuating noise by mesh smoothing has a minor effect on FLE. Future work will focus on expanding the CNN for image segmentation.
Collapse
Affiliation(s)
- Milovan Regodić
- Medical University of Innsbruck, Department of Otorhinolaryngology, Innsbruck, Austria.,Medical University of Vienna, Department of Radiation Oncology, Vienna, Austria
| | - Zoltan Bardosi
- Medical University of Innsbruck, Department of Otorhinolaryngology, Innsbruck, Austria
| | - Wolfgang Freysinger
- Medical University of Innsbruck, Department of Otorhinolaryngology, Innsbruck, Austria
| |
Collapse
|
10
|
Geng M, Tian Z, Jiang Z, You Y, Feng X, Xia Y, Yang K, Ren Q, Meng X, Maier A, Lu Y. PMS-GAN: Parallel Multi-Stream Generative Adversarial Network for Multi-Material Decomposition in Spectral Computed Tomography. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:571-584. [PMID: 33064649 DOI: 10.1109/tmi.2020.3031617] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Spectral computed tomography is able to provide quantitative information on the scanned object and enables material decomposition. Traditional projection-based material decomposition methods suffer from the nonlinearity of the imaging system, which limits the decomposition accuracy. Inspired by the generative adversarial network, we proposed a novel parallel multi-stream generative adversarial network (PMS-GAN) to perform projection-based multi-material decomposition in spectral computed tomography. By designing the differential map and incorporating the adversarial network into loss function, the decomposition accuracy was significantly improved with robust performance. The proposed network was quantitatively evaluated by both simulation and experimental study. The results show that PMS-GAN outperformed the reference methods with certain robustness. Compared with Pix2pix-GAN, PMS-GAN increased the structural similarity index by 172% on the contrast agent Ultravist370, 11% on bones, and 71% on bone marrow, respectively, in a simulated test scenario. In an experimental test scenario, 9% and 38% improvements of the structural similarity index on the biopsy needle and on a torso phantom were observed, respectively. The proposed network demonstrates its capability of multi-material decomposition and has certain potential toward clinical applications.
Collapse
|
11
|
The effect of patellofemoral pain syndrome on patellofemoral joint kinematics under upright weight-bearing conditions. PLoS One 2020; 15:e0239907. [PMID: 32997727 PMCID: PMC7526904 DOI: 10.1371/journal.pone.0239907] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2019] [Accepted: 09/15/2020] [Indexed: 12/02/2022] Open
Abstract
Patellofemoral pain (PFP) is commonly caused by abnormal pressure on the knee due to excessive load while standing, squatting, or going up or down stairs. To better understand the pathophysiology of PFP, we conducted a noninvasive patellar tracking study using a C-arm computed tomography (CT) scanner to assess the non-weight-bearing condition at 0° knee flexion (NWB0°) in supine, weight-bearing at 0° (WB0°) when upright, and at 30° (WB30°) in a squat. Three-dimensional (3D) CT images were obtained from patients with PFP (12 women, 6 men; mean age, 31 ± 9 years; mean weight, 68 ± 9 kg) and control subjects (8 women, 10 men; mean age, 39 ± 15 years; mean weight, 71 ± 13 kg). Six 3D-landmarks on the patella and femur were used to establish a joint coordinate system (JCS) and kinematic degrees of freedom (DoF) values on the JCS were obtained: patellar tilt (PT, °), patellar flexion (PF, °), patellar rotation (PR, °), patellar lateral-medial shift (PTx, mm), patellar proximal-distal shift (PTy, mm), and patellar anterior-posterior shift (PTz, mm). Tests for statistical significance (p < 0.05) showed that the PF during WB30°, the PTy during NWB0°, and the PTz during NWB0°, WB0°, and WB30° showed clear differences between the patients with PFP and healthy controls. In particular, the PF during WB30° (17.62°, extension) and the PTz during WB0° (72.50 mm, posterior) had the largest rotational and translational differences (JCS Δ = patients with PFP—controls), respectively. The JCS coordinates with statistically significant difference can serve as key biomarkers of patellar motion when evaluating a patient suspected of having PFP. The proposed method could reveal diagnostic biomarkers for accurately identifying PFP patients and be an effective addition to clinical diagnosis before surgery and to help plan rehabilitation strategies.
Collapse
|
12
|
Stimpel B, Syben C, Schirrmacher F, Hoelter P, Dorfler A, Maier A. Multi-Modal Deep Guided Filtering for Comprehensible Medical Image Processing. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:1703-1711. [PMID: 31765306 DOI: 10.1109/tmi.2019.2955184] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Deep learning-based image processing is capable of creating highly appealing results. However, it is still widely considered as a "blackbox" transformation. In medical imaging, this lack of comprehensibility of the results is a sensitive issue. The integration of known operators into the deep learning environment has proven to be advantageous for the comprehensibility and reliability of the computations. Consequently, we propose the use of the locally linear guided filter in combination with a learned guidance map for general purpose medical image processing. The output images are only processed by the guided filter while the guidance map can be trained to be task-optimal in an end-to-end fashion. We investigate the performance based on two popular tasks: image super resolution and denoising. The evaluation is conducted based on pairs of multi-modal magnetic resonance imaging and cross-modal computed tomography and magnetic resonance imaging datasets. For both tasks, the proposed approach is on par with state-of-the-art approaches. Additionally, we can show that the input image's content is almost unchanged after the processing which is not the case for conventional deep learning approaches. On top, the proposed pipeline offers increased robustness against degraded input as well as adversarial attacks.
Collapse
|
13
|
Stimpel B, Syben C, Würfl T, Breininger K, Hoelter P, Dörfler A, Maier A. Projection-to-Projection Translation for Hybrid X-ray and Magnetic Resonance Imaging. Sci Rep 2019; 9:18814. [PMID: 31827155 PMCID: PMC6906424 DOI: 10.1038/s41598-019-55108-8] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2019] [Accepted: 11/25/2019] [Indexed: 11/09/2022] Open
Abstract
Hybrid X-ray and magnetic resonance (MR) imaging promises large potential in interventional medical imaging applications due to the broad variety of contrast of MRI combined with fast imaging of X-ray-based modalities. To fully utilize the potential of the vast amount of existing image enhancement techniques, the corresponding information from both modalities must be present in the same domain. For image-guided interventional procedures, X-ray fluoroscopy has proven to be the modality of choice. Synthesizing one modality from another in this case is an ill-posed problem due to ambiguous signal and overlapping structures in projective geometry. To take on these challenges, we present a learning-based solution to MR to X-ray projection-to-projection translation. We propose an image generator network that focuses on high representation capacity in higher resolution layers to allow for accurate synthesis of fine details in the projection images. Additionally, a weighting scheme in the loss computation that favors high-frequency structures is proposed to focus on the important details and contours in projection imaging. The proposed extensions prove valuable in generating X-ray projection images with natural appearance. Our approach achieves a deviation from the ground truth of only 6% and structural similarity measure of 0.913 ± 0.005. In particular the high frequency weighting assists in generating projection images with sharp appearance and reduces erroneously synthesized fine details.
Collapse
Affiliation(s)
- Bernhard Stimpel
- Pattern Recognition Lab, Friedrich-Alexander University Erlangen-Nürnberg, Erlangen, Germany.
- Department of Neuroradiology, University Hospital Erlangen, Erlangen, Germany.
| | - Christopher Syben
- Pattern Recognition Lab, Friedrich-Alexander University Erlangen-Nürnberg, Erlangen, Germany
- Department of Neuroradiology, University Hospital Erlangen, Erlangen, Germany
| | - Tobias Würfl
- Pattern Recognition Lab, Friedrich-Alexander University Erlangen-Nürnberg, Erlangen, Germany
| | - Katharina Breininger
- Pattern Recognition Lab, Friedrich-Alexander University Erlangen-Nürnberg, Erlangen, Germany
| | - Philip Hoelter
- Department of Neuroradiology, University Hospital Erlangen, Erlangen, Germany
| | - Arnd Dörfler
- Department of Neuroradiology, University Hospital Erlangen, Erlangen, Germany
| | - Andreas Maier
- Pattern Recognition Lab, Friedrich-Alexander University Erlangen-Nürnberg, Erlangen, Germany
| |
Collapse
|
14
|
Syben C, Michen M, Stimpel B, Seitz S, Ploner S, Maier AK. Technical Note: PYRO-NN: Python reconstruction operators in neural networks. Med Phys 2019; 46:5110-5115. [PMID: 31389023 PMCID: PMC6899669 DOI: 10.1002/mp.13753] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2019] [Revised: 07/23/2019] [Accepted: 07/24/2019] [Indexed: 11/24/2022] Open
Abstract
PURPOSE Recently, several attempts were conducted to transfer deep learning to medical image reconstruction. An increasingly number of publications follow the concept of embedding the computed tomography (CT) reconstruction as a known operator into a neural network. However, most of the approaches presented lack an efficient CT reconstruction framework fully integrated into deep learning environments. As a result, many approaches use workarounds for mathematically unambiguously solvable problems. METHODS PYRO-NN is a generalized framework to embed known operators into the prevalent deep learning framework Tensorflow. The current status includes state-of-the-art parallel-, fan-, and cone-beam projectors, and back-projectors accelerated with CUDA provided as Tensorflow layers. On top, the framework provides a high-level Python API to conduct FBP and iterative reconstruction experiments with data from real CT systems. RESULTS The framework provides all necessary algorithms and tools to design end-to-end neural network pipelines with integrated CT reconstruction algorithms. The high-level Python API allows a simple use of the layers as known from Tensorflow. All algorithms and tools are referenced to a scientific publication and are compared to existing non-deep learning reconstruction frameworks. To demonstrate the capabilities of the layers, the framework comes with baseline experiments, which are described in the supplementary material. The framework is available as open-source software under the Apache 2.0 licence at https://github.com/csyben/PYRO-NN. CONCLUSIONS PYRO-NN comes with the prevalent deep learning framework Tensorflow and allows to setup end-to-end trainable neural networks in the medical image reconstruction context. We believe that the framework will be a step toward reproducible research and give the medical physics community a toolkit to elevate medical image reconstruction with new deep learning techniques.
Collapse
Affiliation(s)
- Christopher Syben
- Pattern Recognition LabFriedich‐Alexander Universität Erlangen‐Nürnberg91058ErlangenGermany
| | - Markus Michen
- Pattern Recognition LabFriedich‐Alexander Universität Erlangen‐Nürnberg91058ErlangenGermany
| | - Bernhard Stimpel
- Pattern Recognition LabFriedich‐Alexander Universität Erlangen‐Nürnberg91058ErlangenGermany
| | - Stephan Seitz
- Pattern Recognition LabFriedich‐Alexander Universität Erlangen‐Nürnberg91058ErlangenGermany
| | - Stefan Ploner
- Pattern Recognition LabFriedich‐Alexander Universität Erlangen‐Nürnberg91058ErlangenGermany
| | - Andreas K. Maier
- Pattern Recognition LabFriedich‐Alexander Universität Erlangen‐Nürnberg91058ErlangenGermany
| |
Collapse
|
15
|
Martínez A, García-Santos A, Ballesteros N, Desco M, Abella M. XAP-Lab: A software tool for designing flexible X-ray acquisition protocols. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2019; 177:243-252. [PMID: 31319953 DOI: 10.1016/j.cmpb.2019.05.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/05/2018] [Revised: 03/15/2019] [Accepted: 05/15/2019] [Indexed: 06/10/2023]
Abstract
BACKGROUND AND OBJECTIVE The availability of digital X-ray detectors, together with the development of new robotized hardware and reconstruction algorithms, opens the opportunity to provide 3D capabilities with conventional radiology systems. This would be based on the acquisition of a limited number of projections with non-standard geometrical configurations. The versatility of these techniques is enormous, enabling the introduction of tomography in situations where a CT system is hardly available, such as during surgery or in an ICU, or in which a reduction of radiation dose is key, as in pediatrics. Computer simulations are a valuable tool to explore these possibilities before their actual implementation on real systems. Existing software tools generally simulate only standard acquisition protocols, such as cone-beam with circular trajectory, thus not allowing the users to evaluate more sophisticated projection geometries. The goal of this work is to design a simulation tool that enables the design of acquisition protocols with flexible projection geometries. METHODS We present XAP-Lab, a software tool for the design of X-ray acquisition protocols with flexible trajectories. For a given projection geometry, defined through a graphical user interface, it allows the user to simulate projections using GPU-accelerated kernels, the visualization of the scanned field of view and the estimation of the total radiation dose. The complete acquisition protocol can then be exported with the appropriate format for its use on real systems. We tested the software by optimizing a tomosynthesis protocol and validating the results with real acquisitions using a SEDECAL NOVA FA radiography system and phantoms for quantitative and qualitative evaluation. RESULTS Quantitative evaluation using a phantom showed a mean error under 4 mm for each position, below the ±5 mm tolerance of the system specified by the manufacturer. Visual evaluation on a thorax acquisition also showed a good geometrical agreement between simulated and real projections. CONCLUSIONS Results showed an excellent matching with simulations, supporting the usefulness of XAP-Lab for the design of new acquisition protocols with non-standard geometries.
Collapse
Affiliation(s)
- A Martínez
- Departamento de Bioingeniería e Ingeniería Aeroespacial, Universidad Carlos III de Madrid, Spain; Instituto de Investigación Sanitaria Gregorio Marañón, Madrid, Spain
| | - A García-Santos
- Departamento de Bioingeniería e Ingeniería Aeroespacial, Universidad Carlos III de Madrid, Spain; Instituto de Investigación Sanitaria Gregorio Marañón, Madrid, Spain
| | - N Ballesteros
- Instituto de Investigación Sanitaria Gregorio Marañón, Madrid, Spain
| | - M Desco
- Departamento de Bioingeniería e Ingeniería Aeroespacial, Universidad Carlos III de Madrid, Spain; Instituto de Investigación Sanitaria Gregorio Marañón, Madrid, Spain; Centro Nacional Investigaciones Cardiovasculares (CNIC), Spain; Centro de investigación en red en salud mental (CIBERSAM), Spain.
| | - M Abella
- Departamento de Bioingeniería e Ingeniería Aeroespacial, Universidad Carlos III de Madrid, Spain; Instituto de Investigación Sanitaria Gregorio Marañón, Madrid, Spain; Centro Nacional Investigaciones Cardiovasculares (CNIC), Spain.
| |
Collapse
|
16
|
Preuhs A, Maier A, Manhart M, Kowarschik M, Hoppe E, Fotouhi J, Navab N, Unberath M. Symmetry prior for epipolar consistency. Int J Comput Assist Radiol Surg 2019; 14:1541-1551. [DOI: 10.1007/s11548-019-02027-8] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2019] [Accepted: 07/03/2019] [Indexed: 10/26/2022]
|
17
|
Cuadros A, Ma X, Arce GR. Compressive spectral X-ray tomography based on spatial and spectral coded illumination. OPTICS EXPRESS 2019; 27:10745-10764. [PMID: 31052928 DOI: 10.1364/oe.27.010745] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/13/2018] [Accepted: 03/22/2019] [Indexed: 06/09/2023]
Abstract
Spectral computed tomography (CT) relies on the spectral dependence of X-ray attenuation coefficients to separate projection measurements into more than two energy bins. Such data can be used to unveil tomographic material characterization - key in national security and medical imaging. This paper explores a radical departure from conventional methods used in spectral imaging. It relies on K-edge coded apertures to create spatially and spectrally coded, lower-dose, X-ray bundles that interrogate specific voxels of the object. The new approach referred to as compressive spectral X-ray imaging (CSXI) uses low-cost standard X-ray integrating detectors and acquires compressive measurements, which enable the reconstruction of energy binned images from fewer measurements. Various spectral and spatial coding strategies for structured illumination are explored. Subsampling in CSXI is accomplished by either view angle spectral subsampling, spatial subsampling enabled by block-unblock coded apertures placed at the source or detector side, or both. The careful design of subsampling strategies, spectral filters, coded apertures, and their placement, are shown to be critical for the quality of tomographic image reconstruction. The forward imaging model of CSXI, which is a non-linear ill-posed problem, is analyzed and a multi-stage algorithm is developed to address the estimation of the energy binned sinograms from the integrating detector measurements. Then, an Alternating Direction Method of Multipliers (ADMM) is used to solve a joint sparse and low-rank optimization problem for reconstruction that exploits the structure of the spectral X-ray data cube.
Collapse
|
18
|
Stromer D, Christlein V, Huang X, Zippert P, Hausotte T, Maier A. Virtual cleaning and unwrapping of non-invasively digitized soiled bamboo scrolls. Sci Rep 2019; 9:2311. [PMID: 30783154 PMCID: PMC6381128 DOI: 10.1038/s41598-019-39447-0] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2018] [Accepted: 01/24/2019] [Indexed: 11/12/2022] Open
Abstract
In ancient China, symbols and drawings captured on bamboo and wooden slips were used as main communication media. Those documents are very precious for cultural heritage and research, but due to aging processes, the discovered pieces are sometimes in a poor condition and contaminated by soil. Manual cleaning of excavated slips is a demanding and time-consuming task in which writings can be accidentally deleted. To counter this, we propose a novel approach based on conventional 3-D X-ray computed tomography to digitize such historical documents without before manual cleaning. By applying a virtual cleaning and unwrapping algorithm, the entire scroll surface is remapped into 2-D such that the hidden content becomes readable. We show that the technique also works for heavily soiled scrolls, enabling an investigation of the content by the naked eye without the need for manual labor. This digitization also allows for recovery of potentially erased writings and reconstruction of the original spatial information.
Collapse
Affiliation(s)
- Daniel Stromer
- Pattern Recognition Lab, Computer Science, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, 91058, Germany.
| | - Vincent Christlein
- Pattern Recognition Lab, Computer Science, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, 91058, Germany
| | - Xiaolin Huang
- Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, Shanghai, 200240, P.R. China
| | - Patrick Zippert
- Institute of Manufacturing Metrology, Mechanical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, 91052, Germany
| | - Tino Hausotte
- Institute of Manufacturing Metrology, Mechanical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, 91052, Germany
| | - Andreas Maier
- Pattern Recognition Lab, Computer Science, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, 91058, Germany
| |
Collapse
|
19
|
Li X, Chen Z, Zhang L, Zhu X, Wang S, Peng W. Quantitative characterization of ex vivo breast tissue via x-ray phase-contrast tomography. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2019; 27:503-516. [PMID: 30958320 DOI: 10.3233/xst-180453] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
BACKGROUND Grating-based X-ray phase-contrast imaging (GPCI) has received growing interests in recent years due to its high capability of visualizing soft tissue. Breast imaging is one of the most promising candidates for the first clinical application of this imaging modality. OBJECTIVE In this work, quantitative breast tissue characterization based on GPCI computed tomography (CT) is investigated with a laboratory X-ray tube through a comparison between attenuation-based CT images and phase-contrast CT images. METHODS The Hounsfield units (HU) scale was introduced to phase-contrast images due to its wide application in clinical medicine. In this work, instead of water, plastic cylinders composed of polyethylene terephthalate (PET) was treated as the calibration material. An alternative test-retest reliability (TRR) was presented to evaluate the repeatability of GPCI. Comparison between attenuation-based CT imaging and GPCI CT imaging was operated with the use of statistical analysis methods like histograms and receiver operating characteristic (ROC) curves. RESULTS The determined mean TRR related to cylinders is slightly larger in phase-contrast imaging (0.93) than that in attenuation-based imaging (0.89). With respect to distinguishing breast tissues, the AUC (area under curve) values of ROC curves of phase-contrast images are higher than that of attenuation-based images. CONCLUSIONS An ex vivo study of GPCI shows that it is a stable imaging modality for visualizing the breast tissue with good repeatability, and that it could be of potential for the diagnosis of breast cancer as well.
Collapse
Affiliation(s)
- Xinbin Li
- Department of Engineering Physics, Tsinghua University, Haidian District, Beijing, China
- Key Laboratory of Particle & Radiation Imaging (Tsinghua University) of Ministry of Education, Haidian District, Beijing, China
| | - Zhiqiang Chen
- Department of Engineering Physics, Tsinghua University, Haidian District, Beijing, China
- Key Laboratory of Particle & Radiation Imaging (Tsinghua University) of Ministry of Education, Haidian District, Beijing, China
| | - Li Zhang
- Department of Engineering Physics, Tsinghua University, Haidian District, Beijing, China
- Key Laboratory of Particle & Radiation Imaging (Tsinghua University) of Ministry of Education, Haidian District, Beijing, China
| | - Xiaohua Zhu
- Department of Engineering Physics, Tsinghua University, Haidian District, Beijing, China
- Key Laboratory of Particle & Radiation Imaging (Tsinghua University) of Ministry of Education, Haidian District, Beijing, China
| | - Shengping Wang
- Fudan University Shanghai Cancer Center, 270 Dongan Road, Xuhui District, Shanghai, China
| | - Weijun Peng
- Fudan University Shanghai Cancer Center, 270 Dongan Road, Xuhui District, Shanghai, China
| |
Collapse
|
20
|
Lu Y, Kowarschik M, Huang X, Xia Y, Choi J, Chen S, Hu S, Ren Q, Fahrig R, Hornegger J, Maier A. A learning‐based material decomposition pipeline for multi‐energy x‐ray imaging. Med Phys 2018; 46:689-703. [DOI: 10.1002/mp.13317] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2018] [Revised: 11/18/2018] [Accepted: 11/22/2018] [Indexed: 12/20/2022] Open
Affiliation(s)
- Yanye Lu
- Pattern Recognition Lab Department of Computer Science Friedrich‐Alexander‐University Erlangen‐Nuremberg 91058 Erlangen Germany
- Advanced Therapies Siemens Healthineers 91301 Forchheim Germany
| | | | - Xiaolin Huang
- Institute of Image Processing and Pattern Recognition Shanghai Jiao Tong University 200240 Shanghai P.R. China
| | - Yan Xia
- Radiological Sciences Lab Stanford University 94305 CA USA
| | - Jang‐Hwan Choi
- Division of Mechanical and Biomedical Engineering Ewha Womans University 03760 Seoul Korea
| | - Shuqing Chen
- Pattern Recognition Lab Department of Computer Science Friedrich‐Alexander‐University Erlangen‐Nuremberg 91058 Erlangen Germany
| | - Shiyang Hu
- Pattern Recognition Lab Department of Computer Science Friedrich‐Alexander‐University Erlangen‐Nuremberg 91058 Erlangen Germany
| | - Qiushi Ren
- Department of Biomedical Engineering Peking University 100871 Beijing China
| | - Rebecca Fahrig
- Pattern Recognition Lab Department of Computer Science Friedrich‐Alexander‐University Erlangen‐Nuremberg 91058 Erlangen Germany
- Advanced Therapies Siemens Healthineers 91301 Forchheim Germany
| | - Joachim Hornegger
- Pattern Recognition Lab Department of Computer Science Friedrich‐Alexander‐University Erlangen‐Nuremberg 91058 Erlangen Germany
| | - Andreas Maier
- Pattern Recognition Lab Department of Computer Science Friedrich‐Alexander‐University Erlangen‐Nuremberg 91058 Erlangen Germany
| |
Collapse
|
21
|
Browsing through sealed historical manuscripts by using 3-D computed tomography with low-brilliance X-ray sources. Sci Rep 2018; 8:15335. [PMID: 30337644 PMCID: PMC6194115 DOI: 10.1038/s41598-018-33685-4] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2018] [Accepted: 10/03/2018] [Indexed: 12/04/2022] Open
Abstract
Severely damaged historical documents are extremely fragile. In many cases, their secrets remain concealed beneath their cover. Recently, non-invasive digitization approaches based on 3-D scanning have demonstrated the ability to recover single pages or letters without the need to open the manuscripts. This can even be achieved using conventional micro-CTs without the need for synchrotron hardware. However, not all manuscripts may be suited for such techniques due to their material and X-ray properties. In order to recommend which manuscripts and which inks are best suited for such a process, we investigate six inks that were commonly used in ancient times: malachite, three types of iron gall, Tyrian purple, and buckthorn. Image contrast is explored over the complete pipeline, from the X-ray CT scan and page extraction to the virtual flattening of the page image. We demonstrate, that all inks containing metallic particles are visible in the output, a decrease of the X-ray energy enhances the readability, and that the visibility highly depends on the X-ray attenuation of the ink’s metallic ingredients and their concentration. Based on these observations, we give recommendations on how to select the appropriate imaging parameters.
Collapse
|
22
|
Abdurahman S, Frysch R, Bismark R, Melnik S, Beuing O, Rose G. Beam Hardening Correction Using Cone Beam Consistency Conditions. IEEE TRANSACTIONS ON MEDICAL IMAGING 2018; 37:2266-2277. [PMID: 29993714 DOI: 10.1109/tmi.2018.2840343] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
The polychromatic X-ray spectrum and the energy-dependent attenuation coefficient of materials cause beam hardening artifacts in CT reconstructed volumes. These artifacts appear as cupping and streak artifacts depending on the material composition and the geometry of the imaged object. CT scanners employ projection linearization to transform polychromatic attenuation to monochromatic attenuation using a polynomial model. Polynomial coefficients are computed during calibration or using prior information such as X-ray spectrum and attenuation properties of the materials. In this paper, we are presenting a novel method to correct beam hardening artifacts by enforcing cone beam consistency conditions on the projection data. We used consistency conditions derived from Grangeat's fundamental relation between cone beam projection data and 3-D Radon transform. The optimal polynomial coefficients for artifact reduction are iteratively estimated by minimizing the inconsistency of a set of projection pairs. The results from simulated and real datasets show the visible reduction of artifacts. Our studies also demonstrate the robustness of the algorithm when the projections are perturbed with other physical measurement and geometrical errors. The proposed method requires neither calibration nor prior information like X-ray spectrum, attenuation properties of the materials and detector response. The algorithm can be used for beam hardening correction in clinical, pre-clinical, and industrial CT systems.
Collapse
|
23
|
Huang Y, Lu Y, Taubmann O, Lauritsch G, Maier A. Traditional machine learning for limited angle tomography. Int J Comput Assist Radiol Surg 2018; 14:11-19. [DOI: 10.1007/s11548-018-1851-2] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2018] [Accepted: 08/15/2018] [Indexed: 10/28/2022]
|
24
|
Huang Y, Taubmann O, Huang X, Haase V, Lauritsch G, Maier A. Scale-Space Anisotropic Total Variation for Limited Angle Tomography. IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES 2018. [DOI: 10.1109/trpms.2018.2824400] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
25
|
Schirrmacher F, Köhler T, Endres J, Lindenberger T, Husvogt L, Fujimoto JG, Hornegger J, Dörfler A, Hoelter P, Maier AK. Temporal and volumetric denoising via quantile sparse image prior. Med Image Anal 2018; 48:131-146. [PMID: 29913433 DOI: 10.1016/j.media.2018.06.002] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2018] [Revised: 05/09/2018] [Accepted: 06/01/2018] [Indexed: 10/14/2022]
Abstract
This paper introduces an universal and structure-preserving regularization term, called quantile sparse image (QuaSI) prior. The prior is suitable for denoising images from various medical imaging modalities. We demonstrate its effectiveness on volumetric optical coherence tomography (OCT) and computed tomography (CT) data, which show different noise and image characteristics. OCT offers high-resolution scans of the human retina but is inherently impaired by speckle noise. CT on the other hand has a lower resolution and shows high-frequency noise. For the purpose of denoising, we propose a variational framework based on the QuaSI prior and a Huber data fidelity model that can handle 3-D and 3-D+t data. Efficient optimization is facilitated through the use of an alternating direction method of multipliers (ADMM) scheme and the linearization of the quantile filter. Experiments on multiple datasets emphasize the excellent performance of the proposed method.
Collapse
Affiliation(s)
| | - Thomas Köhler
- Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany; e.solutions GmbH, Erlangen, Germany
| | - Jürgen Endres
- Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany; Department of Neuroradiology, Universitätsklinikum Erlangen, Germany
| | - Tobias Lindenberger
- Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
| | - Lennart Husvogt
- Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
| | - James G Fujimoto
- Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, USA
| | - Joachim Hornegger
- Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
| | - Arnd Dörfler
- Department of Neuroradiology, Universitätsklinikum Erlangen, Germany
| | - Philip Hoelter
- Department of Neuroradiology, Universitätsklinikum Erlangen, Germany
| | - Andreas K Maier
- Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
| |
Collapse
|
26
|
Lu Y, Kowarschik M, Huang X, Chen S, Ren Q, Fahrig R, Hornegger J, Maier A. Material Decomposition Using Ensemble Learning for Spectral X-ray Imaging. IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES 2018. [DOI: 10.1109/trpms.2018.2805328] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
27
|
|
28
|
Diagnosis of breast cancer based on microcalcifications using grating-based phase contrast CT. Eur Radiol 2018; 28:3742-3750. [DOI: 10.1007/s00330-017-5158-4] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2017] [Revised: 10/19/2017] [Accepted: 10/26/2017] [Indexed: 10/18/2022]
|
29
|
Range Imaging for Motion Compensation in C-Arm Cone-Beam CT of Knees under Weight-Bearing Conditions. J Imaging 2018. [DOI: 10.3390/jimaging4010013] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
|
30
|
Ahmad M, Fahrig R, Pung L, Spahn M, Köster NS, Reitz S, Moore T, Choi JH, Hinshaw W, Xia Y, Müller K. Assessment of a photon-counting detector for a dual-energy C-arm angiographic system. Med Phys 2017; 44:5938-5948. [DOI: 10.1002/mp.12517] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2016] [Revised: 06/18/2017] [Accepted: 08/05/2017] [Indexed: 11/08/2022] Open
Affiliation(s)
- Moiz Ahmad
- The University of Texas McGovern Medical School; Houston TX USA
| | - Rebecca Fahrig
- Radiological Sciences Lab; Stanford University; Stanford CA USA
- Siemens Healthcare GmbH; Forchheim Germany
| | - Leland Pung
- Siemens Medical Solutions Inc.; Malvern PA USA
| | | | | | | | - Teri Moore
- Siemens Medical Solutions Inc.; Malvern PA USA
| | - Jang-Hwan Choi
- Radiological Sciences Lab; Stanford University; Stanford CA USA
- Division of Mechanical and Biomedical Engineering; Ewha Womans University; Seoul South Korea
| | - Waldo Hinshaw
- Radiological Sciences Lab; Stanford University; Stanford CA USA
| | - Yan Xia
- Radiological Sciences Lab; Stanford University; Stanford CA USA
| | - Kerstin Müller
- Radiological Sciences Lab; Stanford University; Stanford CA USA
- Siemens Healthcare GmbH; Forchheim Germany
| |
Collapse
|
31
|
Kaeppler S, Rieger J, Pelzer G, Horn F, Michel T, Maier A, Anton G, Riess C. Improved reconstruction of phase-stepping data for Talbot-Lau x-ray imaging. J Med Imaging (Bellingham) 2017; 4:034005. [PMID: 28894764 DOI: 10.1117/1.jmi.4.3.034005] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2017] [Accepted: 08/09/2017] [Indexed: 11/14/2022] Open
Abstract
Grating-based Talbot-Lau x-ray interferometry is a popular method for measuring absorption, phase shift, and small-angle scattering. The standard acquisition method for this modality is phase stepping, where the Talbot pattern is reconstructed from multiple images acquired at different grating positions. We review the implicit assumptions in phase-stepping reconstruction, and find that the assumptions of perfectly known grating positions and homoscedastic noise variance are violated in some scenarios. Additionally, we investigate a recently reported estimation bias in the visibility and dark-field signal. To adapt the phase-stepping reconstruction to these findings, we propose three improvements to the reconstruction. These improvements are (a) to use prior knowledge to compute more accurate grating positions to reduce moiré artifacts, (b) to utilize noise variance information to reduce dark-field and phase noise in high-visibility acquisitions, and (c) to perform correction of an estimation bias in the interferometer visibility, leading to more quantitative dark-field imaging in acquisitions with a low signal-to-noise ratio. We demonstrate the benefit of our methods on simulated data, as well as on images acquired with a Talbot-Lau interferometer.
Collapse
Affiliation(s)
- Sebastian Kaeppler
- Friedrich-Alexander-University Erlangen-Nuremberg, Pattern Recognition Lab, Department of Computer Science, Erlangen, Germany
| | - Jens Rieger
- Friedrich-Alexander-University Erlangen-Nuremberg, Erlangen Centre for Astroparticle Physics, Department of Physics, Erlangen, Germany
| | - Georg Pelzer
- Friedrich-Alexander-University Erlangen-Nuremberg, Erlangen Centre for Astroparticle Physics, Department of Physics, Erlangen, Germany
| | - Florian Horn
- Friedrich-Alexander-University Erlangen-Nuremberg, Erlangen Centre for Astroparticle Physics, Department of Physics, Erlangen, Germany
| | - Thilo Michel
- Friedrich-Alexander-University Erlangen-Nuremberg, Erlangen Centre for Astroparticle Physics, Department of Physics, Erlangen, Germany
| | - Andreas Maier
- Friedrich-Alexander-University Erlangen-Nuremberg, Pattern Recognition Lab, Department of Computer Science, Erlangen, Germany
| | - Gisela Anton
- Friedrich-Alexander-University Erlangen-Nuremberg, Erlangen Centre for Astroparticle Physics, Department of Physics, Erlangen, Germany
| | - Christian Riess
- Friedrich-Alexander-University Erlangen-Nuremberg, Pattern Recognition Lab, Department of Computer Science, Erlangen, Germany
| |
Collapse
|
32
|
A review of GPU-based medical image reconstruction. Phys Med 2017; 42:76-92. [PMID: 29173924 DOI: 10.1016/j.ejmp.2017.07.024] [Citation(s) in RCA: 45] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/10/2017] [Revised: 07/06/2017] [Accepted: 07/30/2017] [Indexed: 11/20/2022] Open
Abstract
Tomographic image reconstruction is a computationally demanding task, even more so when advanced models are used to describe a more complete and accurate picture of the image formation process. Such advanced modeling and reconstruction algorithms can lead to better images, often with less dose, but at the price of long calculation times that are hardly compatible with clinical workflows. Fortunately, reconstruction tasks can often be executed advantageously on Graphics Processing Units (GPUs), which are exploited as massively parallel computational engines. This review paper focuses on recent developments made in GPU-based medical image reconstruction, from a CT, PET, SPECT, MRI and US perspective. Strategies and approaches to get the most out of GPUs in image reconstruction are presented as well as innovative applications arising from an increased computing capacity. The future of GPU-based image reconstruction is also envisioned, based on current trends in high-performance computing.
Collapse
|
33
|
Abella M, Serrano E, Garcia- Blas J, García I, de Molina C, Carretero J, Desco M. FUX-Sim: Implementation of a fast universal simulation/reconstruction framework for X-ray systems. PLoS One 2017; 12:e0180363. [PMID: 28692677 PMCID: PMC5503257 DOI: 10.1371/journal.pone.0180363] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2017] [Accepted: 06/14/2017] [Indexed: 11/18/2022] Open
Abstract
The availability of digital X-ray detectors, together with advances in reconstruction algorithms, creates an opportunity for bringing 3D capabilities to conventional radiology systems. The downside is that reconstruction algorithms for non-standard acquisition protocols are generally based on iterative approaches that involve a high computational burden. The development of new flexible X-ray systems could benefit from computer simulations, which may enable performance to be checked before expensive real systems are implemented. The development of simulation/reconstruction algorithms in this context poses three main difficulties. First, the algorithms deal with large data volumes and are computationally expensive, thus leading to the need for hardware and software optimizations. Second, these optimizations are limited by the high flexibility required to explore new scanning geometries, including fully configurable positioning of source and detector elements. And third, the evolution of the various hardware setups increases the effort required for maintaining and adapting the implementations to current and future programming models. Previous works lack support for completely flexible geometries and/or compatibility with multiple programming models and platforms. In this paper, we present FUX-Sim, a novel X-ray simulation/reconstruction framework that was designed to be flexible and fast. Optimized implementation for different families of GPUs (CUDA and OpenCL) and multi-core CPUs was achieved thanks to a modularized approach based on a layered architecture and parallel implementation of the algorithms for both architectures. A detailed performance evaluation demonstrates that for different system configurations and hardware platforms, FUX-Sim maximizes performance with the CUDA programming model (5 times faster than other state-of-the-art implementations). Furthermore, the CPU and OpenCL programming models allow FUX-Sim to be executed over a wide range of hardware platforms.
Collapse
Affiliation(s)
- Monica Abella
- Dept. Bioingeniería e Ingeniería Aeroespacial, Universidad Carlos III de Madrid, Madrid, Spain
- Instituto de Investigación Sanitaria Gregorio Marañón, Madrid, Spain
- * E-mail:
| | - Estefania Serrano
- Instituto de Investigación Sanitaria Gregorio Marañón, Madrid, Spain
- Computer Science and Engineering Dept., Universidad Carlos III de Madrid, Madrid, Spain
| | - Javier Garcia- Blas
- Instituto de Investigación Sanitaria Gregorio Marañón, Madrid, Spain
- Computer Science and Engineering Dept., Universidad Carlos III de Madrid, Madrid, Spain
| | - Ines García
- Instituto de Investigación Sanitaria Gregorio Marañón, Madrid, Spain
| | - Claudia de Molina
- Dept. Bioingeniería e Ingeniería Aeroespacial, Universidad Carlos III de Madrid, Madrid, Spain
- Instituto de Investigación Sanitaria Gregorio Marañón, Madrid, Spain
| | - Jesus Carretero
- Instituto de Investigación Sanitaria Gregorio Marañón, Madrid, Spain
- Computer Science and Engineering Dept., Universidad Carlos III de Madrid, Madrid, Spain
| | - Manuel Desco
- Dept. Bioingeniería e Ingeniería Aeroespacial, Universidad Carlos III de Madrid, Madrid, Spain
- Instituto de Investigación Sanitaria Gregorio Marañón, Madrid, Spain
- Centro de Investigación Biomédica en red de Salud Mental (CIBERSAM), Madrid, Spain
| |
Collapse
|
34
|
Huang Y, Huang X, Taubmann O, Xia Y, Haase V, Hornegger J, Lauritsch G, Maier A. Restoration of missing data in limited angle tomography based on Helgason–Ludwig consistency conditions. Biomed Phys Eng Express 2017. [DOI: 10.1088/2057-1976/aa71bf] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
|
35
|
Taubmann O, Haase V, Lauritsch G, Zheng Y, Krings G, Hornegger J, Maier A. Assessing cardiac function from total-variation-regularized 4D C-arm CT in the presence of angular undersampling. Phys Med Biol 2017; 62:2762-2777. [PMID: 28225355 DOI: 10.1088/1361-6560/aa6241] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Time-resolved tomographic cardiac imaging using an angiographic C-arm device may support clinicians during minimally invasive therapy by enabling a thorough analysis of the heart function directly in the catheter laboratory. However, clinically feasible acquisition protocols entail a highly challenging reconstruction problem which suffers from sparse angular sampling of the trajectory. Compressed sensing theory promises that useful images can be recovered despite massive undersampling by means of sparsity-based regularization. For a multitude of reasons-most notably the desired reduction of scan time, dose and contrast agent required-it is of great interest to know just how little data is actually sufficient for a certain task. In this work, we apply a convex optimization approach based on primal-dual splitting to 4D cardiac C-arm computed tomography. We examine how the quality of spatially and temporally total-variation-regularized reconstruction degrades when using as few as [Formula: see text] projection views per heart phase. First, feasible regularization weights are determined in a numerical phantom study, demonstrating the individual benefits of both regularizers. Secondly, a task-based evaluation is performed in eight clinical patients. Semi-automatic segmentation-based volume measurements of the left ventricular blood pool performed on strongly undersampled images show a correlation of close to 99% with measurements obtained from less sparsely sampled data.
Collapse
Affiliation(s)
- O Taubmann
- Pattern Recognition Lab, Friedrich-Alexander-University Erlangen-Nuremberg, Germany. Erlangen Graduate School in Advanced Optical Technologies (SAOT), Germany
| | | | | | | | | | | | | |
Collapse
|
36
|
Bier B, Berger M, Maier A, Kachelrieß M, Ritschl L, Müller K, Choi JH, Fahrig R. Scatter correction using a primary modulator on a clinical angiography C-arm CT system. Med Phys 2017; 44:e125-e137. [DOI: 10.1002/mp.12094] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2016] [Revised: 11/09/2016] [Accepted: 01/02/2017] [Indexed: 01/12/2023] Open
Affiliation(s)
- Bastian Bier
- Pattern Recognition Lab; Friedrich-Alexander-University Erlangen-Nuremberg; Erlangen Germany
| | - Martin Berger
- Pattern Recognition Lab; Friedrich-Alexander-University Erlangen-Nuremberg; Erlangen Germany
| | - Andreas Maier
- Pattern Recognition Lab; Friedrich-Alexander-University Erlangen-Nuremberg; Erlangen Germany
| | - Marc Kachelrieß
- Medical Physics in Radiology; German Cancer Research Center (DKFZ); Heidelberg Germany
| | | | - Kerstin Müller
- Radiological Sciences Lab; Stanford University; Stanford CA USA
| | - Jang-Hwan Choi
- Radiological Sciences Lab; Stanford University; Stanford CA USA
| | - Rebecca Fahrig
- Radiological Sciences Lab; Stanford University; Stanford CA USA
| |
Collapse
|
37
|
Hoffman J, Young S, Noo F, McNitt-Gray M. Technical Note: FreeCT_wFBP: A robust, efficient, open-source implementation of weighted filtered backprojection for helical, fan-beam CT. Med Phys 2016; 43:1411-20. [PMID: 26936725 DOI: 10.1118/1.4941953] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2023] Open
Abstract
PURPOSE With growing interest in quantitative imaging, radiomics, and CAD using CT imaging, the need to explore the impacts of acquisition and reconstruction parameters has grown. This usually requires extensive access to the scanner on which the data were acquired and its workflow is not designed for large-scale reconstruction projects. Therefore, the authors have developed a freely available, open-source software package implementing a common reconstruction method, weighted filtered backprojection (wFBP), for helical fan-beam CT applications. METHODS FreeCT_wFBP is a low-dependency, GPU-based reconstruction program utilizing c for the host code and Nvidia CUDA C for GPU code. The software is capable of reconstructing helical scans acquired with arbitrary pitch-values, and sampling techniques such as flying focal spots and a quarter-detector offset. In this work, the software has been described and evaluated for reconstruction speed, image quality, and accuracy. Speed was evaluated based on acquisitions of the ACR CT accreditation phantom under four different flying focal spot configurations. Image quality was assessed using the same phantom by evaluating CT number accuracy, uniformity, and contrast to noise ratio (CNR). Finally, reconstructed mass-attenuation coefficient accuracy was evaluated using a simulated scan of a FORBILD thorax phantom and comparing reconstructed values to the known phantom values. RESULTS The average reconstruction time evaluated under all flying focal spot configurations was found to be 17.4 ± 1.0 s for a 512 row × 512 column × 32 slice volume. Reconstructions of the ACR phantom were found to meet all CT Accreditation Program criteria including CT number, CNR, and uniformity tests. Finally, reconstructed mass-attenuation coefficient values of water within the FORBILD thorax phantom agreed with original phantom values to within 0.0001 mm(2)/g (0.01%). CONCLUSIONS FreeCT_wFBP is a fast, highly configurable reconstruction package for third-generation CT available under the GNU GPL. It shows good performance with both clinical and simulated data.
Collapse
Affiliation(s)
- John Hoffman
- Departments of Biomedical Physics and Radiology, David Geffen School of Medicine at UCLA, Los Angeles, California 90024
| | - Stefano Young
- Department of Radiology, David Geffen School of Medicine at UCLA, Los Angeles, California 90024
| | - Frédéric Noo
- Department of Radiology, University of Utah, Salt Lake City, Utah 84112
| | - Michael McNitt-Gray
- Departments of Biomedical Physics and Radiology, David Geffen School of Medicine at UCLA, Los Angeles, California 90024
| |
Collapse
|
38
|
Berger M, Müller K, Aichert A, Unberath M, Thies J, Choi JH, Fahrig R, Maier A. Marker-free motion correction in weight-bearing cone-beam CT of the knee joint. Med Phys 2016; 43:1235-48. [PMID: 26936708 DOI: 10.1118/1.4941012] [Citation(s) in RCA: 32] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
PURPOSE To allow for a purely image-based motion estimation and compensation in weight-bearing cone-beam computed tomography of the knee joint. METHODS Weight-bearing imaging of the knee joint in a standing position poses additional requirements for the image reconstruction algorithm. In contrast to supine scans, patient motion needs to be estimated and compensated. The authors propose a method that is based on 2D/3D registration of left and right femur and tibia segmented from a prior, motion-free reconstruction acquired in supine position. Each segmented bone is first roughly aligned to the motion-corrupted reconstruction of a scan in standing or squatting position. Subsequently, a rigid 2D/3D registration is performed for each bone to each of K projection images, estimating 6 × 4 × K motion parameters. The motion of individual bones is combined into global motion fields using thin-plate-spline extrapolation. These can be incorporated into a motion-compensated reconstruction in the backprojection step. The authors performed visual and quantitative comparisons between a state-of-the-art marker-based (MB) method and two variants of the proposed method using gradient correlation (GC) and normalized gradient information (NGI) as similarity measure for the 2D/3D registration. RESULTS The authors evaluated their method on four acquisitions under different squatting positions of the same patient. All methods showed substantial improvement in image quality compared to the uncorrected reconstructions. Compared to NGI and MB, the GC method showed increased streaking artifacts due to misregistrations in lateral projection images. NGI and MB showed comparable image quality at the bone regions. Because the markers are attached to the skin, the MB method performed better at the surface of the legs where the authors observed slight streaking of the NGI and GC methods. For a quantitative evaluation, the authors computed the universal quality index (UQI) for all bone regions with respect to the motion-free reconstruction. The authors quantitative evaluation over regions around the bones yielded a mean UQI of 18.4 for no correction, 53.3 and 56.1 for the proposed method using GC and NGI, respectively, and 53.7 for the MB reference approach. In contrast to the authors registration-based corrections, the MB reference method caused slight nonrigid deformations at bone outlines when compared to a motion-free reference scan. CONCLUSIONS The authors showed that their method based on the NGI similarity measure yields reconstruction quality close to the MB reference method. In contrast to the MB method, the proposed method does not require any preparation prior to the examination which will improve the clinical workflow and patient comfort. Further, the authors found that the MB method causes small, nonrigid deformations at the bone outline which indicates that markers may not accurately reflect the internal motion close to the knee joint. Therefore, the authors believe that the proposed method is a promising alternative to MB motion management.
Collapse
Affiliation(s)
- M Berger
- Pattern Recognition Lab, Friedrich-Alexander-University Erlangen-Nuremberg, 91058 Erlangen, Germany
| | - K Müller
- Radiological Sciences Laboratory, Stanford University, Stanford, California 94305
| | - A Aichert
- Pattern Recognition Lab, Friedrich-Alexander-University Erlangen-Nuremberg, 91058 Erlangen, Germany
| | - M Unberath
- Pattern Recognition Lab, Friedrich-Alexander-University Erlangen-Nuremberg, 91058 Erlangen, Germany
| | - J Thies
- Computer Graphics Lab, Friedrich-Alexander-University Erlangen-Nuremberg, 91058 Erlangen, Germany
| | - J-H Choi
- Radiological Sciences Laboratory, Stanford University, Stanford, California 94305
| | - R Fahrig
- Radiological Sciences Laboratory, Stanford University, Stanford, California 94305
| | - A Maier
- Pattern Recognition Lab, Friedrich-Alexander-University Erlangen-Nuremberg, 91058 Erlangen, Germany
| |
Collapse
|
39
|
Taubmann O, Maier A, Hornegger J, Lauritsch G, Fahrig R. Coping with real world data: Artifact reduction and denoising for motion-compensated cardiac C-arm CT. Med Phys 2016; 43:883-93. [PMID: 26843249 DOI: 10.1118/1.4939878] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
PURPOSE Detailed analysis of cardiac motion would be helpful for supporting clinical workflow in the interventional suite. With an angiographic C-arm system, multiple heart phases can be reconstructed using electrocardiogram gating. However, the resulting angular undersampling is highly detrimental to the quality of the reconstructed images, especially in nonideal intraprocedural imaging conditions. Motion-compensated reconstruction has previously been shown to alleviate this problem, but it heavily relies on a preliminary reconstruction suitable for motion estimation. In this work, the authors propose a processing pipeline tailored to augment these initial images for the purpose of motion estimation and assess how it affects the final images after motion compensation. METHODS The following combination of simple, direct methods inspired by the core ideas of existing approaches proved beneficial: (a) Streak reduction by masking high-intensity components in projection domain after filtering. (b) Streak reduction by subtraction of estimated artifact volumes in reconstruction domain. (c) Denoising in spatial domain using a joint bilateral filter guided by an uncompensated reconstruction. (d) Denoising in temporal domain using an adaptive Gaussian smoothing based on a novel motion detection scheme. RESULTS Experiments on a numerical heart phantom yield a reduction of the relative root-mean-square error from 89.9% to 3.6% and an increase of correlation with the ground truth from 95.763% to 99.995% for the motion-compensated reconstruction when the authors' processing is applied to the initial images. In three clinical patient data sets, the signal-to-noise ratio measured in an ideally homogeneous region is increased by 37.7% on average. Overall visual appearance is improved notably and some anatomical features are more readily discernible. CONCLUSIONS The authors' findings suggest that the proposed sequence of steps provides a clear advantage over an arbitrary sequence of individual image enhancement methods and is fit to overcome the issue of lacking image quality in motion-compensated C-arm imaging of the heart. As for future work, the obtained results pave the way for investigating how accurately cardiac functional motion parameters can be determined with this modality.
Collapse
Affiliation(s)
- Oliver Taubmann
- Pattern Recognition Lab, Computer Science Department, Friedrich-Alexander-University Erlangen-Nuremberg, 91058 Erlangen, Germany and Erlangen Graduate School in Advanced Optical Technologies (SAOT), 91052 Erlangen, Germany
| | - Andreas Maier
- Pattern Recognition Lab, Computer Science Department, Friedrich-Alexander-University Erlangen-Nuremberg, 91058 Erlangen, Germany and Erlangen Graduate School in Advanced Optical Technologies (SAOT), 91052 Erlangen, Germany
| | - Joachim Hornegger
- Pattern Recognition Lab, Computer Science Department, Friedrich-Alexander-University Erlangen-Nuremberg, 91058 Erlangen, Germany and Erlangen Graduate School in Advanced Optical Technologies (SAOT), 91052 Erlangen, Germany
| | | | - Rebecca Fahrig
- Radiological Sciences Laboratory, Stanford University, Stanford, California 94305 and Siemens Healthcare GmbH, 91301 Forchheim, Germany
| |
Collapse
|
40
|
Kinect-Based Correction of Overexposure Artifacts in Knee Imaging with C-Arm CT Systems. Int J Biomed Imaging 2016; 2016:2502486. [PMID: 27516772 PMCID: PMC4969567 DOI: 10.1155/2016/2502486] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2016] [Accepted: 06/13/2016] [Indexed: 11/17/2022] Open
Abstract
Objective. To demonstrate a novel approach of compensating overexposure artifacts in CT scans of the knees without attaching any supporting appliances to the patient. C-Arm CT systems offer the opportunity to perform weight-bearing knee scans on standing patients to diagnose diseases like osteoarthritis. However, one serious issue is overexposure of the detector in regions close to the patella, which can not be tackled with common techniques. Methods. A Kinect camera is used to algorithmically remove overexposure artifacts close to the knee surface. Overexposed near-surface knee regions are corrected by extrapolating the absorption values from more reliable projection data. To achieve this, we develop a cross-calibration procedure to transform surface points from the Kinect to CT voxel coordinates. Results. Artifacts at both knee phantoms are reduced significantly in the reconstructed data and a major part of the truncated regions is restored. Conclusion. The results emphasize the feasibility of the proposed approach. The accuracy of the cross-calibration procedure can be increased to further improve correction results. Significance. The correction method can be extended to a multi-Kinect setup for use in real-world scenarios. Using depth cameras does not require prior scans and offers the possibility of a temporally synchronized correction of overexposure artifacts. To achieve this, we develop a cross-calibration procedure to transform surface points from the Kinect to CT voxel coordinates.
Collapse
|
41
|
Estimating FLEimage distributions of manual fiducial localization in CT images. Int J Comput Assist Radiol Surg 2016; 11:1043-9. [PMID: 27025605 PMCID: PMC4893364 DOI: 10.1007/s11548-016-1389-0] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2016] [Accepted: 03/15/2016] [Indexed: 12/02/2022]
Abstract
Purpose The fiducial localization error distribution (FLE) and fiducial configuration govern the application accuracy of point-based registration and drive target registration error (TRE) prediction models. The error of physically localizing patient fiducials (\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$${\hbox {FLE}}_\mathrm{patient}$$\end{document}FLEpatient) is negligible when a registration probe matches the implanted screws with mechanical precision. Reliable trackers provide an unbiased estimate of the positional error (\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$${\hbox {FLE}}_\mathrm{tracker}$$\end{document}FLEtracker) with cheap repetitions. FLE further contains the localization error in the imaging data (\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$${\hbox {FLE}}_\mathrm{image}$$\end{document}FLEimage), sampling of which in general is expensive and possibly biased. Finding the best techniques for estimating \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$${\hbox {FLE}}_\mathrm{image}$$\end{document}FLEimage is crucial for the applicability of the TRE prediction methods. Methods We built a ground-truth (gt)-based unbiased estimator (\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\widehat{{\hbox {FLE}}_\mathrm{gt}}$$\end{document}FLEgt^) of \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$${\hbox {FLE}}_\mathrm{image}$$\end{document}FLEimage from the samples collected in a virtual CT dataset in which the true locations of image fiducials are known by definition. Replacing true locations in \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$${\hbox {FLE}}_\mathrm{gt}$$\end{document}FLEgt by the sample mean creates a practical difference-to-mean (dtm)-based estimator (\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\widehat{{\hbox {FLE}}_\mathrm{dtm}}$$\end{document}FLEdtm^) that is applicable on any dataset. To check the practical validity of the dtm estimator, ten persons manually localized nine fiducials ten times in the virtual CT and the resulting \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$${\hbox {FLE}}_\mathrm{dtm}$$\end{document}FLEdtm and \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$${\hbox {FLE}}_\mathrm{gt}$$\end{document}FLEgt distributions were tested for statistical equality with a kernel-based two-sample test using the maximum mean discrepancy (MMD) (Gretton in J Mach Learn Res 13:723–773, 2012) statistics at \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\alpha =0.05$$\end{document}α=0.05. Results \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$${\hbox {FLE}}_\mathrm{dtm}$$\end{document}FLEdtm and \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$${\hbox {FLE}}_\mathrm{gt}$$\end{document}FLEgt were found (for most of the cases) not to be statistically significantly different; conditioning them on persons and/or screws however yielded statistically significant differences much more often. Conclusions We conclude that \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\widehat{{\hbox {FLE}}_\mathrm{dtm}}$$\end{document}FLEdtm^ is the best candidate (within our model) for estimating \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$${\hbox {FLE}}_\mathrm{image}$$\end{document}FLEimage in homogeneous TRE prediction models. The presented approach also allows ground-truth-based numerical validation of \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$${\hbox {FLE}}_\mathrm{image}$$\end{document}FLEimage estimators and (manual/automatic) image fiducial localization methods in phantoms with parameters similar to clinical datasets.
Collapse
|
42
|
|
43
|
Herbst M, Schebesch F, Berger M, Choi JH, Fahrig R, Hornegger J, Maier A. Dynamic detector offsets for field of view extension in C-arm computed tomography with application to weight-bearing imaging. Med Phys 2015; 42:2718-29. [PMID: 25979070 DOI: 10.1118/1.4915542] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
PURPOSE In C-arm computed tomography (CT), the field of view (FOV) is often not sufficient to acquire certain anatomical structures, e.g., a full hip or thorax. Proposed methods to extend the FOV use a fixed detector displacement and a 360° scan range to double the radius of the FOV. These trajectories are designed for circular FOVs. However, there are cases in which the required FOV is not circular but rather an ellipsoid. METHODS In this work, the authors show that in fan-beam CT, the use of a dynamically adjusting detector offset can reduce the required scan range when using a noncircular FOV. Furthermore, the authors present an analytic solution to determine the minimal required scan ranges for elliptic FOVs given a certain detector size and an algorithmic approach for arbitrary FOVs. RESULTS The authors show that the proposed method can result in a substantial reduction of the required scan range. Initial reconstructions of data sets acquired with our new minimal trajectory yielded image quality comparable to reconstructions of data acquired using a fixed detector offset and a full 360° rotation. CONCLUSIONS Our results show a promising reduction of the necessary scan range especially for ellipsoidal objects that extend the FOV. In noncircular FOVs, there exists a set of solutions that allow a trade-off between detector size and scan range.
Collapse
Affiliation(s)
- Magdalena Herbst
- Pattern Recognition Lab, Department of Computer Science, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen 91058, Germany
| | - Frank Schebesch
- Pattern Recognition Lab, Department of Computer Science, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen 91058, Germany
| | - Martin Berger
- Pattern Recognition Lab, Department of Computer Science, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen 91058, Germany
| | - Jang-Hwan Choi
- Department of Radiology, Stanford University, Stanford, California 94305
| | - Rebecca Fahrig
- Department of Radiology, Stanford University, Stanford, California 94305
| | - Joachim Hornegger
- Pattern Recognition Lab, Department of Computer Science, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen 91058, Germany Erlangen Graduate School in Advanced Optical Technologies (SAOT), Erlangen 91058, Germany
| | - Andreas Maier
- Pattern Recognition Lab, Department of Computer Science, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen 91058, Germany Erlangen Graduate School in Advanced Optical Technologies (SAOT), Erlangen 91058, Germany
| |
Collapse
|
44
|
Choi JH, Maier A, Keil A, Pal S, McWalter EJ, Beaupré GS, Gold GE, Fahrig R. Fiducial marker-based correction for involuntary motion in weight-bearing C-arm CT scanning of knees. II. Experiment. Med Phys 2015; 41:061902. [PMID: 24877813 DOI: 10.1118/1.4873675] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022] Open
Abstract
PURPOSE A C-arm CT system has been shown to be capable of scanning a single cadaver leg under loaded conditions by virtue of its highly flexible acquisition trajectories. In Part I of this study, using the 4D XCAT-based numerical simulation, the authors predicted that the involuntary motion in the lower body of subjects in weight-bearing positions would seriously degrade image quality and the authors suggested three motion compensation methods by which the reconstructions could be corrected to provide diagnostic image quality. Here, the authors demonstrate that a flat-panel angiography system is appropriate for scanning both legs of subjects in vivo under weight-bearing conditions and further evaluate the three motion-correction algorithms using in vivo data. METHODS The geometry of a C-arm CT system for a horizontal scan trajectory was calibrated using the PDS-2 phantom. The authors acquired images of two healthy volunteers while lying supine on a table, standing, and squatting at several knee flexion angles. In order to identify the involuntary motion of the lower body, nine 1-mm-diameter tantalum fiducial markers were attached around the knee. The static mean marker position in 3D, a reference for motion compensation, was estimated by back-projecting detected markers in multiple projections using calibrated projection matrices and identifying the intersection points in 3D of the back-projected rays. Motion was corrected using three different methods (described in detail previously): (1) 2D projection shifting, (2) 2D deformable projection warping, and (3) 3D rigid body warping. For quantitative image quality analysis, SSIM indices for the three methods were compared using the supine data as a ground truth. RESULTS A 2D Euclidean distance-based metric of subjects' motion ranged from 0.85 mm (±0.49 mm) to 3.82 mm (±2.91 mm) (corresponding to 2.76 to 12.41 pixels) resulting in severe motion artifacts in 3D reconstructions. Shifting in 2D, 2D warping, and 3D warping improved the SSIM in the central slice by 20.22%, 16.83%, and 25.77% in the data with the largest motion among the five datasets (SCAN5); improvement in off-center slices was 18.94%, 29.14%, and 36.08%, respectively. CONCLUSIONS The authors showed that C-arm CT control can be implemented for nonstandard horizontal trajectories which enabled us to scan and successfully reconstruct both legs of volunteers in weight-bearing positions. As predicted using theoretical models, the proposed motion correction methods improved image quality by reducing motion artifacts in reconstructions; 3D warping performed better than the 2D methods, especially in off-center slices.
Collapse
Affiliation(s)
- Jang-Hwan Choi
- Department of Radiology, Stanford University, Stanford, California 94305 and Department of Mechanical Engineering, Stanford University, Stanford, California 94305
| | - Andreas Maier
- Department of Radiology, Stanford University, Stanford, California 94305
| | - Andreas Keil
- Department of Radiology, Stanford University, Stanford, California 94305
| | - Saikat Pal
- Biomedical Engineering Department, California Polytechnic State University, San Luis Obispo, California 93407
| | - Emily J McWalter
- Department of Radiology, Stanford University, Stanford, California 94305
| | - Gary S Beaupré
- Musculoskeletal Research Laboratory, VA Palo Alto Health Care System, Palo Alto, California 94304
| | - Garry E Gold
- Department of Radiology, Stanford University, Stanford, California 94305
| | - Rebecca Fahrig
- Department of Radiology, Stanford University, Stanford, California 94305
| |
Collapse
|
45
|
Estimate, Compensate, Iterate: Joint Motion Estimation and Compensation in 4-D Cardiac C-arm Computed Tomography. LECTURE NOTES IN COMPUTER SCIENCE 2015. [DOI: 10.1007/978-3-319-24571-3_69] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/01/2023]
|
46
|
Projection-Based Denoising Method for Photon-Counting Energy-Resolving Detectors. INFORMATIK AKTUELL 2015. [DOI: 10.1007/978-3-662-46224-9_25] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/30/2023]
|
47
|
Müller K, Maier AK, Schwemmer C, Lauritsch G, De Buck S, Wielandts JY, Hornegger J, Fahrig R. Image artefact propagation in motion estimation and reconstruction in interventional cardiac C-arm CT. Phys Med Biol 2014; 59:3121-38. [PMID: 24840084 DOI: 10.1088/0031-9155/59/12/3121] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
The acquisition of data for cardiac imaging using a C-arm computed tomography system requires several seconds and multiple heartbeats. Hence, incorporation of motion correction in the reconstruction step may improve the resulting image quality. Cardiac motion can be estimated by deformable three-dimensional (3D)/3D registration performed on initial 3D images of different heart phases. This motion information can be used for a motion-compensated reconstruction allowing the use of all acquired data for image reconstruction. However, the result of the registration procedure and hence the estimated deformations are influenced by the quality of the initial 3D images. In this paper, the sensitivity of the 3D/3D registration step to the image quality of the initial images is studied. Different reconstruction algorithms are evaluated for a recently proposed cardiac C-arm CT acquisition protocol. The initial 3D images are all based on retrospective electrocardiogram (ECG)-gated data. ECG-gating of data from a single C-arm rotation provides only a few projections per heart phase for image reconstruction. This view sparsity leads to prominent streak artefacts and a poor signal to noise ratio. Five different initial image reconstructions are evaluated: (1) cone beam filtered-backprojection (FDK), (2) cone beam filtered-backprojection and an additional bilateral filter (FFDK), (3) removal of the shadow of dense objects (catheter, pacing electrode, etc) before reconstruction with a cone beam filtered-backprojection (cathFDK), (4) removal of the shadow of dense objects before reconstruction with a cone beam filtered-backprojection and a bilateral filter (cathFFDK). The last method (5) is an iterative few-view reconstruction (FV), the prior image constrained compressed sensing combined with the improved total variation algorithm. All reconstructions are investigated with respect to the final motion-compensated reconstruction quality. The algorithms were tested on a mathematical phantom data set with and without a catheter and on two porcine models using qualitative and quantitative measures. The quantitative results of the phantom experiments show that if no dense object is present within the scan field of view, the quality of the FDK initial images is sufficient for motion estimation via 3D/3D registration. When a catheter or pacing electrode is present, the shadow of these objects needs to be removed before the initial image reconstruction. An additional bilateral filter shows no major improvement with respect to the final motion-compensated reconstruction quality. The results with respect to image quality of the cathFDK, cathFFDK and FV images are comparable. In conclusion, in terms of computational complexity, the algorithm of choice is the cathFDK algorithm.
Collapse
Affiliation(s)
- K Müller
- Pattern Recognition Lab, Department of Computer Science, Friedrich-Alexander-Universität Erlangen-Nürnberg, Martensstr 3, D-91058 Erlangen, Germany. Erlangen Graduate School in Advanced Optical Technologies (SAOT), Paul-Gordan-Str 6, D-91052 Erlangen, Germany
| | | | | | | | | | | | | | | |
Collapse
|
48
|
Müller K, Maier AK, Zheng Y, Wang Y, Lauritsch G, Schwemmer C, Rohkohl C, Hornegger J, Fahrig R. Interventional heart wall motion analysis with cardiac C-arm CT systems. Phys Med Biol 2014; 59:2265-84. [PMID: 24731942 DOI: 10.1088/0031-9155/59/9/2265] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Today, quantitative analysis of three-dimensional (3D) dynamics of the left ventricle (LV) cannot be performed directly in the catheter lab using a current angiographic C-arm system, which is the workhorse imaging modality for cardiac interventions. Therefore, myocardial wall analysis is completely based on the 2D angiographic images or pre-interventional 3D/4D imaging. In this paper, we present a complete framework to study the ventricular wall motion in 4D (3D+t) directly in the catheter lab. From the acquired 2D projection images, a dynamic 3D surface model of the LV is generated, which is then used to detect ventricular dyssynchrony. Different quantitative features to evaluate LV dynamics known from other modalities (ultrasound, magnetic resonance imaging) are transferred to the C-arm CT data. We use the ejection fraction, the systolic dyssynchrony index a 3D fractional shortening and the phase to maximal contraction (ϕi, max) to determine an indicator of LV dyssynchrony and to discriminate regionally pathological from normal myocardium. The proposed analysis tool was evaluated on simulated phantom LV data with and without pathological wall dysfunctions. The LV data used is publicly available online at https://conrad.stanford.edu/data/heart. In addition, the presented framework was tested on eight clinical patient data sets. The first clinical results demonstrate promising performance of the proposed analysis tool and encourage the application of the presented framework to a larger study in clinical practice.
Collapse
Affiliation(s)
- Kerstin Müller
- Department of Computer Science, Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Martensstr. 3, D-91058 Erlangen, Germany. Erlangen Graduate School in Advanced Optical Technologies (SAOT), Paul-Gordan-Str. 6, D-91052 Erlangen, Germany
| | | | | | | | | | | | | | | | | |
Collapse
|
49
|
Choi JH, Fahrig R, Keil A, Besier TF, Pal S, McWalter EJ, Beaupré GS, Maier A. Fiducial marker-based correction for involuntary motion in weight-bearing C-arm CT scanning of knees. Part I. Numerical model-based optimization. Med Phys 2014; 40:091905. [PMID: 24007156 DOI: 10.1118/1.4817476] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
PURPOSE Human subjects in standing positions are apt to show much more involuntary motion than in supine positions. The authors aimed to simulate a complicated realistic lower body movement using the four-dimensional (4D) digital extended cardiac-torso (XCAT) phantom. The authors also investigated fiducial marker-based motion compensation methods in two-dimensional (2D) and three-dimensional (3D) space. The level of involuntary movement-induced artifacts and image quality improvement were investigated after applying each method. METHODS An optical tracking system with eight cameras and seven retroreflective markers enabled us to track involuntary motion of the lower body of nine healthy subjects holding a squat position at 60° of flexion. The XCAT-based knee model was developed using the 4D XCAT phantom and the optical tracking data acquired at 120 Hz. The authors divided the lower body in the XCAT into six parts and applied unique affine transforms to each so that the motion (6 degrees of freedom) could be synchronized with the optical markers' location at each time frame. The control points of the XCAT were tessellated into triangles and 248 projection images were created based on intersections of each ray and monochromatic absorption. The tracking data sets with the largest motion (Subject 2) and the smallest motion (Subject 5) among the nine data sets were used to animate the XCAT knee model. The authors defined eight skin control points well distributed around the knees as pseudo-fiducial markers which functioned as a reference in motion correction. Motion compensation was done in the following ways: (1) simple projection shifting in 2D, (2) deformable projection warping in 2D, and (3) rigid body warping in 3D. Graphics hardware accelerated filtered backprojection was implemented and combined with the three correction methods in order to speed up the simulation process. Correction fidelity was evaluated as a function of number of markers used (4-12) and marker distribution in three scenarios. RESULTS Average optical-based translational motion for the nine subjects was 2.14 mm (± 0.69 mm) and 2.29 mm (± 0.63 mm) for the right and left knee, respectively. In the representative central slices of Subject 2, the authors observed 20.30%, 18.30%, and 22.02% improvements in the structural similarity (SSIM) index with 2D shifting, 2D warping, and 3D warping, respectively. The performance of 2D warping improved as the number of markers increased up to 12 while 2D shifting and 3D warping were insensitive to the number of markers used. The minimum required number of markers for 2D shifting, 2D warping, and 3D warping was 4-6, 12, and 8, respectively. An even distribution of markers over the entire field of view provided robust performance for all three correction methods. CONCLUSIONS The authors were able to simulate subject-specific realistic knee movement in weight-bearing positions. This study indicates that involuntary motion can seriously degrade the image quality. The proposed three methods were evaluated with the numerical knee model; 3D warping was shown to outperform the 2D methods. The methods are shown to significantly reduce motion artifacts if an appropriate marker setup is chosen.
Collapse
Affiliation(s)
- Jang-Hwan Choi
- Department of Radiology, Stanford University, Stanford, California 94305, USA.
| | | | | | | | | | | | | | | |
Collapse
|