1
|
Two-phase learning-based 3D deblurring method for digital breast tomosynthesis images. PLoS One 2022; 17:e0262736. [PMID: 35073353 PMCID: PMC8786177 DOI: 10.1371/journal.pone.0262736] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2021] [Accepted: 01/04/2022] [Indexed: 11/19/2022] Open
Abstract
In digital breast tomosynthesis (DBT) systems, projection data are acquired from a limited number of angles. Consequently, the reconstructed images contain severe blurring artifacts that might heavily degrade the DBT image quality and cause difficulties in detecting lesions. In this study, we propose a two-phase learning approach for artifact compensation in a coarse-to-fine manner to mitigate blurring artifacts effectively along all viewing directions of the DBT image volume (i.e., along the axial, coronal, and sagittal planes) to improve the detection performance of lesions. The proposed method employs a convolutional neural network model comprising two submodels/phases, with Phase 1 performing three-dimensional (3D) deblurring and Phase 2 performing additional 2D deblurring. To investigate the effects of loss functions on the proposed model’s deblurring performance, we evaluated several loss functions, such as the pixel-based loss function, adversarial-based loss function, and perception-based loss function. Compared with the DBT image, the mean squared error of the image and the root mean squared errors of the gradient of the image decreased by 82.8% and 44.9%, respectively, and the contrast-to-noise ratio increased by 183.4% in the in-focus plane. We verified that the proposed method sequentially restored the missing frequency components as the DBT images were processed through the Phase 1 and Phase 2 steps. These results indicate that the proposed method performs effective 3D deblurring, significantly reducing the blurring artifacts in the in-focus plane and other planes of the DBT image, thus improving the detection performance of lesions.
Collapse
|
2
|
Sghaier M, Chouzenoux E, Pesquet JC, Muller S. A Novel Task-Based reconstruction approach for digital breast tomosynthesis. Med Image Anal 2021; 77:102341. [PMID: 34998110 DOI: 10.1016/j.media.2021.102341] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2020] [Revised: 12/16/2021] [Accepted: 12/20/2021] [Indexed: 10/19/2022]
Abstract
The reconstruction of a volumetric image from Digital Breast Tomosynthesis (DBT) measurements is an ill-posed inverse problem, for which existing iterative regularized approaches can provide a good solution. However, the clinical task is somehow omitted in the derivation of those techniques, although it plays a primary role in the radiologist diagnosis. In this work, we address this issue by introducing a novel variational formulation for DBT reconstruction, tailored for a specific clinical task, namely the detection of microcalcifications. Our method aims at simultaneously enhancing the detectability performance and enabling a high-quality restoration of the background breast tissues. Our contribution is threefold. First, we introduce an original task-based reconstruction framework through the proposition of a detectability function inspired from mathematical model observers. Second, we propose a novel total-variation regularizer where the gradient field accounts for the different morphological contents of the imaged breast. Third, we integrate the two developed measures into a cost function, minimized thanks to a new form of the Majorize Minimize Memory Gradient (3MG) algorithm. We conduct a numerical comparison of the convergence speed of the proposed method with those of standard convex optimization algorithms. Experimental results show the interest of our DBT reconstruction approach, qualitatively and quantitatively.
Collapse
Affiliation(s)
- Maissa Sghaier
- University of Paris-Saclay, CentraleSupélec, CVN, Inria, 09 Rue Joliot Curie, Gif-sur-Yvette 91190, France; GE Healthcare, 283 Rue de la Minière, Buc 78530, France.
| | - Emilie Chouzenoux
- University of Paris-Saclay, CentraleSupélec, CVN, Inria, 09 Rue Joliot Curie, Gif-sur-Yvette 91190, France.
| | - Jean-Christophe Pesquet
- University of Paris-Saclay, CentraleSupélec, CVN, Inria, 09 Rue Joliot Curie, Gif-sur-Yvette 91190, France.
| | - Serge Muller
- GE Healthcare, 283 Rue de la Minière, Buc 78530, France.
| |
Collapse
|
3
|
Sidky EY, Phillips JP, Zhou W, Ongie G, Cruz-Bastida JP, Reiser IS, Anastasio MA, Pan X. A signal detection model for quantifying overregularization in nonlinear image reconstruction. Med Phys 2021; 48:6312-6323. [PMID: 34169538 DOI: 10.1002/mp.14703] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2020] [Revised: 12/09/2020] [Accepted: 12/21/2020] [Indexed: 11/08/2022] Open
Abstract
Many useful image quality metrics for evaluating linear image reconstruction techniques do not apply to or are difficult to interpret for nonlinear image reconstruction. The vast majority of metrics employed for evaluating nonlinear image reconstruction are based on some form of global image fidelity, such as image root mean square error (RMSE). Use of such metrics can lead to overregularization in the sense that they can favor removal of subtle details in the image. To address this shortcoming, we develop an image quality metric based on signal detection that serves as a surrogate to the qualitative loss of fine image details. The metric is demonstrated in the context of a breast CT simulation, where different equal-dose configurations are considered. The configurations differ in the number of projections acquired. Image reconstruction is performed with a nonlinear algorithm based on total variation constrained least-squares (TV-LSQ). The resulting images are studied as a function of three parameters: number of views acquired, total variation constraint value, and number of iterations. The images are evaluated visually, with image RMSE, and with the proposed signal-detection-based metric. The latter uses a small signal, and computes detectability in the sinogram and in the reconstructed image. Loss of signal detectability through the image reconstruction process is taken as a quantitative measure of loss of fine details in the image. Loss of signal detectability is seen to correlate well with the blocky or patchy appearance due to overregularization with TV-LSQ, and this trend runs counter to the image RMSE metric, which tends to favor the over-regularized images. The proposed signal detection-based metric provides an image quality assessment that is complimentary to that of image RMSE. Using the two metrics in concert may yield a useful prescription for determining CT algorithm and configuration parameters when nonlinear image reconstruction is used.
Collapse
Affiliation(s)
- Emil Y Sidky
- Department of Radiology, The University of Chicago, 5841 S. Maryland Ave., Chicago, IL, 60637, USA
| | - John Paul Phillips
- Department of Radiology, The University of Chicago, 5841 S. Maryland Ave., Chicago, IL, 60637, USA
| | - Weimin Zhou
- Department of Bioengineering, University of Illinois at Urbana-Champaign, 1406 W. Green St., Urbana, IL, 61801, USA
| | - Greg Ongie
- Department of Mathematical and Statistical Sciences, Marquette University, 1313 W. Wisconsin Ave., Milwaukee, WI, 53233, USA
| | - Juan P Cruz-Bastida
- Department of Radiology, The University of Chicago, 5841 S. Maryland Ave., Chicago, IL, 60637, USA
| | - Ingrid S Reiser
- Department of Radiology, The University of Chicago, 5841 S. Maryland Ave., Chicago, IL, 60637, USA
| | - Mark A Anastasio
- Department of Bioengineering, University of Illinois at Urbana-Champaign, 1406 W. Green St., Urbana, IL, 61801, USA
| | - Xiaochuan Pan
- Department of Radiology, The University of Chicago, 5841 S. Maryland Ave., Chicago, IL, 60637, USA
| |
Collapse
|
4
|
Su T, Deng X, Yang J, Wang Z, Fang S, Zheng H, Liang D, Ge Y. DIR-DBTnet: Deep iterative reconstruction network for three-dimensional digital breast tomosynthesis imaging. Med Phys 2021; 48:2289-2300. [PMID: 33594671 DOI: 10.1002/mp.14779] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2020] [Revised: 01/21/2021] [Accepted: 02/09/2021] [Indexed: 11/08/2022] Open
Abstract
PURPOSE The goal of this study is to develop a three-dimensional (3D) iterative reconstruction framework based on the deep learning (DL) technique to improve the digital breast tomosynthesis (DBT) imaging performance. METHODS In this work, the DIR-DBTnet is developed for DBT image reconstruction by mapping the conventional iterative reconstruction (IR) algorithm to the deep neural network. By design, the DIR-DBTnet learns and optimizes the regularizer and the iteration parameters automatically during the network training with a large amount of simulated DBT data. Numerical, experimental, and clinical data are used to evaluate its performance. Quantitative metrics such as the artifact spread function (ASF), breast density, and the signal difference to noise ratio (SDNR) are measured to assess the image quality. RESULTS Results show that the proposed DIR-DBTnet is able to reduce the in-plane shadow artifacts and the out-of-plane signal leaking artifacts compared to the filtered backprojection (FBP) and the total variation (TV)-based IR methods. Quantitatively, the full width half maximum (FWHM) of the measured ASF from the clinical data is 27.1% and 23.0% smaller than those obtained with the FBP and TV methods, while the SDNR is increased by 194.5% and 21.8%, respectively. In addition, the breast density obtained from the DIR-DBTnet network is more accurate and consistent with the ground truth. CONCLUSIONS In conclusion, a deep iterative reconstruction network, DIR-DBTnet, has been proposed for 3D DBT image reconstruction. Both qualitative and quantitative analyses of the numerical, experimental, and clinical results demonstrate that the DIR-DBTnet has superior DBT imaging performance than the conventional algorithms.
Collapse
Affiliation(s)
- Ting Su
- Research Center for Medical Artificial Intelligence, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Xiaolei Deng
- College of Mechanical & Electrical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016, China
| | - Jiecheng Yang
- Research Center for Medical Artificial Intelligence, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Zhenwei Wang
- Shanghai United Imaging Healthcare Co, Ltd, Shanghai, 201807, China
| | - Shibo Fang
- Research Center for Medical Artificial Intelligence, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Hairong Zheng
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Dong Liang
- Research Center for Medical Artificial Intelligence, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China.,Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Yongshuai Ge
- Research Center for Medical Artificial Intelligence, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China.,Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| |
Collapse
|
5
|
Rose SD, Sidky EY, Reiser I, Pan X. Imaging of fiber-like structures in digital breast tomosynthesis. J Med Imaging (Bellingham) 2019; 6:031404. [PMID: 30662927 DOI: 10.1117/1.jmi.6.3.031404] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2018] [Accepted: 12/10/2018] [Indexed: 11/14/2022] Open
Abstract
Fiber-like features are an important aspect of breast imaging. Vessels and ducts are present in all breast images, and spiculations radiating from a mass can indicate malignancy. Accordingly, fiber objects are one of the three types of signals used in the American College of Radiology digital mammography (ACR-DM) accreditation phantom. Our work focuses on the image properties of fiber-like structures in digital breast tomosynthesis (DBT) and how image reconstruction can affect their appearance. The impact of DBT image reconstruction algorithm and regularization strength on the conspicuity of fiber-like signals of various orientations is investigated in simulation. A metric is developed to characterize this orientation dependence and allow for quantitative comparison of algorithms and associated parameters in the context of imaging fiber signals. The imaging properties of fibers, characterized in simulation, are then demonstrated in detail with physical DBT data of the ACR-DM phantom. The characterization of imaging of fiber signals is used to explain features of an actual clinical DBT case. For the algorithms investigated, at low regularization setting, the results show a striking variation in conspicuity as a function of orientation in the viewing plane. In particular, the conspicuity of fibers nearly aligned with the plane of the x-ray source trajectory is decreased relative to more obliquely oriented fibers. Increasing regularization strength mitigates this orientation dependence at the cost of increasing depth blur of these structures.
Collapse
Affiliation(s)
- Sean D Rose
- University of Wisconsin, Department of Medical Physics, Madison, Wisconsin, United States
| | - Emil Y Sidky
- University of Chicago, Department of Radiology, Chicago, Illinois, United States
| | - Ingrid Reiser
- University of Chicago, Department of Radiology, Chicago, Illinois, United States
| | - Xiaochuan Pan
- University of Chicago, Department of Radiology, Chicago, Illinois, United States
| |
Collapse
|