1
|
Zhang C, Piccini D, Demirel OB, Bonanno G, Roy CW, Yaman B, Moeller S, Shenoy C, Stuber M, Akçakaya M. Large-scale 3D non-Cartesian coronary MRI reconstruction using distributed memory-efficient physics-guided deep learning with limited training data. MAGMA (NEW YORK, N.Y.) 2024; 37:429-438. [PMID: 38743377 DOI: 10.1007/s10334-024-01157-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/10/2023] [Revised: 02/19/2024] [Accepted: 03/13/2024] [Indexed: 05/16/2024]
Abstract
OBJECT To enable high-quality physics-guided deep learning (PG-DL) reconstruction of large-scale 3D non-Cartesian coronary MRI by overcoming challenges of hardware limitations and limited training data availability. MATERIALS AND METHODS While PG-DL has emerged as a powerful image reconstruction method, its application to large-scale 3D non-Cartesian MRI is hindered by hardware limitations and limited availability of training data. We combine several recent advances in deep learning and MRI reconstruction to tackle the former challenge, and we further propose a 2.5D reconstruction using 2D convolutional neural networks, which treat 3D volumes as batches of 2D images to train the network with a limited amount of training data. Both 3D and 2.5D variants of the PG-DL networks were compared to conventional methods for high-resolution 3D kooshball coronary MRI. RESULTS Proposed PG-DL reconstructions of 3D non-Cartesian coronary MRI with 3D and 2.5D processing outperformed all conventional methods both quantitatively and qualitatively in terms of image assessment by an experienced cardiologist. The 2.5D variant further improved vessel sharpness compared to 3D processing, and scored higher in terms of qualitative image quality. DISCUSSION PG-DL reconstruction of large-scale 3D non-Cartesian MRI without compromising image size or network complexity is achieved, and the proposed 2.5D processing enables high-quality reconstruction with limited training data.
Collapse
Affiliation(s)
- Chi Zhang
- Electrical and Computer Engineering, University of Minnesota, 200 Union Street S.E., Minneapolis, MN, 55455, USA
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
| | - Davide Piccini
- Department of Diagnostic and Interventional Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland
- Advanced Clinical Imaging Technology, Siemens Healthineers International, Lausanne, Switzerland
| | - Omer Burak Demirel
- Electrical and Computer Engineering, University of Minnesota, 200 Union Street S.E., Minneapolis, MN, 55455, USA
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
| | - Gabriele Bonanno
- Advanced Clinical Imaging Technology, Siemens Healthineers International, Lausanne, Switzerland
| | - Christopher W Roy
- Department of Diagnostic and Interventional Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland
| | - Burhaneddin Yaman
- Electrical and Computer Engineering, University of Minnesota, 200 Union Street S.E., Minneapolis, MN, 55455, USA
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
| | - Steen Moeller
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
| | - Chetan Shenoy
- Department of Medicine (Cardiology), University of Minnesota, Minneapolis, MN, 55455, USA
| | - Matthias Stuber
- Department of Diagnostic and Interventional Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland
- Center for Biomedical Imaging, Lausanne, Switzerland
| | - Mehmet Akçakaya
- Electrical and Computer Engineering, University of Minnesota, 200 Union Street S.E., Minneapolis, MN, 55455, USA.
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA.
| |
Collapse
|
2
|
Jun Y, Arefeen Y, Cho J, Fujita S, Wang X, Ellen Grant P, Gagoski B, Jaimes C, Gee MS, Bilgic B. Zero-DeepSub: Zero-shot deep subspace reconstruction for rapid multiparametric quantitative MRI using 3D-QALAS. Magn Reson Med 2024; 91:2459-2482. [PMID: 38282270 PMCID: PMC11005062 DOI: 10.1002/mrm.30018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Revised: 12/15/2023] [Accepted: 01/06/2024] [Indexed: 01/30/2024]
Abstract
PURPOSE To develop and evaluate methods for (1) reconstructing 3D-quantification using an interleaved Look-Locker acquisition sequence with T2 preparation pulse (3D-QALAS) time-series images using a low-rank subspace method, which enables accurate and rapid T1 and T2 mapping, and (2) improving the fidelity of subspace QALAS by combining scan-specific deep-learning-based reconstruction and subspace modeling. THEORY AND METHODS A low-rank subspace method for 3D-QALAS (i.e., subspace QALAS) and zero-shot deep-learning subspace method (i.e., Zero-DeepSub) were proposed for rapid and high fidelity T1 and T2 mapping and time-resolved imaging using 3D-QALAS. Using an ISMRM/NIST system phantom, the accuracy and reproducibility of the T1 and T2 maps estimated using the proposed methods were evaluated by comparing them with reference techniques. The reconstruction performance of the proposed subspace QALAS using Zero-DeepSub was evaluated in vivo and compared with conventional QALAS at high reduction factors of up to nine-fold. RESULTS Phantom experiments showed that subspace QALAS had good linearity with respect to the reference methods while reducing biases and improving precision compared to conventional QALAS, especially for T2 maps. Moreover, in vivo results demonstrated that subspace QALAS had better g-factor maps and could reduce voxel blurring, noise, and artifacts compared to conventional QALAS and showed robust performance at up to nine-fold acceleration with Zero-DeepSub, which enabled whole-brain T1, T2, and PD mapping at 1 mm isotropic resolution within 2 min of scan time. CONCLUSION The proposed subspace QALAS along with Zero-DeepSub enabled high fidelity and rapid whole-brain multiparametric quantification and time-resolved imaging.
Collapse
Affiliation(s)
- Yohan Jun
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, MA, United States
- Department of Radiology, Harvard Medical School, Boston, MA, United States
| | - Yamin Arefeen
- Chandra Family Department of Electrical and Computer Engineering, The University of Texas, Austin, TX, United States
- Department of Imaging Physics, The University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Jaejin Cho
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, MA, United States
- Department of Radiology, Harvard Medical School, Boston, MA, United States
| | - Shohei Fujita
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, MA, United States
- Department of Radiology, Harvard Medical School, Boston, MA, United States
| | - Xiaoqing Wang
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, MA, United States
- Department of Radiology, Harvard Medical School, Boston, MA, United States
| | - P. Ellen Grant
- Department of Radiology, Harvard Medical School, Boston, MA, United States
- Fetal-Neonatal Neuroimaging & Developmental Science Center, Boston Children’s Hospital, Boston, MA, United States
| | - Borjan Gagoski
- Department of Radiology, Harvard Medical School, Boston, MA, United States
- Fetal-Neonatal Neuroimaging & Developmental Science Center, Boston Children’s Hospital, Boston, MA, United States
| | - Camilo Jaimes
- Department of Radiology, Harvard Medical School, Boston, MA, United States
- Department of Radiology, Massachusetts General Hospital, Boston, MA, United States
| | - Michael S. Gee
- Department of Radiology, Harvard Medical School, Boston, MA, United States
- Department of Radiology, Massachusetts General Hospital, Boston, MA, United States
| | - Berkin Bilgic
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, MA, United States
- Department of Radiology, Harvard Medical School, Boston, MA, United States
- Harvard/MIT Health Sciences and Technology, Cambridge, MA, United States
| |
Collapse
|
3
|
Christodoulou AG, Cruz G, Arami A, Weingärtner S, Artico J, Peters D, Seiberlich N. The future of cardiovascular magnetic resonance: All-in-one vs. real-time (Part 1). J Cardiovasc Magn Reson 2024; 26:100997. [PMID: 38237900 PMCID: PMC11211239 DOI: 10.1016/j.jocmr.2024.100997] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2023] [Accepted: 01/10/2024] [Indexed: 02/26/2024] Open
Abstract
Cardiovascular magnetic resonance (CMR) protocols can be lengthy and complex, which has driven the research community to develop new technologies to make these protocols more efficient and patient-friendly. Two different approaches to improving CMR have been proposed, specifically "all-in-one" CMR, where several contrasts and/or motion states are acquired simultaneously, and "real-time" CMR, in which the examination is accelerated to avoid the need for breathholding and/or cardiac gating. The goal of this two-part manuscript is to describe these two different types of emerging rapid CMR. To this end, the vision of each is described, along with techniques which have been devised and tested along the pathway of clinical implementation. The pros and cons of the different methods are presented, and the remaining open needs of each are detailed. Part 1 will tackle the "all-in-one" approaches, and Part 2 the "real-time" approaches along with an overall summary of these emerging methods.
Collapse
Affiliation(s)
- Anthony G Christodoulou
- Department of Radiological Sciences, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA; Biomedical Imaging Research Institute, Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Gastao Cruz
- Michigan Institute for Imaging Technology and Translation, Department of Radiology, University of Michigan, Ann Arbor, MI, USA
| | - Ayda Arami
- Department of Imaging Physics, Delft University of Technology, Delft, the Netherlands; Department of Radiology, Leiden University Medical Center, Leiden, the Netherlands
| | - Sebastian Weingärtner
- Department of Imaging Physics, Delft University of Technology, Delft, the Netherlands
| | | | - Dana Peters
- Radiology & Biomedical Imaging, Yale University, New Haven, CT, USA
| | - Nicole Seiberlich
- Michigan Institute for Imaging Technology and Translation, Department of Radiology, University of Michigan, Ann Arbor, MI, USA.
| |
Collapse
|
4
|
Li P, Hu Y. Learned Tensor Low-CP-Rank and Bloch Response Manifold Priors for Non-Cartesian MRF Reconstruction. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; 42:3702-3714. [PMID: 37549069 DOI: 10.1109/tmi.2023.3302872] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/09/2023]
Abstract
Magnetic resonance fingerprinting (MRF) can rapidly perform simultaneous imaging of multiple tissue parameters. However, the rapid acquisition schemes used in MRF inevitably introduce aliasing artifacts in the recovered tissue fingerprints, reducing the accuracy of the predicted parameter maps. Current regularized reconstruction methods are based on iterative procedures which are usually time-consuming. In addition, most of the current deep learning-based methods for MRF often lack interpretability owing to the black-box nature, and most deep learning-based methods are not applicable for non-Cartesian scenarios, which limits the practical applications. In this paper, we propose a joint reconstruction model incorporating MRF-physics prior and the data correlation constraint for non-Cartesian MRF reconstruction. To avoid time-consuming iterative procedures, we unroll the reconstruction model into a deep neural network. Specifically, we propose a learned CANDECOMP/PARAFAC (CP) decomposition module to exploit the tensor low-rank priors of high-dimensional MRF data, which avoids computationally burdensome singular value decomposition. Inspired by the MRF-physics, we also propose a Bloch response manifold module to learn the mapping between reconstructed MRF data and the multiple parameter maps. Numerical experiments show that the proposed network can reconstruct high-quality MRF data and multiple parameter maps within significantly reduced computational time.
Collapse
|
5
|
Singh D, Monga A, de Moura HL, Zhang X, Zibetti MVW, Regatte RR. Emerging Trends in Fast MRI Using Deep-Learning Reconstruction on Undersampled k-Space Data: A Systematic Review. Bioengineering (Basel) 2023; 10:1012. [PMID: 37760114 PMCID: PMC10525988 DOI: 10.3390/bioengineering10091012] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Revised: 08/22/2023] [Accepted: 08/24/2023] [Indexed: 09/29/2023] Open
Abstract
Magnetic Resonance Imaging (MRI) is an essential medical imaging modality that provides excellent soft-tissue contrast and high-resolution images of the human body, allowing us to understand detailed information on morphology, structural integrity, and physiologic processes. However, MRI exams usually require lengthy acquisition times. Methods such as parallel MRI and Compressive Sensing (CS) have significantly reduced the MRI acquisition time by acquiring less data through undersampling k-space. The state-of-the-art of fast MRI has recently been redefined by integrating Deep Learning (DL) models with these undersampled approaches. This Systematic Literature Review (SLR) comprehensively analyzes deep MRI reconstruction models, emphasizing the key elements of recently proposed methods and highlighting their strengths and weaknesses. This SLR involves searching and selecting relevant studies from various databases, including Web of Science and Scopus, followed by a rigorous screening and data extraction process using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. It focuses on various techniques, such as residual learning, image representation using encoders and decoders, data-consistency layers, unrolled networks, learned activations, attention modules, plug-and-play priors, diffusion models, and Bayesian methods. This SLR also discusses the use of loss functions and training with adversarial networks to enhance deep MRI reconstruction methods. Moreover, we explore various MRI reconstruction applications, including non-Cartesian reconstruction, super-resolution, dynamic MRI, joint learning of reconstruction with coil sensitivity and sampling, quantitative mapping, and MR fingerprinting. This paper also addresses research questions, provides insights for future directions, and emphasizes robust generalization and artifact handling. Therefore, this SLR serves as a valuable resource for advancing fast MRI, guiding research and development efforts of MRI reconstruction for better image quality and faster data acquisition.
Collapse
Affiliation(s)
- Dilbag Singh
- Center of Biomedical Imaging, Department of Radiology, New York University Grossman School of Medicine, New York, NY 10016, USA; (A.M.); (H.L.d.M.); (X.Z.); (M.V.W.Z.)
| | | | | | | | | | - Ravinder R. Regatte
- Center of Biomedical Imaging, Department of Radiology, New York University Grossman School of Medicine, New York, NY 10016, USA; (A.M.); (H.L.d.M.); (X.Z.); (M.V.W.Z.)
| |
Collapse
|