1
|
Wang S, Wu R, Jia S, Diakite A, Li C, Liu Q, Zheng H, Ying L. Knowledge-driven deep learning for fast MR imaging: Undersampled MR image reconstruction from supervised to un-supervised learning. Magn Reson Med 2024; 92:496-518. [PMID: 38624162 DOI: 10.1002/mrm.30105] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Revised: 03/19/2024] [Accepted: 03/20/2024] [Indexed: 04/17/2024]
Abstract
Deep learning (DL) has emerged as a leading approach in accelerating MRI. It employs deep neural networks to extract knowledge from available datasets and then applies the trained networks to reconstruct accurate images from limited measurements. Unlike natural image restoration problems, MRI involves physics-based imaging processes, unique data properties, and diverse imaging tasks. This domain knowledge needs to be integrated with data-driven approaches. Our review will introduce the significant challenges faced by such knowledge-driven DL approaches in the context of fast MRI along with several notable solutions, which include learning neural networks and addressing different imaging application scenarios. The traits and trends of these techniques have also been given which have shifted from supervised learning to semi-supervised learning, and finally, to unsupervised learning methods. In addition, MR vendors' choices of DL reconstruction have been provided along with some discussions on open questions and future directions, which are critical for the reliable imaging systems.
Collapse
Affiliation(s)
- Shanshan Wang
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Ruoyou Wu
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Sen Jia
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Alou Diakite
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Cheng Li
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Qiegen Liu
- Department of Electronic Information Engineering, Nanchang University, Nanchang, China
| | - Hairong Zheng
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Leslie Ying
- Department of Biomedical Engineering and Department of Electrical Engineering, The State University of New York, Buffalo, New York, USA
| |
Collapse
|
2
|
Zhang T, Zhao Y, Jin W, Li Y, Guo R, Ke Z, Luo J, Li Y, Liang ZP. B 1 mapping using pre-learned subspaces for quantitative brain imaging. Magn Reson Med 2023; 90:2089-2101. [PMID: 37345702 DOI: 10.1002/mrm.29764] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2023] [Revised: 05/24/2023] [Accepted: 05/30/2023] [Indexed: 06/23/2023]
Abstract
PURPOSE To develop a machine learning-based method for estimation of both transmitter and receiver B1 fields desired for correction of the B1 inhomogeneity effects in quantitative brain imaging. THEORY AND METHODS A subspace model-based machine learning method was proposed for estimation of B1t and B1r fields. Probabilistic subspace models were used to capture scan-dependent variations in the B1 fields; the subspace basis and coefficient distributions were learned from pre-scanned training data. Estimation of the B1 fields for new experimental data was achieved by solving a linear optimization problem with prior distribution constraints. We evaluated the performance of the proposed method for B1 inhomogeneity correction in quantitative brain imaging scenarios, including T1 and proton density (PD) mapping from variable-flip-angle spoiled gradient-echo (SPGR) data as well as neurometabolic mapping from MRSI data, using phantom, healthy subject and brain tumor patient data. RESULTS In both phantom and healthy subject data, the proposed method produced high-quality B1 maps. B1 correction on SPGR data using the estimated B1 maps produced significantly improved T1 and PD maps. In brain tumor patients, the proposed method produced more accurate and robust B1 estimation and correction results than conventional methods. The B1 maps were also applied to MRSI data from tumor patients and produced improved neurometabolite maps, with better separation between pathological and normal tissues. CONCLUSION This work presents a novel method to estimate B1 variations using probabilistic subspace models and machine learning. The proposed method may make correction of B1 inhomogeneity effects more robust in practical applications.
Collapse
Affiliation(s)
- Tianxiao Zhang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Yibo Zhao
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
| | - Wen Jin
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
| | - Yudu Li
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
| | - Rong Guo
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
- Siemens Medical Solutions USA, Inc., Urbana, Illinois, USA
| | - Ziwen Ke
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Jie Luo
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Yao Li
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Zhi-Pei Liang
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
| |
Collapse
|
3
|
Krueger F, Aigner CS, Hammernik K, Dietrich S, Lutz M, Schulz-Menger J, Schaeffter T, Schmitter S. Rapid estimation of 2D relative B 1 + -maps from localizers in the human heart at 7T using deep learning. Magn Reson Med 2023; 89:1002-1015. [PMID: 36336877 DOI: 10.1002/mrm.29510] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2022] [Revised: 10/11/2022] [Accepted: 10/11/2022] [Indexed: 11/09/2022]
Abstract
PURPOSE Subject-tailored parallel transmission pulses for ultra-high fields body applications are typically calculated based on subject-specific B 1 + $$ {\mathrm{B}}_1^{+} $$ -maps of all transmit channels, which require lengthy adjustment times. This study investigates the feasibility of using deep learning to estimate complex, channel-wise, relative 2D B 1 + $$ {\mathrm{B}}_1^{+} $$ -maps from a single gradient echo localizer to overcome long calibration times. METHODS 126 channel-wise, complex, relative 2D B 1 + $$ {\mathrm{B}}_1^{+} $$ -maps of the human heart from 44 subjects were acquired at 7T using a Cartesian, cardiac gradient-echo sequence obtained under breath-hold to create a library for network training and cross-validation. The deep learning predicted maps were qualitatively compared to the ground truth. Phase-only B 1 + $$ {\mathrm{B}}_1^{+} $$ -shimming was subsequently performed on the estimated B 1 + $$ {\mathrm{B}}_1^{+} $$ -maps for a region of interest covering the heart. The proposed network was applied at 7T to 3 unseen test subjects. RESULTS The deep learning-based B 1 + $$ {\mathrm{B}}_1^{+} $$ -maps, derived in approximately 0.2 seconds, match the ground truth for the magnitude and phase. The static, phase-only pulse design performs best when maximizing the mean transmission efficiency. In-vivo application of the proposed network to unseen subjects demonstrates the feasibility of this approach: the network yields predicted B 1 + $$ {\mathrm{B}}_1^{+} $$ -maps comparable to the acquired ground truth and anatomical scans reflect the resulting B 1 + $$ {\mathrm{B}}_1^{+} $$ -pattern using the deep learning-based maps. CONCLUSION The feasibility of estimating 2D relative B 1 + $$ {\mathrm{B}}_1^{+} $$ -maps from initial localizer scans of the human heart at 7T using deep learning is successfully demonstrated. Because the technique requires only sub-seconds to derive channel-wise B 1 + $$ {\mathrm{B}}_1^{+} $$ -maps, it offers high potential for advancing clinical body imaging at ultra-high fields.
Collapse
Affiliation(s)
- Felix Krueger
- Physikalisch-Technische Bundesanstalt, Braunschweig and Berlin, Germany.,Technische Universität Berlin, Biomedical Engineering, Berlin, Germany
| | | | - Kerstin Hammernik
- Technical University of Munich, Munich, Germany.,Imperial College London, London, United Kingdom
| | | | - Max Lutz
- Physikalisch-Technische Bundesanstalt, Braunschweig and Berlin, Germany
| | - Jeanette Schulz-Menger
- Charité-Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität Zu Berlin, Experimental Clinical Research Center, Berlin, Germany.,DZHK (German Centre for Cardiovascular Research), Partner Site Berlin, Berlin, Germany.,Department of Cardiology and Nephrology, HELIOS Hospital Berlin-Buch, Berlin, Germany
| | - Tobias Schaeffter
- Physikalisch-Technische Bundesanstalt, Braunschweig and Berlin, Germany.,Technische Universität Berlin, Biomedical Engineering, Berlin, Germany.,Division of Imaging Sciences and Biomedical Engineering, King's College London, London, United Kingdom
| | - Sebastian Schmitter
- Physikalisch-Technische Bundesanstalt, Braunschweig and Berlin, Germany.,Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, Minnesota, USA.,Medical Physics in Radiology, German Cancer Research Center (DKFZ), Heidelberg, Germany
| |
Collapse
|
4
|
Deep Learning-Based Water-Fat Separation from Dual-Echo Chemical Shift-Encoded Imaging. Bioengineering (Basel) 2022; 9:bioengineering9100579. [PMID: 36290546 PMCID: PMC9598080 DOI: 10.3390/bioengineering9100579] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2022] [Revised: 10/12/2022] [Accepted: 10/15/2022] [Indexed: 11/26/2022] Open
Abstract
Conventional water–fat separation approaches suffer long computational times and are prone to water/fat swaps. To solve these problems, we propose a deep learning-based dual-echo water–fat separation method. With IRB approval, raw data from 68 pediatric clinically indicated dual echo scans were analyzed, corresponding to 19382 contrast-enhanced images. A densely connected hierarchical convolutional network was constructed, in which dual-echo images and corresponding echo times were used as input and water/fat images obtained using the projected power method were regarded as references. Models were trained and tested using knee images with 8-fold cross validation and validated on out-of-distribution data from the ankle, foot, and arm. Using the proposed method, the average computational time for a volumetric dataset with ~400 slices was reduced from 10 min to under one minute. High fidelity was achieved (correlation coefficient of 0.9969, l1 error of 0.0381, SSIM of 0.9740, pSNR of 58.6876) and water/fat swaps were mitigated. I is of particular interest that metal artifacts were substantially reduced, even when the training set contained no images with metallic implants. Using the models trained with only contrast-enhanced images, water/fat images were predicted from non-contrast-enhanced images with high fidelity. The proposed water–fat separation method has been demonstrated to be fast, robust, and has the added capability to compensate for metal artifacts.
Collapse
|
5
|
Karakuzu A, Appelhoff S, Auer T, Boudreau M, Feingold F, Khan AR, Lazari A, Markiewicz C, Mulder M, Phillips C, Salo T, Stikov N, Whitaker K, de Hollander G. qMRI-BIDS: An extension to the brain imaging data structure for quantitative magnetic resonance imaging data. Sci Data 2022; 9:517. [PMID: 36002444 PMCID: PMC9402561 DOI: 10.1038/s41597-022-01571-4] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2021] [Accepted: 07/19/2022] [Indexed: 11/16/2022] Open
Abstract
The Brain Imaging Data Structure (BIDS) established community consensus on the organization of data and metadata for several neuroimaging modalities. Traditionally, BIDS had a strong focus on functional magnetic resonance imaging (MRI) datasets and lacked guidance on how to store multimodal structural MRI datasets. Here, we present and describe the BIDS Extension Proposal 001 (BEP001), which adds a range of quantitative MRI (qMRI) applications to the BIDS. In general, the aim of qMRI is to characterize brain microstructure by quantifying the physical MR parameters of the tissue via computational, biophysical models. By proposing this new standard, we envision standardization of qMRI through multicenter dissemination of interoperable datasets. This way, BIDS can act as a catalyst of convergence between qMRI methods development and application-driven neuroimaging studies that can help develop quantitative biomarkers for neural tissue characterization. In conclusion, this BIDS extension offers a common ground for developers to exchange novel imaging data and tools, reducing the entrance barrier for qMRI in the field of neuroimaging.
Collapse
Affiliation(s)
- Agah Karakuzu
- NeuroPoly Lab, Institute of Biomedical Engineering, Polytechnique Montreal, Montréal, QC, Canada. .,Montreal Heart Institute, Montreal, QC, Canada.
| | - Stefan Appelhoff
- Center for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany
| | - Tibor Auer
- NeuroModulation Lab, School of Psychology, University of Surrey, Guildford, UK
| | - Mathieu Boudreau
- NeuroPoly Lab, Institute of Biomedical Engineering, Polytechnique Montreal, Montréal, QC, Canada.,Montreal Heart Institute, Montreal, QC, Canada
| | | | - Ali R Khan
- Department of Medical Biophysics, Robarts Research Institute, University of Western Ontario, London, Canada
| | - Alberto Lazari
- Wellcome Centre for Integrative Neuroimaging, FMRIB, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK
| | | | - Martijn Mulder
- Department of Experimental Psychology, Utrecht University, Utrecht, the Netherlands
| | - Christophe Phillips
- GIGA Cyclotron Research Centre in vivo imaging, GIGA Institute, University of Liège, Liège, Belgium
| | - Taylor Salo
- Florida International University, Miami, FL, USA
| | - Nikola Stikov
- NeuroPoly Lab, Institute of Biomedical Engineering, Polytechnique Montreal, Montréal, QC, Canada.,Montreal Heart Institute, Montreal, QC, Canada.,Center for Advanced Interdisciplinary Research, Ss. Cyril and Methodius University, Skopje, North Macedonia
| | | | - Gilles de Hollander
- Zurich Center for Neuroeconomics (ZNE), Department of Economics, University of Zurich, Zurich, Switzerland. .,Spinoza Centre for Neuroimaging, Amsterdam, The Netherlands.
| |
Collapse
|
6
|
Li S, Shen C, Ding Z, She H, Du YP. Accelerating multi-echo chemical shift encoded water-fat MRI using model-guided deep learning. Magn Reson Med 2022; 88:1851-1866. [PMID: 35649172 DOI: 10.1002/mrm.29307] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2022] [Revised: 04/30/2022] [Accepted: 05/02/2022] [Indexed: 11/10/2022]
Abstract
PURPOSE To accelerate chemical shift encoded (CSE) water-fat imaging by applying a model-guided deep learning water-fat separation (MGDL-WF) framework to the undersampled k-space data. METHODS A model-guided deep learning water-fat separation framework is proposed for the acceleration using Cartesian/radial undersampling data. The proposed MGDL-WF combines the power of CSE water-fat imaging model and data-driven deep learning by jointly using a multi-peak fat model and a modified residual U-net network. The model is used to guide the image reconstruction, and the network is used to capture the artifacts induced by the undersampling. A data consistency layer is used in MGDL-WF to ensure the output images to be consistent with the k-space measurements. A Gauss-Newton iteration algorithm is adapted for the gradient updating of the networks. RESULTS Compared with the compressed sensing water-fat separation (CS-WF) algorithm/2-step procedure algorithm, the MGDL-WF increased peak signal-to-noise ratio (PSNR) by 5.31/5.23, 6.11/4.54, and 4.75 dB/1.88 dB with Cartesian sampling, and by 4.13/6.53, 2.90/4.68, and 1.68 dB/3.48 dB with radial sampling, at acceleration rates (R) of 4, 6, and 8, respectively. By using MGDL-WF, radial sampling increased the PSNR by 2.07 dB at R = 8, compared with Cartesian sampling. CONCLUSIONS The proposed MGDL-WF enables exploiting features of the water images and fat images from the undersampled multi-echo data, leading to improved performance in the accelerated CSE water-fat imaging. By using MGDL-WF, radial sampling can further improve the image quality with comparable scan time in comparison with Cartesian sampling.
Collapse
Affiliation(s)
- Shuo Li
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Chenfei Shen
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Zekang Ding
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Huajun She
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Yiping P Du
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
7
|
Plumley A, Watkins L, Treder M, Liebig P, Murphy K, Kopanoglu E. Rigid motion-resolved B 1 + prediction using deep learning for real-time parallel-transmission pulse design. Magn Reson Med 2021; 87:2254-2270. [PMID: 34958134 PMCID: PMC7613077 DOI: 10.1002/mrm.29132] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2021] [Revised: 11/30/2021] [Accepted: 12/03/2021] [Indexed: 11/19/2022]
Abstract
Purpose Tailored parallel-transmit (pTx) pulses produce uniform excitation profiles at 7 T, but are sensitive to head motion. A potential solution is real-time pulse redesign. A deep learning framework is proposed to estimate pTx B1+ distributions following within-slice motion, which can then be used for tailored pTx pulse redesign. Methods Using simulated data, conditional generative adversarial networks were trained to predict B1+ distributions in the head following a displacement. Predictions were made for two virtual body models that were not included in training. Predicted maps were compared with groundtruth (simulated, following motion) B1+ maps. Tailored pTx pulses were designed using B1+ maps at the original position (simulated, no motion) and evaluated using simulated B1+ maps at displaced position (ground-truth maps) to quantify motion-related excitation error. A second pulse was designed using predicted maps (also evaluated on ground-truth maps) to investigate improvement offered by the proposed method. Results Predicted B1+ maps corresponded well with ground-truth maps. Error in predicted maps was lower than motion-related error in 99% and 67% of magnitude and phase evaluations, respectively. Worst-case flip-angle normalized RMS error due to motion (76% of target flip angle) was reduced by 59% when pulses were redesigned using predicted maps. Conclusion We propose a framework for predicting B1+ maps online with deep neural networks. Predicted maps can then be used for real-time tailored pulse redesign, helping to overcome head motion–related error in pTx.
Collapse
Affiliation(s)
- Alix Plumley
- Cardiff University Brain Research Imaging Centre (CUBRIC), School of Psychology, Cardiff University, Cardiff, United Kingdom
| | - Luke Watkins
- Cardiff University Brain Research Imaging Centre (CUBRIC), School of Psychology, Cardiff University, Cardiff, United Kingdom.,School of Physics & Astronomy, Cardiff University Brain Research Imaging Centre (CUBRIC), Cardiff, United Kingdom
| | - Matthias Treder
- School of Computer Science and Informatics, Cardiff University, Cardiff, United Kingdom
| | | | - Kevin Murphy
- School of Physics & Astronomy, Cardiff University Brain Research Imaging Centre (CUBRIC), Cardiff, United Kingdom
| | - Emre Kopanoglu
- Cardiff University Brain Research Imaging Centre (CUBRIC), School of Psychology, Cardiff University, Cardiff, United Kingdom
| |
Collapse
|
8
|
Qi H, Cruz G, Botnar R, Prieto C. Synergistic multi-contrast cardiac magnetic resonance image reconstruction. PHILOSOPHICAL TRANSACTIONS. SERIES A, MATHEMATICAL, PHYSICAL, AND ENGINEERING SCIENCES 2021; 379:20200197. [PMID: 33966456 DOI: 10.1098/rsta.2020.0197] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/03/2023]
Abstract
Cardiac magnetic resonance imaging (CMR) is an important tool for the non-invasive diagnosis of a variety of cardiovascular diseases. Parametric mapping with multi-contrast CMR is able to quantify tissue alterations in myocardial disease and promises to improve patient care. However, magnetic resonance imaging is an inherently slow imaging modality, resulting in long acquisition times for parametric mapping which acquires a series of cardiac images with different contrasts for signal fitting or dictionary matching. Furthermore, extra efforts to deal with respiratory and cardiac motion by triggering and gating further increase the scan time. Several techniques have been developed to speed up CMR acquisitions, which usually acquire less data than that required by the Nyquist-Shannon sampling theorem, followed by regularized reconstruction to mitigate undersampling artefacts. Recent advances in CMR parametric mapping speed up CMR by synergistically exploiting spatial-temporal and contrast redundancies. In this article, we will review the recent developments in multi-contrast CMR image reconstruction for parametric mapping with special focus on low-rank and model-based reconstructions. Deep learning-based multi-contrast reconstruction has recently been proposed in other magnetic resonance applications. These developments will be covered to introduce the general methodology. Current technical limitations and potential future directions are discussed. This article is part of the theme issue 'Synergistic tomographic image reconstruction: part 1'.
Collapse
Affiliation(s)
- Haikun Qi
- School of Biomedical Engineering and Imaging Sciences, King's College London, 3rd Floor, Lambeth Wing, St Thomas' Hospital, London SE1 7EH, UK
| | - Gastao Cruz
- School of Biomedical Engineering and Imaging Sciences, King's College London, 3rd Floor, Lambeth Wing, St Thomas' Hospital, London SE1 7EH, UK
| | - René Botnar
- School of Biomedical Engineering and Imaging Sciences, King's College London, 3rd Floor, Lambeth Wing, St Thomas' Hospital, London SE1 7EH, UK
- Escuela de Ingeniería, Pontificia Universidad Católica de Chile, Santiago, Chile
| | - Claudia Prieto
- School of Biomedical Engineering and Imaging Sciences, King's College London, 3rd Floor, Lambeth Wing, St Thomas' Hospital, London SE1 7EH, UK
- Escuela de Ingeniería, Pontificia Universidad Católica de Chile, Santiago, Chile
| |
Collapse
|
9
|
Liu F, Kijowski R, El Fakhri G, Feng L. Magnetic resonance parameter mapping using model-guided self-supervised deep learning. Magn Reson Med 2021; 85:3211-3226. [PMID: 33464652 PMCID: PMC9185837 DOI: 10.1002/mrm.28659] [Citation(s) in RCA: 32] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2020] [Revised: 11/15/2020] [Accepted: 12/07/2020] [Indexed: 12/25/2022]
Abstract
PURPOSE To develop a model-guided self-supervised deep learning MRI reconstruction framework called reference-free latent map extraction (RELAX) for rapid quantitative MR parameter mapping. METHODS Two physical models are incorporated for network training in RELAX, including the inherent MR imaging model and a quantitative model that is used to fit parameters in quantitative MRI. By enforcing these physical model constraints, RELAX eliminates the need for full sampled reference data sets that are required in standard supervised learning. Meanwhile, RELAX also enables direct reconstruction of corresponding MR parameter maps from undersampled k-space. Generic sparsity constraints used in conventional iterative reconstruction, such as the total variation constraint, can be additionally included in the RELAX framework to improve reconstruction quality. The performance of RELAX was tested for accelerated T1 and T2 mapping in both simulated and actually acquired MRI data sets and was compared with supervised learning and conventional constrained reconstruction for suppressing noise and/or undersampling-induced artifacts. RESULTS In the simulated data sets, RELAX generated good T1 /T2 maps in the presence of noise and/or undersampling artifacts, comparable to artifact/noise-free ground truth. The inclusion of a spatial total variation constraint helps improve image quality. For the in vivo T1 /T2 mapping data sets, RELAX achieved superior reconstruction quality compared with conventional iterative reconstruction, and similar reconstruction performance to supervised deep learning reconstruction. CONCLUSION This work has demonstrated the initial feasibility of rapid quantitative MR parameter mapping based on self-supervised deep learning. The RELAX framework may also be further extended to other quantitative MRI applications by incorporating corresponding quantitative imaging models.
Collapse
Affiliation(s)
- Fang Liu
- Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Richard Kijowski
- Department of Radiology, University of Wisconsin-Madison, Madison, Wisconsin, USA
| | - Georges El Fakhri
- Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Li Feng
- Biomedical Engineering and Imaging Institute and Department of Radiology, Icahn School of Medicine at Mount Sinai, New York, USA
| |
Collapse
|
10
|
Desmond KL, Xu R, Sun Y, Chavez S. A practical method for post-acquisition reduction of bias in fast, whole-brain B1-maps. Magn Reson Imaging 2020; 77:88-98. [PMID: 33338561 DOI: 10.1016/j.mri.2020.12.009] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2020] [Revised: 11/22/2020] [Accepted: 12/13/2020] [Indexed: 12/24/2022]
Abstract
Large consistent differences have been observed between maps of the flip angle correction factor (commonly called "B1-maps") produced with different fast methods in the human brain. We present an empirical procedure for first-order multiplicative bias correction that can be applied when more than one B1-mapping method is available. We use a B1-map measurement in a calibration phantom as a reference and the voxel-wise histogram mode between ratios of B1-maps produced from different methods to calculate determine the bias as a multiplicative correcting scale factor. Institutional implementations of four common methods of B1-mapping were assessed: Method of Slopes, FSE and EPI double angle methods (DAM), and Bloch-Siegert. In human subjects, the multiplicative bias used to correct for each of the four methods was: Method of Slopes = 1.005, FSE-DAM = 0.956, EPI-DAM = 1.080, and Bloch-Siegert = 1.128. Scaling to remove this bias between methods produces more consistent B1-maps which enable more consistent values for any computations requiring flip angle correction. In addition, we present evidence that the corrected B1 maps, using our calibration method, are also more accurate.
Collapse
Affiliation(s)
- Kimberly L Desmond
- Brain Health Imaging Centre, Centre for Addiction and Mental Health, Toronto, Ontario M5T 1R8, Canada; Department of Psychiatry, University of Toronto, Toronto, Ontario M5T 1R8, Canada.
| | - Ruiyang Xu
- Brain Health Imaging Centre, Centre for Addiction and Mental Health, Toronto, Ontario M5T 1R8, Canada
| | - Yutong Sun
- Brain Health Imaging Centre, Centre for Addiction and Mental Health, Toronto, Ontario M5T 1R8, Canada
| | - Sofia Chavez
- Brain Health Imaging Centre, Centre for Addiction and Mental Health, Toronto, Ontario M5T 1R8, Canada; Department of Psychiatry, University of Toronto, Toronto, Ontario M5T 1R8, Canada
| |
Collapse
|
11
|
Wu Y, Li D, Xing L, Gold G. Deriving new soft tissue contrasts from conventional MR images using deep learning. Magn Reson Imaging 2020; 74:121-127. [PMID: 32956805 DOI: 10.1016/j.mri.2020.09.014] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2020] [Revised: 09/16/2020] [Accepted: 09/16/2020] [Indexed: 11/24/2022]
Abstract
Versatile soft tissue contrast in magnetic resonance imaging is a unique advantage of the imaging modality. However, the versatility is not fully exploited. In this study, we propose a deep learning-based strategy to derive more soft tissue contrasts from conventional MR images obtained in standard clinical MRI. Two types of experiments are performed. First, MR images corresponding to different pulse sequences are predicted from one or more images already acquired. As an example, we predict T1ρ weighted knee image from T2 weighted image and/or T1 weighted image. Furthermore, we estimate images corresponding to alternative imaging parameter values. In a representative case, variable flip angle images are predicted from a single T1 weighted image, whose accuracy is further validated in quantitative T1 map subsequently derived. To accomplish these tasks, images are retrospectively collected from 56 subjects, and self-attention convolutional neural network models are trained using 1104 knee images from 46 subjects and tested using 240 images from 10 other subjects. High accuracy has been achieved in resultant qualitative images as well as quantitative T1 maps. The proposed deep learning method can be broadly applied to obtain more versatile soft tissue contrasts without additional scans or used to normalize MR data that were inconsistently acquired for quantitative analysis.
Collapse
Affiliation(s)
- Yan Wu
- Department of Radiation Oncology, Stanford University, Stanford, CA, United States of America
| | - Debiao Li
- Department of Imaging, Biomedical Imaging Research Institute, Cedars Sinai Medical Center, Los Angeles, CA, United States of America
| | - Lei Xing
- Department of Radiation Oncology, Stanford University, Stanford, CA, United States of America
| | - Garry Gold
- Department of Radiation Oncology, Stanford University, Stanford, CA, United States of America; Department of Radiology, Stanford University, Stanford, CA, United States of America.
| |
Collapse
|