1
|
Wang S, Wu R, Jia S, Diakite A, Li C, Liu Q, Zheng H, Ying L. Knowledge-driven deep learning for fast MR imaging: Undersampled MR image reconstruction from supervised to un-supervised learning. Magn Reson Med 2024; 92:496-518. [PMID: 38624162 DOI: 10.1002/mrm.30105] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Revised: 03/19/2024] [Accepted: 03/20/2024] [Indexed: 04/17/2024]
Abstract
Deep learning (DL) has emerged as a leading approach in accelerating MRI. It employs deep neural networks to extract knowledge from available datasets and then applies the trained networks to reconstruct accurate images from limited measurements. Unlike natural image restoration problems, MRI involves physics-based imaging processes, unique data properties, and diverse imaging tasks. This domain knowledge needs to be integrated with data-driven approaches. Our review will introduce the significant challenges faced by such knowledge-driven DL approaches in the context of fast MRI along with several notable solutions, which include learning neural networks and addressing different imaging application scenarios. The traits and trends of these techniques have also been given which have shifted from supervised learning to semi-supervised learning, and finally, to unsupervised learning methods. In addition, MR vendors' choices of DL reconstruction have been provided along with some discussions on open questions and future directions, which are critical for the reliable imaging systems.
Collapse
Affiliation(s)
- Shanshan Wang
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Ruoyou Wu
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Sen Jia
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Alou Diakite
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Cheng Li
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Qiegen Liu
- Department of Electronic Information Engineering, Nanchang University, Nanchang, China
| | - Hairong Zheng
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Leslie Ying
- Department of Biomedical Engineering and Department of Electrical Engineering, The State University of New York, Buffalo, New York, USA
| |
Collapse
|
2
|
Pednekar A, Kocaoglu M, Wang H, Tanimoto A, Tkach JA, Lang S, Taylor MD. Accelerated Cine Cardiac MRI Using Deep Learning-Based Reconstruction: A Systematic Evaluation. J Magn Reson Imaging 2024; 60:640-650. [PMID: 37855257 DOI: 10.1002/jmri.29081] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Revised: 10/05/2023] [Accepted: 10/05/2023] [Indexed: 10/20/2023] Open
Abstract
BACKGROUND Breath-holding (BH) for cine balanced steady state free precession (bSSFP) imaging is challenging for patients with impaired BH capacity. Deep learning-based reconstruction (DLR) of undersampled k-space promises to shorten BHs while preserving image quality and accuracy of ventricular assessment. PURPOSE To perform a systematic evaluation of DLR of cine bSSFP images from undersampled k-space over a range of acceleration factors. STUDY TYPE Retrospective. SUBJECTS Fifteen pectus excavatum patients (mean age 16.8 ± 5.4 years, 20% female) with normal cardiac anatomy and function and 12-second BH capability. FIELD STRENGTH/SEQUENCE 1.5-T, cine bSSFP. ASSESSMENT Retrospective DLR was conducted by applying compressed sensitivity encoding (C-SENSE) acceleration to systematically undersample fully sampled k-space cine bSSFP acquisition data over an acceleration/undersampling factor (R) considering a range of 2 to 8. Quality imperceptibility (QI) measures, including structural similarity index measure, were calculated using images reconstructed from fully sampled k-space as a reference. Image quality, including contrast and edge definition, was evaluated for diagnostic adequacy by three readers with varying levels of experience in cardiac MRI (>4 years, >18 years, and 1 year). Automated DL-based biventricular segmentation was performed commercially available software by cardiac radiologists with more than 4 years of experience. STATISTICAL TESTS Tukey box plots, linear mixed effects model, analysis of variance (ANOVA), weighted kappa, Kruskal-Wallis test, and Wilcoxon signed-rank test were employed as appropriate. A P-value <0.05 was considered statistically significant. RESULTS There was a significant decrease in the QI values and edge definition scores as R increased. Diagnostically adequate image quality was observed up to R = 5. The effect of R on all biventricular volumetric indices was non-significant (P = 0.447). DATA CONCLUSION The biventricular volumetric indices obtained from the reconstruction of fully sampled cine bSSFP acquisitions and DLR of the same k-space data undersampled by C-SENSE up to R = 5 may be comparable. EVIDENCE LEVEL 3 TECHNICAL EFFICACY: Stage 1.
Collapse
Affiliation(s)
- Amol Pednekar
- Department of Radiology, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, USA
- Department of Radiology, University of Cincinnati College of Medicine, Cincinnati, Ohio, USA
| | - Murat Kocaoglu
- Department of Radiology, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, USA
- Department of Radiology, University of Cincinnati College of Medicine, Cincinnati, Ohio, USA
| | - Hui Wang
- Department of Radiology, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, USA
- Department of Radiology, University of Cincinnati College of Medicine, Cincinnati, Ohio, USA
- MR Clinical Science, Philips Healthcare, Cincinnati, Ohio, USA
| | - Aki Tanimoto
- Department of Radiology, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, USA
- Department of Radiology, University of Cincinnati College of Medicine, Cincinnati, Ohio, USA
| | - Jean A Tkach
- Department of Radiology, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, USA
- Department of Radiology, University of Cincinnati College of Medicine, Cincinnati, Ohio, USA
| | - Sean Lang
- The Heart Institute, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, USA
- Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio, USA
| | - Michael D Taylor
- The Heart Institute, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, USA
- Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio, USA
| |
Collapse
|
3
|
Ghoul A, Pan J, Lingg A, Kubler J, Krumm P, Hammernik K, Rueckert D, Gatidis S, Kustner T. Attention-Aware Non-Rigid Image Registration for Accelerated MR Imaging. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:3013-3026. [PMID: 39088484 DOI: 10.1109/tmi.2024.3385024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/03/2024]
Abstract
Accurate motion estimation at high acceleration factors enables rapid motion-compensated reconstruction in Magnetic Resonance Imaging (MRI) without compromising the diagnostic image quality. In this work, we introduce an attention-aware deep learning-based framework that can perform non-rigid pairwise registration for fully sampled and accelerated MRI. We extract local visual representations to build similarity maps between the registered image pairs at multiple resolution levels and additionally leverage long-range contextual information using a transformer-based module to alleviate ambiguities in the presence of artifacts caused by undersampling. We combine local and global dependencies to perform simultaneous coarse and fine motion estimation. The proposed method was evaluated on in-house acquired fully sampled and accelerated data of 101 patients and 62 healthy subjects undergoing cardiac and thoracic MRI. The impact of motion estimation accuracy on the downstream task of motion-compensated reconstruction was analyzed. We demonstrate that our model derives reliable and consistent motion fields across different sampling trajectories (Cartesian and radial) and acceleration factors of up to 16x for cardiac motion and 30x for respiratory motion and achieves superior image quality in motion-compensated reconstruction qualitatively and quantitatively compared to conventional and recent deep learning-based approaches. The code is publicly available at https://github.com/lab-midas/GMARAFT.
Collapse
|
4
|
Cheng H, Hou X, Huang G, Jia S, Yang G, Nie S. Feature Fusion for Multi-Coil Compressed MR Image Reconstruction. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024; 37:1969-1979. [PMID: 38459398 PMCID: PMC11300769 DOI: 10.1007/s10278-024-01057-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/30/2023] [Revised: 02/14/2024] [Accepted: 02/15/2024] [Indexed: 03/10/2024]
Abstract
Magnetic resonance imaging (MRI) occupies a pivotal position within contemporary diagnostic imaging modalities, offering non-invasive and radiation-free scanning. Despite its significance, MRI's principal limitation is the protracted data acquisition time, which hampers broader practical application. Promising deep learning (DL) methods for undersampled magnetic resonance (MR) image reconstruction outperform the traditional approaches in terms of speed and image quality. However, the intricate inter-coil correlations have been insufficiently addressed, leading to an underexploitation of the rich information inherent in multi-coil acquisitions. In this article, we proposed a method called "Multi-coil Feature Fusion Variation Network" (MFFVN), which introduces an encoder to extract the feature from multi-coil MR image directly and explicitly, followed by a feature fusion operation. Coil reshaping enables the 2D network to achieve satisfactory reconstruction results, while avoiding the introduction of a significant number of parameters and preserving inter-coil information. Compared with VN, MFFVN yields an improvement in the average PSNR and SSIM of the test set, registering enhancements of 0.2622 dB and 0.0021 dB respectively. This uplift can be attributed to the integration of feature extraction and fusion stages into the network's architecture, thereby effectively leveraging and combining the multi-coil information for enhanced image reconstruction quality. The proposed method outperforms the state-of-the-art methods on fastMRI dataset of multi-coil brains under a fourfold acceleration factor without incurring substantial computation overhead.
Collapse
Affiliation(s)
- Hang Cheng
- School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China
| | - Xuewen Hou
- Radiotherapy Business Unit, Shanghai United Imaging Healthcare Co., Ltd., Shanghai, 201807, China
| | - Gang Huang
- Shanghai Key Laboratory of Molecular Imaging, Shanghai University of Medicine and Health Sciences, Shanghai, 201318, China
| | - Shouqiang Jia
- Department of Radiology, Jinan People's Hospital Affiliated to Shandong First Medical University, Jinan Shandong, 271199, China.
| | - Guang Yang
- Shanghai Key Laboratory of Magnetic Resonance, Department of Physics, East China Normal University, Shanghai, 200062, China.
| | - Shengdong Nie
- School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China.
| |
Collapse
|
5
|
Koechli M, Callaghan FM, Burkhardt BEU, Lohézic M, Zhu X, Rücker B, Valsangiacomo Buechel ER, Kellenberger CJ, Geiger J. Accelerated cardiac magnetic resonance imaging using deep learning for volumetric assessment in children. Pediatr Radiol 2024:10.1007/s00247-024-05978-6. [PMID: 39017676 DOI: 10.1007/s00247-024-05978-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/20/2024] [Revised: 06/18/2024] [Accepted: 06/20/2024] [Indexed: 07/18/2024]
Abstract
BACKGROUND Ventricular volumetry using a short-axis stack of two-dimensional (D) cine balanced steady-state free precession (bSSFP) sequences is crucial in any cardiac magnetic resonance imaging (MRI) examination. This task becomes particularly challenging in children due to multiple breath-holds. OBJECTIVE To assess the diagnostic performance of accelerated 3-RR cine MRI sequences using deep learning reconstruction compared with standard 2-D cine bSSFP sequences. MATERIAL AND METHODS Twenty-nine consecutive patients (mean age 11 ± 5, median 12, range 1-17 years) undergoing cardiac MRI were scanned with a conventional segmented 2-D cine and a deep learning accelerated cine (three heartbeats) acquisition on a 1.5-tesla scanner. Short-axis volumetrics were performed (semi-)automatically in both datasets retrospectively by two experienced readers who visually assessed image quality employing a 4-point grading scale. Scan times and image quality were compared using the Wilcoxon rank-sum test. Volumetrics were assessed with linear regression and Bland-Altman analyses, and measurement agreement with intraclass correlation coefficient (ICC). RESULTS Mean acquisition time was significantly reduced with the 3-RR deep learning cine compared to the standard cine sequence (45.5 ± 13.8 s vs. 218.3 ± 44.8 s; P < 0.001). No significant differences in biventricular volumetrics were found. Left ventricular (LV) mass was increased in the deep learning cine compared with the standard cine sequence (71.4 ± 33.1 g vs. 69.9 ± 32.5 g; P < 0.05). All volumetric measurements had an excellent agreement with ICC > 0.9 except for ejection fraction (EF) (LVEF 0.81, RVEF 0.73). The image quality of deep learning cine images was decreased for end-diastolic and end-systolic contours, papillary muscles, and valve depiction (2.9 ± 0.5 vs. 3.5 ± 0.4; P < 0.05). CONCLUSION Deep learning cine volumetrics did not differ significantly from standard cine results except for LV mass, which was slightly overestimated with deep learning cine. Deep learning cine sequences result in a significant reduction in scan time with only slightly lower image quality.
Collapse
Affiliation(s)
- Melina Koechli
- Department of Diagnostic Imaging, University Children's Hospital Zurich, Zurich, Switzerland
- Children's Research Center, University Children's Hospital Zurich, Zurich, Switzerland
| | - Fraser M Callaghan
- Children's Research Center, University Children's Hospital Zurich, Zurich, Switzerland
- Center for MR-Research, University Children's Hospital Zurich, Zurich, Switzerland
| | - Barbara E U Burkhardt
- Children's Research Center, University Children's Hospital Zurich, Zurich, Switzerland
- Pediatric Heart Center, University Children's Hospital Zurich, Zurich, Switzerland
| | | | | | - Beate Rücker
- Children's Research Center, University Children's Hospital Zurich, Zurich, Switzerland
- Pediatric Heart Center, University Children's Hospital Zurich, Zurich, Switzerland
| | - Emanuela R Valsangiacomo Buechel
- Children's Research Center, University Children's Hospital Zurich, Zurich, Switzerland
- Pediatric Heart Center, University Children's Hospital Zurich, Zurich, Switzerland
| | - Christian J Kellenberger
- Department of Diagnostic Imaging, University Children's Hospital Zurich, Zurich, Switzerland
- Children's Research Center, University Children's Hospital Zurich, Zurich, Switzerland
| | - Julia Geiger
- Department of Diagnostic Imaging, University Children's Hospital Zurich, Zurich, Switzerland.
- Children's Research Center, University Children's Hospital Zurich, Zurich, Switzerland.
| |
Collapse
|
6
|
Yan C, Liu Y, Wang C, Fan W, Zhu Y. Accelerated cardiac cine magnetic resonance imaging using deep low-rank plus sparse network: validation in patients. Quant Imaging Med Surg 2024; 14:5131-5143. [PMID: 39022294 PMCID: PMC11250298 DOI: 10.21037/qims-24-17] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2024] [Accepted: 06/03/2024] [Indexed: 07/20/2024]
Abstract
Background Accurate and reproducible assessment of left ventricular (LV) volumes is important in managing various cardiac conditions. However, patients are required to hold their breath multiple times during data acquisition, which may result in discomfort and restrict cardiac motion, potentially compromising the accuracy of the detected results. Accelerated imaging techniques can help reduce the number of breath holds needed, potentially improving patient comfort and the reliability of the LV assessment. This study aimed to prospectively evaluate the feasibility and accuracy of LV assessment with a model-based low-rank plus sparse network (L+S-Net) for accelerated magnetic resonance (MR) cine imaging. Methods Fourty-one patients with different cardiac conditions were recruited in this study. Both accelerated MR cine imaging with L+S-Net and traditional electrocardiogram (ECG)-gated segmented cine were performed for each patient. Subjective image quality (IQ) score and quantitative LV volume function parameters were measured and compared between L+S-Net and traditional standards. The IQ score and LV volume measurements of cardiovascular magnetic resonance (CMR) images reconstructed by L+S-Net and standard cine were compared by paired t-test. The acquisition time of the two methods was also calculated. Results In a quantitative analysis, L+S-Net and standard cine yielded similar measurements for all parameters of LV function (ejection fraction: 35±22 for standard vs. 33±23 for L+S-Net), although L+S-Net had slightly lower IQ scores than standard cine CMR (4.2±0.5 for L+S-Net vs. 4.8±0.4 for standard cine; P<0.001). The mean acquisition time of L+S-Net and standard cine was 0.83±0.08 vs. 6.35±0.78 s per slice (P<0.001). Conclusions Assessment of LV function with L+S-Net at 3.0 T yields comparable results to the reference standard, albeit with a reduced acquisition time. This feature enhances the clinical applicability of the L+S-Net approach, helping alleviate patient discomfort and motion artifacts that may arise due to prolonged acquisition time.
Collapse
Affiliation(s)
- Chenyuan Yan
- Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Yuanyuan Liu
- Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Che Wang
- Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Weixiong Fan
- Department of Magnetic Resonance, Guangdong Provincial Key Laboratory of Precision Medicine and Clinical Translational Research of Hakka Population, Meizhou People’s Hospital, Meizhou, China
| | - Yanjie Zhu
- Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| |
Collapse
|
7
|
Pan J, Huang W, Rueckert D, Kustner T, Hammernik K. Motion-Compensated MR CINE Reconstruction With Reconstruction-Driven Motion Estimation. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:2420-2433. [PMID: 38354077 DOI: 10.1109/tmi.2024.3364504] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/16/2024]
Abstract
In cardiac CINE, motion-compensated MR reconstruction (MCMR) is an effective approach to address highly undersampled acquisitions by incorporating motion information between frames. In this work, we propose a novel perspective for addressing the MCMR problem and a more integrated and efficient solution to the MCMR field. Contrary to state-of-the-art (SOTA) MCMR methods which break the original problem into two sub-optimization problems, i.e. motion estimation and reconstruction, we formulate this problem as a single entity with one single optimization. Our approach is unique in that the motion estimation is directly driven by the ultimate goal, reconstruction, but not by the canonical motion-warping loss (similarity measurement between motion-warped images and target images). We align the objectives of motion estimation and reconstruction, eliminating the drawbacks of artifacts-affected motion estimation and therefore error-propagated reconstruction. Further, we can deliver high-quality reconstruction and realistic motion without applying any regularization/smoothness loss terms, circumventing the non-trivial weighting factor tuning. We evaluate our method on two datasets: 1) an in-house acquired 2D CINE dataset for the retrospective study and 2) the public OCMR cardiac dataset for the prospective study. The conducted experiments indicate that the proposed MCMR framework can deliver artifact-free motion estimation and high-quality MR images even for imaging accelerations up to 20x, outperforming SOTA non-MCMR and MCMR methods in both qualitative and quantitative evaluation across all experiments. The code is available at https://github.com/JZPeterPan/MCMR-Recon-Driven-Motion.
Collapse
|
8
|
Heckel R, Jacob M, Chaudhari A, Perlman O, Shimron E. Deep learning for accelerated and robust MRI reconstruction. MAGMA (NEW YORK, N.Y.) 2024; 37:335-368. [PMID: 39042206 DOI: 10.1007/s10334-024-01173-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/03/2024] [Revised: 05/24/2024] [Accepted: 05/28/2024] [Indexed: 07/24/2024]
Abstract
Deep learning (DL) has recently emerged as a pivotal technology for enhancing magnetic resonance imaging (MRI), a critical tool in diagnostic radiology. This review paper provides a comprehensive overview of recent advances in DL for MRI reconstruction, and focuses on various DL approaches and architectures designed to improve image quality, accelerate scans, and address data-related challenges. It explores end-to-end neural networks, pre-trained and generative models, and self-supervised methods, and highlights their contributions to overcoming traditional MRI limitations. It also discusses the role of DL in optimizing acquisition protocols, enhancing robustness against distribution shifts, and tackling biases. Drawing on the extensive literature and practical insights, it outlines current successes, limitations, and future directions for leveraging DL in MRI reconstruction, while emphasizing the potential of DL to significantly impact clinical imaging practices.
Collapse
Affiliation(s)
- Reinhard Heckel
- Department of computer engineering, Technical University of Munich, Munich, Germany
| | - Mathews Jacob
- Department of Electrical and Computer Engineering, University of Iowa, Iowa, 52242, IA, USA
| | - Akshay Chaudhari
- Department of Radiology, Stanford University, Stanford, 94305, CA, USA
- Department of Biomedical Data Science, Stanford University, Stanford, 94305, CA, USA
| | - Or Perlman
- Department of Biomedical Engineering, Tel Aviv University, Tel Aviv, Israel
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel
| | - Efrat Shimron
- Department of Electrical and Computer Engineering, Technion-Israel Institute of Technology, Haifa, 3200004, Israel.
- Department of Biomedical Engineering, Technion-Israel Institute of Technology, Haifa, 3200004, Israel.
| |
Collapse
|
9
|
Küstner T, Hammernik K, Rueckert D, Hepp T, Gatidis S. Predictive uncertainty in deep learning-based MR image reconstruction using deep ensembles: Evaluation on the fastMRI data set. Magn Reson Med 2024; 92:289-302. [PMID: 38282254 DOI: 10.1002/mrm.30030] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2023] [Revised: 12/08/2023] [Accepted: 01/10/2024] [Indexed: 01/30/2024]
Abstract
PURPOSE To estimate pixel-wise predictive uncertainty for deep learning-based MR image reconstruction and to examine the impact of domain shifts and architecture robustness. METHODS Uncertainty prediction could provide a measure for robustness of deep learning (DL)-based MR image reconstruction from undersampled data. DL methods bear the risk of inducing reconstruction errors like in-painting of unrealistic structures or missing pathologies. These errors may be obscured by visual realism of DL reconstruction and thus remain undiscovered. Furthermore, most methods are task-agnostic and not well calibrated to domain shifts. We propose a strategy that estimates aleatoric (data) and epistemic (model) uncertainty, which entails training a deep ensemble (epistemic) with nonnegative log-likelihood (aleatoric) loss in addition to the conventional applied losses terms. The proposed procedure can be paired with any DL reconstruction, enabling investigations of their predictive uncertainties on a pixel level. Five different architectures were investigated on the fastMRI database. The impact on the examined uncertainty of in-distributional and out-of-distributional data with changes to undersampling pattern, imaging contrast, imaging orientation, anatomy, and pathology were explored. RESULTS Predictive uncertainty could be captured and showed good correlation to normalized mean squared error. Uncertainty was primarily focused along the aliased anatomies and on hyperintense and hypointense regions. The proposed uncertainty measure was able to detect disease prevalence shifts. Distinct predictive uncertainty patterns were observed for changing network architectures. CONCLUSION The proposed approach enables aleatoric and epistemic uncertainty prediction for DL-based MR reconstruction with an interpretable examination on a pixel level.
Collapse
Affiliation(s)
- Thomas Küstner
- Medical Image and Data Analysis (MIDAS.lab), Department of Diagnostic and Interventional Radiology, University Hospital of Tuebingen, Tübingen, Germany
| | - Kerstin Hammernik
- School of Computation, Information and Technology, Klinikum rechts der Isar, Technical University of Munich, Munich, Germany
- School of Medicine, Klinikum Rechts der Isar, Technical University of Munich, Munich, Germany
| | - Daniel Rueckert
- School of Computation, Information and Technology, Klinikum rechts der Isar, Technical University of Munich, Munich, Germany
- School of Medicine, Klinikum Rechts der Isar, Technical University of Munich, Munich, Germany
- Department of Computing, Imperial College London, London, UK
| | - Tobias Hepp
- Medical Image and Data Analysis (MIDAS.lab), Department of Diagnostic and Interventional Radiology, University Hospital of Tuebingen, Tübingen, Germany
| | - Sergios Gatidis
- Medical Image and Data Analysis (MIDAS.lab), Department of Diagnostic and Interventional Radiology, University Hospital of Tuebingen, Tübingen, Germany
| |
Collapse
|
10
|
Villegas-Martinez M, de Villedon de Naide V, Muthurangu V, Bustin A. The beating heart: artificial intelligence for cardiovascular application in the clinic. MAGMA (NEW YORK, N.Y.) 2024; 37:369-382. [PMID: 38907767 DOI: 10.1007/s10334-024-01180-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/26/2023] [Revised: 04/25/2024] [Accepted: 06/13/2024] [Indexed: 06/24/2024]
Abstract
Artificial intelligence (AI) integration in cardiac magnetic resonance imaging presents new and exciting avenues for advancing patient care, automating post-processing tasks, and enhancing diagnostic precision and outcomes. The use of AI significantly streamlines the examination workflow through the reduction of acquisition and postprocessing durations, coupled with the automation of scan planning and acquisition parameters selection. This has led to a notable improvement in examination workflow efficiency, a reduction in operator variability, and an enhancement in overall image quality. Importantly, AI unlocks new possibilities to achieve spatial resolutions that were previously unattainable in patients. Furthermore, the potential for low-dose and contrast-agent-free imaging represents a stride toward safer and more patient-friendly diagnostic procedures. Beyond these benefits, AI facilitates precise risk stratification and prognosis evaluation by adeptly analysing extensive datasets. This comprehensive review article explores recent applications of AI in the realm of cardiac magnetic resonance imaging, offering insights into its transformative potential in the field.
Collapse
Affiliation(s)
- Manuel Villegas-Martinez
- IHU LIRYC, Electrophysiology and Heart Modeling Institute, Hôpital Xavier Arnozan, Université de Bordeaux-INSERM U1045, Avenue du Haut Lévêque, 33604, Pessac, France
- Department of Cardiovascular Imaging, Hôpital Cardiologique du Haut-Lévêque, CHU de Bordeaux, Avenue de Magellan, 33604, Pessac, France
| | - Victor de Villedon de Naide
- IHU LIRYC, Electrophysiology and Heart Modeling Institute, Hôpital Xavier Arnozan, Université de Bordeaux-INSERM U1045, Avenue du Haut Lévêque, 33604, Pessac, France
- Department of Cardiovascular Imaging, Hôpital Cardiologique du Haut-Lévêque, CHU de Bordeaux, Avenue de Magellan, 33604, Pessac, France
| | - Vivek Muthurangu
- Center for Cardiovascular Imaging, UCL Institute of Cardiovascular Science, University College London, London, WC1N 1EH, UK
| | - Aurélien Bustin
- IHU LIRYC, Electrophysiology and Heart Modeling Institute, Hôpital Xavier Arnozan, Université de Bordeaux-INSERM U1045, Avenue du Haut Lévêque, 33604, Pessac, France.
- Department of Cardiovascular Imaging, Hôpital Cardiologique du Haut-Lévêque, CHU de Bordeaux, Avenue de Magellan, 33604, Pessac, France.
- Department of Diagnostic and Interventional Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland.
| |
Collapse
|
11
|
Aromiwura AA, Cavalcante JL, Kwong RY, Ghazipour A, Amini A, Bax J, Raman S, Pontone G, Kalra DK. The role of artificial intelligence in cardiovascular magnetic resonance imaging. Prog Cardiovasc Dis 2024:S0033-0620(24)00092-6. [PMID: 38925255 DOI: 10.1016/j.pcad.2024.06.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/23/2024] [Accepted: 06/23/2024] [Indexed: 06/28/2024]
Abstract
Cardiovascular magnetic resonance (CMR) imaging is the gold standard test for myocardial tissue characterization and chamber volumetric and functional evaluation. However, manual CMR analysis can be time-consuming and is subject to intra- and inter-observer variability. Artificial intelligence (AI) is a field that permits automated task performance through the identification of high-level and complex data relationships. In this review, we review the rapidly growing role of AI in CMR, including image acquisition, sequence prescription, artifact detection, reconstruction, segmentation, and data reporting and analysis including quantification of volumes, function, myocardial infarction (MI) and scar detection, and prediction of outcomes. We conclude with a discussion of the emerging challenges to widespread adoption and solutions that will allow for successful, broader uptake of this powerful technology.
Collapse
Affiliation(s)
| | | | - Raymond Y Kwong
- Division of Cardiovascular Medicine, Brigham and Women's Hospital, Boston, MA, USA
| | - Aryan Ghazipour
- Medical Imaging Laboratory, Department of Electrical and Computer Engineering, University of Louisville, Louisville, KY, USA
| | - Amir Amini
- Medical Imaging Laboratory, Department of Electrical and Computer Engineering, University of Louisville, Louisville, KY, USA
| | - Jeroen Bax
- Department of Cardiology, Leiden University, Leiden, the Netherlands
| | - Subha Raman
- Division of Cardiology, Indiana University School of Medicine, Indianapolis, IN, USA
| | - Gianluca Pontone
- Department of Cardiology and Cardiovascular Imaging, Centro Cardiologico Monzino IRCCS, University of Milan, Milan, Italy
| | - Dinesh K Kalra
- Division of Cardiology, Department of Medicine, University of Louisville, Louisville, KY, USA; Center for Artificial Intelligence in Radiological Sciences (CAIRS), Department of Radiology, University of Louisville, Louisville, KY, USA.
| |
Collapse
|
12
|
Zhang Q, Fotaki A, Ghadimi S, Wang Y, Doneva M, Wetzl J, Delfino JG, O'Regan DP, Prieto C, Epstein FH. Improving the efficiency and accuracy of cardiovascular magnetic resonance with artificial intelligence-review of evidence and proposition of a roadmap to clinical translation. J Cardiovasc Magn Reson 2024; 26:101051. [PMID: 38909656 DOI: 10.1016/j.jocmr.2024.101051] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2024] [Revised: 06/09/2024] [Accepted: 06/18/2024] [Indexed: 06/25/2024] Open
Abstract
BACKGROUND Cardiovascular magnetic resonance (CMR) is an important imaging modality for the assessment of heart disease; however, limitations of CMR include long exam times and high complexity compared to other cardiac imaging modalities. Recently advancements in artificial intelligence (AI) technology have shown great potential to address many CMR limitations. While the developments are remarkable, translation of AI-based methods into real-world CMR clinical practice remains at a nascent stage and much work lies ahead to realize the full potential of AI for CMR. METHODS Herein we review recent cutting-edge and representative examples demonstrating how AI can advance CMR in areas such as exam planning, accelerated image reconstruction, post-processing, quality control, classification and diagnosis. RESULTS These advances can be applied to speed up and simplify essentially every application including cine, strain, late gadolinium enhancement, parametric mapping, 3D whole heart, flow, perfusion and others. AI is a unique technology based on training models using data. Beyond reviewing the literature, this paper discusses important AI-specific issues in the context of CMR, including (1) properties and characteristics of datasets for training and validation, (2) previously published guidelines for reporting CMR AI research, (3) considerations around clinical deployment, (4) responsibilities of clinicians and the need for multi-disciplinary teams in the development and deployment of AI in CMR, (5) industry considerations, and (6) regulatory perspectives. CONCLUSIONS Understanding and consideration of all these factors will contribute to the effective and ethical deployment of AI to improve clinical CMR.
Collapse
Affiliation(s)
- Qiang Zhang
- Oxford Centre for Clinical Magnetic Resonance Research, Division of Cardiovascular Medicine, Radcliffe Department of Medicine, University of Oxford, Oxford, UK; Big Data Institute, University of Oxford, Oxford, UK.
| | - Anastasia Fotaki
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK; Royal Brompton Hospital, Guy's and St Thomas' NHS Foundation Trust, London, UK.
| | - Sona Ghadimi
- Department of Biomedical Engineering, University of Virginia, Charlottesville, VA, USA.
| | - Yu Wang
- Department of Biomedical Engineering, University of Virginia, Charlottesville, VA, USA.
| | | | - Jens Wetzl
- Siemens Healthineers AG, Erlangen, Germany.
| | - Jana G Delfino
- US Food and Drug Administration, Center for Devices and Radiological Health (CDRH), Office of Science and Engineering Laboratories (OSEL), Silver Spring, MD, USA.
| | - Declan P O'Regan
- MRC Laboratory of Medical Sciences, Imperial College London, London, UK.
| | - Claudia Prieto
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK; School of Engineering, Pontificia Universidad Católica de Chile, Santiago, Chile.
| | - Frederick H Epstein
- Department of Biomedical Engineering, University of Virginia, Charlottesville, VA, USA.
| |
Collapse
|
13
|
Akai H, Yasaka K, Sugawara H, Furuta T, Tajima T, Kato S, Yamaguchi H, Ohtomo K, Abe O, Kiryu S. Faster acquisition of magnetic resonance imaging sequences of the knee via deep learning reconstruction: a volunteer study. Clin Radiol 2024; 79:453-459. [PMID: 38614869 DOI: 10.1016/j.crad.2024.03.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Revised: 12/29/2023] [Accepted: 03/02/2024] [Indexed: 04/15/2024]
Abstract
AIM To evaluate whether deep learning reconstruction (DLR) can accelerate the acquisition of magnetic resonance imaging (MRI) sequences of the knee for clinical use. MATERIALS AND METHODS Using a 1.5-T MRI scanner, sagittal fat-suppressed T2-weighted imaging (fs-T2WI), coronal proton density-weighted imaging (PDWI), and coronal T1-weighted imaging (T1WI) were performed. DLR was applied to images with a number of signal averages (NSA) of 1 to obtain 1DLR images. Then 1NSA, 1DLR, and 4NSA images were compared subjectively, and by noise (standard deviation of intra-articular water or medial meniscus) and contrast-to-noise ratio between two anatomical structures or between an anatomical structure and intra-articular water. RESULTS Twenty-seven healthy volunteers (age: 40.6 ± 11.9 years) were enrolled. Three 1DLR image sequences were obtained within 200 s (approximately 12 minutes for 4NSA image). According to objective evaluations, PDWI 1DLR images showed the smallest noise and significantly higher contrast than 1NSA and 4NSA images. For fs-T2WI, smaller noise and higher contrast were observed in the order of 4NSA, 1DLR, and 1NSA images. According to the subjective analysis, structure visibility, image noise, and overall image quality were significantly better for PDWI 1DLR than 1NSA images; moreover, the visibility of the meniscus and bone, image noise, and overall image quality were significantly better for 1DLR than 4NSA images. Fs-T2WI and T1WI 1DLR images showed no difference between 1DLR and 4NSA images. CONCLUSION Compared to PDWI 4NSA images, PDWI 1DLR images were of higher quality, while the quality of fs-T2WI and T1WI 1DLR images was similar to that of 4NSA images.
Collapse
Affiliation(s)
- H Akai
- Department of Radiology, Institute of Medical Science, University of Tokyo, 4-6-1 Shirokanedai, Minato-ku, Tokyo, 108-8639, Japan; Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda, Narita, Chiba, 286-0124, Japan
| | - K Yasaka
- Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda, Narita, Chiba, 286-0124, Japan; Department of Radiology, Graduate School of Medicine, University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8655, Japan
| | - H Sugawara
- Department of Diagnostic Radiology, McGill University, 1650 Cedar Avenue, Montreal, Quebec, H3G 1A4, Canada
| | - T Furuta
- Department of Radiology, Institute of Medical Science, University of Tokyo, 4-6-1 Shirokanedai, Minato-ku, Tokyo, 108-8639, Japan
| | - T Tajima
- Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda, Narita, Chiba, 286-0124, Japan; Department of Radiology, International University of Health and Welfare Mita Hospital, 1-4-3 Mita, Minato-ku, Tokyo, 108-8329, Japan
| | - S Kato
- Department of Radiology, Institute of Medical Science, University of Tokyo, 4-6-1 Shirokanedai, Minato-ku, Tokyo, 108-8639, Japan
| | - H Yamaguchi
- Department of Radiology, Institute of Medical Science, University of Tokyo, 4-6-1 Shirokanedai, Minato-ku, Tokyo, 108-8639, Japan
| | - K Ohtomo
- International University of Health and Welfare, 2600-1 Kiakanemaru, Ohtawara, Tochigi, 324-8501, Japan
| | - O Abe
- Department of Radiology, Graduate School of Medicine, University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8655, Japan
| | - S Kiryu
- Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda, Narita, Chiba, 286-0124, Japan.
| |
Collapse
|
14
|
Lee JH, Kim JY, Ryu K, Al-Masni MA, Kim TH, Han D, Kim HG, Kim DH. JUST-Net: Jointly unrolled cross-domain optimization based spatio-temporal reconstruction network for accelerated 3D myelin water imaging. Magn Reson Med 2024; 91:2483-2497. [PMID: 38342983 DOI: 10.1002/mrm.30021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2023] [Revised: 01/08/2024] [Accepted: 01/08/2024] [Indexed: 02/13/2024]
Abstract
PURPOSE We introduced a novel reconstruction network, jointly unrolled cross-domain optimization-based spatio-temporal reconstruction network (JUST-Net), aimed at accelerating 3D multi-echo gradient-echo (mGRE) data acquisition and improving the quality of resulting myelin water imaging (MWI) maps. METHOD An unrolled cross-domain spatio-temporal reconstruction network was designed. The main idea is to combine frequency and spatio-temporal image feature representations and to sequentially implement convolution layers in both domains. The k-space subnetwork utilizes shared information from adjacent frames, whereas the image subnetwork applies separate convolutions in both spatial and temporal dimensions. The proposed reconstruction network was evaluated for both retrospectively and prospectively accelerated acquisition. Furthermore, it was assessed in simulation studies and real-world cases with k-space corruptions to evaluate its potential for motion artifact reduction. RESULTS The proposed JUST-Net enabled highly reproducible and accelerated 3D mGRE acquisition for whole-brain MWI, reducing the acquisition time from fully sampled 15:23 to 2:22 min within a 3-min reconstruction time. The normalized root mean squared error of the reconstructed mGRE images increased by less than 4.0%, and the correlation coefficients for MWI showed a value of over 0.68 when compared to the fully sampled reference. Additionally, the proposed method demonstrated a mitigating effect on both simulated and clinical motion-corrupted cases. CONCLUSION The proposed JUST-Net has demonstrated the capability to achieve high acceleration factors for 3D mGRE-based MWI, which is expected to facilitate widespread clinical applications of MWI.
Collapse
Affiliation(s)
- Jae-Hun Lee
- Department of Electrical and Electronic Engineering, Yonsei University, Seoul, Republic of Korea
- Artificial Intelligence and Robotics Institute, Korea Institute of Science and Technology, Seoul, Republic of Korea
| | - Jae-Yoon Kim
- Department of Electrical and Electronic Engineering, Yonsei University, Seoul, Republic of Korea
| | - Kanghyun Ryu
- Artificial Intelligence and Robotics Institute, Korea Institute of Science and Technology, Seoul, Republic of Korea
| | - Mohammed A Al-Masni
- Department of Artificial Intelligence, Sejong University, Seoul, Republic of Korea
| | - Tae Hyung Kim
- Department of Computer Engineering, Hongik University, Seoul, Republic of Korea
| | - Dongyeob Han
- Siemens Healthineers Ltd, Seoul, Republic of Korea
| | - Hyun Gi Kim
- Department of Radiology, Eunpyeong St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| | - Dong-Hyun Kim
- Department of Electrical and Electronic Engineering, Yonsei University, Seoul, Republic of Korea
| |
Collapse
|
15
|
Giannakopoulos II, Muckley MJ, Kim J, Breen M, Johnson PM, Lui YW, Lattanzi R. Accelerated MRI reconstructions via variational network and feature domain learning. Sci Rep 2024; 14:10991. [PMID: 38744904 PMCID: PMC11094153 DOI: 10.1038/s41598-024-59705-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Accepted: 04/15/2024] [Indexed: 05/16/2024] Open
Abstract
We introduce three architecture modifications to enhance the performance of the end-to-end (E2E) variational network (VarNet) for undersampled MRI reconstructions. We first implemented the Feature VarNet, which propagates information throughout the cascades of the network in an N-channel feature-space instead of a 2-channel feature-space. Then, we add an attention layer that utilizes the spatial locations of Cartesian undersampling artifacts to further improve performance. Lastly, we combined the Feature and E2E VarNets into the Feature-Image (FI) VarNet, to facilitate cross-domain learning and boost accuracy. Reconstructions were evaluated on the fastMRI dataset using standard metrics and clinical scoring by three neuroradiologists. Feature and FI VarNets outperformed the E2E VarNet for 4 × , 5 × and 8 × Cartesian undersampling in all studied metrics. FI VarNet secured second place in the public fastMRI leaderboard for 4 × Cartesian undersampling, outperforming all open-source models in the leaderboard. Radiologists rated FI VarNet brain reconstructions with higher quality and sharpness than the E2E VarNet reconstructions. FI VarNet excelled in preserving anatomical details, including blood vessels, whereas E2E VarNet discarded or blurred them in some cases. The proposed FI VarNet enhances the reconstruction quality of undersampled MRI and could enable clinically acceptable reconstructions at higher acceleration factors than currently possible.
Collapse
Affiliation(s)
- Ilias I Giannakopoulos
- Department of Radiology, The Bernard and Irene Schwartz Center for Biomedical Imaging, New York University Grossman School of Medicine, New York, NY, 10016, USA.
| | | | - Jesi Kim
- Department of Radiology, The Bernard and Irene Schwartz Center for Biomedical Imaging, New York University Grossman School of Medicine, New York, NY, 10016, USA
| | - Matthew Breen
- Department of Radiology, The Bernard and Irene Schwartz Center for Biomedical Imaging, New York University Grossman School of Medicine, New York, NY, 10016, USA
| | - Patricia M Johnson
- Department of Radiology, The Bernard and Irene Schwartz Center for Biomedical Imaging, New York University Grossman School of Medicine, New York, NY, 10016, USA
- Department of Radiology, Center for Advanced Imaging Innovation and Research (CAI2R), New York University Grossman School of Medicine, New York, NY, 10016, USA
- Vilcek Institute of Graduate Biomedical Sciences, New York University Grossman School of Medicine, New York, NY, 10016, USA
| | - Yvonne W Lui
- Department of Radiology, The Bernard and Irene Schwartz Center for Biomedical Imaging, New York University Grossman School of Medicine, New York, NY, 10016, USA
- Department of Radiology, Center for Advanced Imaging Innovation and Research (CAI2R), New York University Grossman School of Medicine, New York, NY, 10016, USA
- Vilcek Institute of Graduate Biomedical Sciences, New York University Grossman School of Medicine, New York, NY, 10016, USA
| | - Riccardo Lattanzi
- Department of Radiology, The Bernard and Irene Schwartz Center for Biomedical Imaging, New York University Grossman School of Medicine, New York, NY, 10016, USA
- Department of Radiology, Center for Advanced Imaging Innovation and Research (CAI2R), New York University Grossman School of Medicine, New York, NY, 10016, USA
- Vilcek Institute of Graduate Biomedical Sciences, New York University Grossman School of Medicine, New York, NY, 10016, USA
| |
Collapse
|
16
|
Li Z, Xiao S, Wang C, Li H, Zhao X, Duan C, Zhou Q, Rao Q, Fang Y, Xie J, Shi L, Guo F, Ye C, Zhou X. Encoding Enhanced Complex CNN for Accurate and Highly Accelerated MRI. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:1828-1840. [PMID: 38194397 DOI: 10.1109/tmi.2024.3351211] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/11/2024]
Abstract
Magnetic resonance imaging (MRI) using hyperpolarized noble gases provides a way to visualize the structure and function of human lung, but the long imaging time limits its broad research and clinical applications. Deep learning has demonstrated great potential for accelerating MRI by reconstructing images from undersampled data. However, most existing deep convolutional neural networks (CNN) directly apply square convolution to k-space data without considering the inherent properties of k-space sampling, limiting k-space learning efficiency and image reconstruction quality. In this work, we propose an encoding enhanced (EN2) complex CNN for highly undersampled pulmonary MRI reconstruction. EN2 complex CNN employs convolution along either the frequency or phase-encoding direction, resembling the mechanisms of k-space sampling, to maximize the utilization of the encoding correlation and integrity within a row or column of k-space. We also employ complex convolution to learn rich representations from the complex k-space data. In addition, we develop a feature-strengthened modularized unit to further boost the reconstruction performance. Experiments demonstrate that our approach can accurately reconstruct hyperpolarized 129Xe and 1H lung MRI from 6-fold undersampled k-space data and provide lung function measurements with minimal biases compared with fully sampled images. These results demonstrate the effectiveness of the proposed algorithmic components and indicate that the proposed approach could be used for accelerated pulmonary MRI in research and clinical lung disease patient care.
Collapse
|
17
|
Onnis C, van Assen M, Muscogiuri E, Muscogiuri G, Gershon G, Saba L, De Cecco CN. The Role of Artificial Intelligence in Cardiac Imaging. Radiol Clin North Am 2024; 62:473-488. [PMID: 38553181 DOI: 10.1016/j.rcl.2024.01.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/02/2024]
Abstract
Artificial intelligence (AI) is having a significant impact in medical imaging, advancing almost every aspect of the field, from image acquisition and postprocessing to automated image analysis with outreach toward supporting decision making. Noninvasive cardiac imaging is one of the main and most exciting fields for AI development. The aim of this review is to describe the main applications of AI in cardiac imaging, including CT and MR imaging, and provide an overview of recent advancements and available clinical applications that can improve clinical workflow, disease detection, and prognostication in cardiac disease.
Collapse
Affiliation(s)
- Carlotta Onnis
- Translational Laboratory for Cardiothoracic Imaging and Artificial Intelligence, Department of Radiology and Imaging Sciences, Emory University, 100 Woodruff Circle, Atlanta, GA 30322, USA; Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), di Cagliari-Polo di Monserrato, SS 554 km 4,500 Monserrato, Cagliari 09042, Italy. https://twitter.com/CarlottaOnnis
| | - Marly van Assen
- Translational Laboratory for Cardiothoracic Imaging and Artificial Intelligence, Department of Radiology and Imaging Sciences, Emory University, 100 Woodruff Circle, Atlanta, GA 30322, USA. https://twitter.com/marly_van_assen
| | - Emanuele Muscogiuri
- Translational Laboratory for Cardiothoracic Imaging and Artificial Intelligence, Department of Radiology and Imaging Sciences, Emory University, 100 Woodruff Circle, Atlanta, GA 30322, USA; Division of Thoracic Imaging, Department of Radiology, University Hospitals Leuven, Herestraat 49, Leuven 3000, Belgium
| | - Giuseppe Muscogiuri
- Department of Diagnostic and Interventional Radiology, Papa Giovanni XXIII Hospital, Piazza OMS, 1, Bergamo BG 24127, Italy. https://twitter.com/GiuseppeMuscog
| | - Gabrielle Gershon
- Translational Laboratory for Cardiothoracic Imaging and Artificial Intelligence, Department of Radiology and Imaging Sciences, Emory University, 100 Woodruff Circle, Atlanta, GA 30322, USA. https://twitter.com/gabbygershon
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), di Cagliari-Polo di Monserrato, SS 554 km 4,500 Monserrato, Cagliari 09042, Italy. https://twitter.com/lucasabaITA
| | - Carlo N De Cecco
- Translational Laboratory for Cardiothoracic Imaging and Artificial Intelligence, Department of Radiology and Imaging Sciences, Emory University, 100 Woodruff Circle, Atlanta, GA 30322, USA; Division of Cardiothoracic Imaging, Department of Radiology and Imaging Sciences, Emory University, Emory University Hospital, 1365 Clifton Road Northeast, Suite AT503, Atlanta, GA 30322, USA.
| |
Collapse
|
18
|
Pieroni M, Namdar M, Olivotto I, Desnick RJ. Anderson-Fabry disease management: role of the cardiologist. Eur Heart J 2024; 45:1395-1409. [PMID: 38486361 DOI: 10.1093/eurheartj/ehae148] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/03/2023] [Revised: 02/04/2024] [Accepted: 02/27/2024] [Indexed: 04/22/2024] Open
Abstract
Anderson-Fabry disease (AFD) is a lysosomal storage disorder characterized by glycolipid accumulation in cardiac cells, associated with a peculiar form of hypertrophic cardiomyopathy (HCM). Up to 1% of patients with a diagnosis of HCM indeed have AFD. With the availability of targeted therapies for sarcomeric HCM and its genocopies, a timely differential diagnosis is essential. Specifically, the therapeutic landscape for AFD is rapidly evolving and offers increasingly effective, disease-modifying treatment options. However, diagnosing AFD may be difficult, particularly in the non-classic phenotype with prominent or isolated cardiac involvement and no systemic red flags. For many AFD patients, the clinical journey from initial clinical manifestations to diagnosis and appropriate treatment remains challenging, due to late recognition or utter neglect. Consequently, late initiation of treatment results in an exacerbation of cardiac involvement, representing the main cause of morbidity and mortality, irrespective of gender. Optimal management of AFD patients requires a dedicated multidisciplinary team, in which the cardiologist plays a decisive role, ranging from the differential diagnosis to the prevention of complications and the evaluation of timing for disease-specific therapies. The present review aims to redefine the role of cardiologists across the main decision nodes in contemporary AFD clinical care and drug discovery.
Collapse
Affiliation(s)
- Maurizio Pieroni
- Cardiovascular Department, San Donato Hospital, Via Pietro Nenni 22, 52100 Arezzo, Italy
| | - Mehdi Namdar
- Cardiology Division, Hôpitaux Universitaires de Genève, Geneva, Switzerland
| | - Iacopo Olivotto
- Cardiomyopathy Unit, Careggi Hospital and Meyer Children's Hospital IRCCS, Florence, Italy
- Department of Experimental and Clinical Medicine, University of Florence, Florence, Italy
| | - Robert J Desnick
- Department of Genetics and Genomic Sciences, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| |
Collapse
|
19
|
Li S, Wang Z, Ding Z, She H, Du YP. Accelerated four-dimensional free-breathing whole-liver water-fat magnetic resonance imaging with deep dictionary learning and chemical shift modeling. Quant Imaging Med Surg 2024; 14:2884-2903. [PMID: 38617145 PMCID: PMC11007520 DOI: 10.21037/qims-23-1396] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2023] [Accepted: 02/13/2024] [Indexed: 04/16/2024]
Abstract
Background Multi-echo chemical-shift-encoded magnetic resonance imaging (MRI) has been widely used for fat quantification and fat suppression in clinical liver examinations. Clinical liver water-fat imaging typically requires breath-hold acquisitions, with the free-breathing acquisition method being more desirable for patient comfort. However, the acquisition for free-breathing imaging could take up to several minutes. The purpose of this study is to accelerate four-dimensional free-breathing whole-liver water-fat MRI by jointly using high-dimensional deep dictionary learning and model-guided (MG) reconstruction. Methods A high-dimensional model-guided deep dictionary learning (HMDDL) algorithm is proposed for the acceleration. The HMDDL combines the powers of the high-dimensional dictionary learning neural network (hdDLNN) and the chemical shift model. The neural network utilizes the prior information of the dynamic multi-echo data in spatial respiratory motion, and echo dimensions to exploit the features of images. The chemical shift model is used to guide the reconstruction of field maps, R 2 ∗ maps, water images, and fat images. Data acquired from ten healthy subjects and ten subjects with clinically diagnosed nonalcoholic fatty liver disease (NAFLD) were selected for training. Data acquired from one healthy subject and two NAFLD subjects were selected for validation. Data acquired from five healthy subjects and five NAFLD subjects were selected for testing. A three-dimensional (3D) blipped golden-angle stack-of-stars multi-gradient-echo pulse sequence was designed to accelerate the data acquisition. The retrospectively undersampled data were used for training, and the prospectively undersampled data were used for testing. The performance of the HMDDL was evaluated in comparison with the compressed sensing-based water-fat separation (CS-WF) algorithm and a parallel non-Cartesian recurrent neural network (PNCRNN) algorithm. Results Four-dimensional water-fat images with ten motion states for whole-liver are demonstrated at several R values. In comparison with the CS-WF and PNCRNN, the HMDDL improved the mean peak signal-to-noise ratio (PSNR) of images by 9.93 and 2.20 dB, respectively, and improved the mean structure similarity (SSIM) of images by 0.058 and 0.009, respectively, at R=10. The paired t-test shows that there was no significant difference between HMDDL and ground truth for proton-density fat fraction (PDFF) and R 2 ∗ values at R up to 10. Conclusions The proposed HMDDL enables features of water images and fat images from the highly undersampled multi-echo data along spatial, respiratory motion, and echo dimensions, to improve the performance of accelerated four-dimensional (4D) free-breathing water-fat imaging.
Collapse
Affiliation(s)
- Shuo Li
- National Engineering Research Center of Advanced Magnetic Resonance Technologies for Diagnosis and Therapy, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Zhijun Wang
- National Engineering Research Center of Advanced Magnetic Resonance Technologies for Diagnosis and Therapy, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Zekang Ding
- National Engineering Research Center of Advanced Magnetic Resonance Technologies for Diagnosis and Therapy, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Huajun She
- National Engineering Research Center of Advanced Magnetic Resonance Technologies for Diagnosis and Therapy, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Yiping P Du
- National Engineering Research Center of Advanced Magnetic Resonance Technologies for Diagnosis and Therapy, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
20
|
Yan X, Luo Y, Chen X, Chen EZ, Liu Q, Zou L, Bao Y, Huang L, Xia L. From Compressed-Sensing to Deep Learning MR: Comparative Biventricular Cardiac Function Analysis in a Patient Cohort. J Magn Reson Imaging 2024; 59:1231-1241. [PMID: 37435633 DOI: 10.1002/jmri.28899] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Revised: 06/26/2023] [Accepted: 06/27/2023] [Indexed: 07/13/2023] Open
Abstract
BACKGROUND Conventional segmented, retrospectively gated cine (Conv-cine) is challenged in patients with breath-hold difficulties. Compressed sensing (CS) has shown values in cine imaging but generally requires long reconstruction time. Recent artificial intelligence (AI) has demonstrated potential in fast cine imaging. PURPOSE To compare CS-cine and AI-cine with Conv-cine in quantitative biventricular functions, image quality, and reconstruction time. STUDY TYPE Prospective human studies. SUBJECTS 70 patients (age, 39 ± 15 years, 54.3% male). FIELD STRENGTH/SEQUENCE 3T; balanced steady state free precession gradient echo sequences. ASSESSMENT Biventricular functional parameters of CS-, AI-, and Conv-cine were measured by two radiologists independently and compared. The scan and reconstruction time were recorded. Subjective scores of image quality were compared by three radiologists. STATISTICAL TESTS Paired t-test and two related-samples Wilcoxon sign test were used to compare biventricular functional parameters between CS-, AI-, and Conv-cine. Intraclass correlation coefficient (ICC), Bland-Altman analysis, and Kendall's W method were applied to evaluate agreement of biventricular functional parameters and image quality of these three sequences. A P-value <0.05 was considered statistically significant, and standardized mean difference (SMD) < 0. 100 was considered no significant difference. RESULTS Compared to Conv-cine, no statistically significant differences were identified in CS- and AI-cine function results (all P > 0.05), except for very small differences in left ventricle end-diastole volumes of 2.5 mL (SMD = 0.082) and 4.1 mL (SMD = 0.096), respectively. Bland-Altman scatter plots revealed that biventricular function results were mostly distributed within the 95% confidence interval. All parameters had acceptable to excellent interobserver agreements (ICC: 0.748-0.989). Compared with Conv-cine (84 ± 13 sec), both CS (14 ± 2 sec) and AI (15 ± 2 sec) techniques reduced scan time. Compared with CS-cine (304 ± 17 sec), AI-cine (24 ± 4 sec) reduced reconstruction time. CS-cine demonstrated significantly lower quality scores than Conv-cine, while AI-cine demonstrated similar scores (P = 0.634). CONCLUSION CS- and AI-cine can achieve whole-heart cardiac cine imaging in a single breath-hold. Both CS- and AI-cine have the potential to supplement the gold standard Conv-cine in studying biventricular functions and benefit patients having difficulties with breath-holds. LEVEL OF EVIDENCE 1 TECHNICAL EFFICACY STAGE: 1.
Collapse
Affiliation(s)
- Xianghu Yan
- Department of Radiology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Yi Luo
- Department of Radiology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Xiao Chen
- United Imaging Intelligence, Cambridge, Massachusetts, USA
| | - Eric Z Chen
- United Imaging Intelligence, Cambridge, Massachusetts, USA
| | - Qi Liu
- UIH America, Inc., Houston, Texas, USA
| | - Lixian Zou
- Paul C. Lauterbur Research Centre for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Science, Shenzhen, Guangdong, China
| | - Yuwei Bao
- Department of Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Lu Huang
- Department of Radiology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Liming Xia
- Department of Radiology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| |
Collapse
|
21
|
Phair A, Fotaki A, Felsner L, Fletcher TJ, Qi H, Botnar RM, Prieto C. A motion-corrected deep-learning reconstruction framework for accelerating whole-heart magnetic resonance imaging in patients with congenital heart disease. J Cardiovasc Magn Reson 2024; 26:101039. [PMID: 38521391 PMCID: PMC10993190 DOI: 10.1016/j.jocmr.2024.101039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2023] [Revised: 02/16/2024] [Accepted: 03/14/2024] [Indexed: 03/25/2024] Open
Abstract
BACKGROUND Cardiovascular magnetic resonance (CMR) is an important imaging modality for the assessment and management of adult patients with congenital heart disease (CHD). However, conventional techniques for three-dimensional (3D) whole-heart acquisition involve long and unpredictable scan times and methods that accelerate scans via k-space undersampling often rely on long iterative reconstructions. Deep-learning-based reconstruction methods have recently attracted much interest due to their capacity to provide fast reconstructions while often outperforming existing state-of-the-art methods. In this study, we sought to adapt and validate a non-rigid motion-corrected model-based deep learning (MoCo-MoDL) reconstruction framework for 3D whole-heart MRI in a CHD patient cohort. METHODS The previously proposed deep-learning reconstruction framework MoCo-MoDL, which incorporates a non-rigid motion-estimation network and a denoising regularization network within an unrolled iterative reconstruction, was trained in an end-to-end manner using 39 CHD patient datasets. Once trained, the framework was evaluated in eight CHD patient datasets acquired with seven-fold prospective undersampling. Reconstruction quality was compared with the state-of-the-art non-rigid motion-corrected patch-based low-rank reconstruction method (NR-PROST) and against reference images (acquired with three-or-four-fold undersampling and reconstructed with NR-PROST). RESULTS Seven-fold undersampled scan times were 2.1 ± 0.3 minutes and reconstruction times were ∼30 seconds, approximately 240 times faster than an NR-PROST reconstruction. Image quality comparable to the reference images was achieved using the proposed MoCo-MoDL framework, with no statistically significant differences found in any of the assessed quantitative or qualitative image quality measures. Additionally, expert image quality scores indicated the MoCo-MoDL reconstructions were consistently of a higher quality than the NR-PROST reconstructions of the same data, with the differences in 12 of the 22 scores measured for individual vascular structures found to be statistically significant. CONCLUSION The MoCo-MoDL framework was applied to an adult CHD patient cohort, achieving good quality 3D whole-heart images from ∼2-minute scans with reconstruction times of ∼30 seconds.
Collapse
Affiliation(s)
- Andrew Phair
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
| | - Anastasia Fotaki
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
| | - Lina Felsner
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
| | - Thomas J Fletcher
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
| | - Haikun Qi
- School of Biomedical Engineering, Shanghai Tech University, Shanghai, China
| | - René M Botnar
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom; Instituto de Ingeniería Biológica y Médica, Pontificia Universidad Católica de Chile, Santiago, Chile; Escuela de Ingeniería, Pontificia Universidad Católica de Chile, Santiago, Chile; Millennium Institute for Intelligent Healthcare Engineering, Santiago, Chile; Technical University of Munich, Institute of Advanced Study, Munich, Germany
| | - Claudia Prieto
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom; Escuela de Ingeniería, Pontificia Universidad Católica de Chile, Santiago, Chile; Millennium Institute for Intelligent Healthcare Engineering, Santiago, Chile.
| |
Collapse
|
22
|
Gao C, Ming Z, Nguyen KL, Pang J, Bedayat A, Dale BM, Zhong X, Finn JP. Ferumoxytol-Enhanced Cardiac Cine MRI Reconstruction Using a Variable-Splitting Spatiotemporal Network. J Magn Reson Imaging 2024. [PMID: 38436994 DOI: 10.1002/jmri.29295] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2023] [Revised: 01/29/2024] [Accepted: 01/31/2024] [Indexed: 03/05/2024] Open
Abstract
BACKGROUND Balanced steady-state free precession (bSSFP) imaging is commonly used in cardiac cine MRI but prone to image artifacts. Ferumoxytol-enhanced (FE) gradient echo (GRE) has been proposed as an alternative. Utilizing the abundance of bSSFP images to develop a computationally efficient network that is applicable to FE GRE cine would benefit future network development. PURPOSE To develop a variable-splitting spatiotemporal network (VSNet) for image reconstruction, trained on bSSFP cine images and applicable to FE GRE cine images. STUDY TYPE Retrospective and prospective. SUBJECTS 41 patients (26 female, 53 ± 19 y/o) for network training, 31 patients (19 female, 49 ± 17 y/o) and 5 healthy subjects (5 female, 30 ± 7 y/o) for testing. FIELD STRENGTH/SEQUENCE 1.5T and 3T, bSSFP and GRE. ASSESSMENT VSNet was compared to VSNet with total variation loss, compressed sensing and low rank methods for 14× accelerated data. The GRAPPA×2/×3 images served as the reference. Peak signal-to-noise-ratio (PSNR), structural similarity index (SSIM), left ventricular (LV) and right ventricular (RV) end-diastolic volume (EDV), end-systolic volume (ESV), and ejection fraction (EF) were measured. Qualitative image ranking and scoring were independently performed by three readers. Latent scores were calculated based on scores of each method relative to the reference. STATISTICS Linear mixed-effects regression, Tukey method, Fleiss' Kappa, Bland-Altman analysis, and Bayesian categorical cumulative probit model. A P-value <0.05 was considered statistically significant. RESULTS VSNet achieved significantly higher PSNR (32.7 ± 0.2), SSIM (0.880 ± 0.004), rank (2.14 ± 0.06), and latent scores (-1.72 ± 0.22) compared to other methods (rank >2.90, latent score < -2.63). Fleiss' Kappa was 0.52 for scoring and 0.61 for ranking. VSNet showed no significantly different LV and RV ESV (P = 0.938) and EF (P = 0.143) measurements, but statistically significant different (2.62 mL) EDV measurements compared to the reference. CONCLUSION VSNet produced the highest image quality and the most accurate functional measurements for FE GRE cine images among the tested 14× accelerated reconstruction methods. LEVEL OF EVIDENCE 3 TECHNICAL EFFICACY: Stage 1.
Collapse
Affiliation(s)
- Chang Gao
- Department of Physics and Biology in Medicine, University of California Los Angeles, Los Angeles, California, USA
- Department of Radiological Sciences, University of California Los Angeles, Los Angeles, California, USA
| | - Zhengyang Ming
- Department of Physics and Biology in Medicine, University of California Los Angeles, Los Angeles, California, USA
- Department of Radiological Sciences, University of California Los Angeles, Los Angeles, California, USA
| | - Kim-Lien Nguyen
- Department of Physics and Biology in Medicine, University of California Los Angeles, Los Angeles, California, USA
- Department of Radiological Sciences, University of California Los Angeles, Los Angeles, California, USA
- Division of Cardiology, University of California Los Angeles and VA Greater Los Angeles Healthcare System, Los Angeles, California, USA
| | - Jianing Pang
- MR R&D Collaborations, Siemens Medical Solutions USA, Inc., Chicago, Illinois, USA
| | - Arash Bedayat
- Department of Radiological Sciences, University of California Los Angeles, Los Angeles, California, USA
| | - Brian M Dale
- MR R&D Collaborations, Siemens Medical Solutions USA, Inc., Cary, North Carliona, USA
| | - Xiaodong Zhong
- MR R&D Collaborations, Siemens Medical Solutions USA, Inc., Los Angeles, California, USA
| | - J Paul Finn
- Department of Physics and Biology in Medicine, University of California Los Angeles, Los Angeles, California, USA
- Department of Radiological Sciences, University of California Los Angeles, Los Angeles, California, USA
| |
Collapse
|
23
|
Curcuru AN, Yang D, An H, Cuculich PS, Robinson CG, Gach HM. Technical note: Minimizing CIED artifacts on a 0.35 T MRI-Linac using deep learning. J Appl Clin Med Phys 2024; 25:e14304. [PMID: 38368615 DOI: 10.1002/acm2.14304] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 01/11/2024] [Accepted: 02/03/2024] [Indexed: 02/20/2024] Open
Abstract
BACKGROUND Artifacts from implantable cardioverter defibrillators (ICDs) are a challenge to magnetic resonance imaging (MRI)-guided radiotherapy (MRgRT). PURPOSE This study tested an unsupervised generative adversarial network to mitigate ICD artifacts in balanced steady-state free precession (bSSFP) cine MRIs and improve image quality and tracking performance for MRgRT. METHODS Fourteen healthy volunteers (Group A) were scanned on a 0.35 T MRI-Linac with and without an MR conditional ICD taped to their left pectoral to simulate an implanted ICD. bSSFP MRI data from 12 of the volunteers were used to train a CycleGAN model to reduce ICD artifacts. The data from the remaining two volunteers were used for testing. In addition, the dataset was reorganized three times using a Leave-One-Out scheme. Tracking metrics [Dice similarity coefficient (DSC), target registration error (TRE), and 95 percentile Hausdorff distance (95% HD)] were evaluated for whole-heart contours. Image quality metrics [normalized root mean square error (nRMSE), peak signal-to-noise ratio (PSNR), and multiscale structural similarity (MS-SSIM) scores] were evaluated. The technique was also tested qualitatively on three additional ICD datasets (Group B) including a patient with an implanted ICD. RESULTS For the whole-heart contour with CycleGAN reconstruction: 1) Mean DSC rose from 0.910 to 0.935; 2) Mean TRE dropped from 4.488 to 2.877 mm; and 3) Mean 95% HD dropped from 10.236 to 7.700 mm. For the whole-body slice with CycleGAN reconstruction: 1) Mean nRMSE dropped from 0.644 to 0.420; 2) Mean MS-SSIM rose from 0.779 to 0.819; and 3) Mean PSNR rose from 18.744 to 22.368. The three Group B datasets evaluated qualitatively displayed a reduction in ICD artifacts in the heart. CONCLUSION CycleGAN-generated reconstructions significantly improved both tracking and image quality metrics when used to mitigate artifacts from ICDs.
Collapse
Affiliation(s)
- Austen N Curcuru
- Department of Radiation Oncology, Washington University in St. Louis, St. Louis, Missouri, USA
| | - Deshan Yang
- Department of Radiation Oncology, Duke University, Durham, North Carolina, USA
| | - Hongyu An
- Departments of Radiology, Biomedical Engineering and Neurology, Washington University in St. Louis, St. Louis, Missouri, USA
| | - Phillip S Cuculich
- Departments of Cardiovascular Medicine and Radiation Oncology, Washington University in St. Louis, St. Louis, Missouri, USA
| | - Clifford G Robinson
- Department of Radiation Oncology, Washington University in St. Louis, St. Louis, Missouri, USA
| | - H Michael Gach
- Departments of Radiation Oncology, Radiology and Biomedical Engineering, Washington University in St. Louis, St. Louis, Missouri, USA
| |
Collapse
|
24
|
Machado I, Puyol-Anton E, Hammernik K, Cruz G, Ugurlu D, Olakorede I, Oksuz I, Ruijsink B, Castelo-Branco M, Young A, Prieto C, Schnabel J, King A. A Deep Learning-Based Integrated Framework for Quality-Aware Undersampled Cine Cardiac MRI Reconstruction and Analysis. IEEE Trans Biomed Eng 2024; 71:855-865. [PMID: 37782583 DOI: 10.1109/tbme.2023.3321431] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/04/2023]
Abstract
Cine cardiac magnetic resonance (CMR) imaging is considered the gold standard for cardiac function evaluation. However, cine CMR acquisition is inherently slow and in recent decades considerable effort has been put into accelerating scan times without compromising image quality or the accuracy of derived results. In this article, we present a fully-automated, quality-controlled integrated framework for reconstruction, segmentation and downstream analysis of undersampled cine CMR data. The framework produces high quality reconstructions and segmentations, leading to undersampling factors that are optimised on a scan-by-scan basis. This results in reduced scan times and automated analysis, enabling robust and accurate estimation of functional biomarkers. To demonstrate the feasibility of the proposed approach, we perform simulations of radial k-space acquisitions using in-vivo cine CMR data from 270 subjects from the UK Biobank (with synthetic phase) and in-vivo cine CMR data from 16 healthy subjects (with real phase). The results demonstrate that the optimal undersampling factor varies for different subjects by approximately 1 to 2 seconds per slice. We show that our method can produce quality-controlled images in a mean scan time reduced from 12 to 4 seconds per slice, and that image quality is sufficient to allow clinically relevant parameters to be automatically estimated to lie within 5% mean absolute difference.
Collapse
|
25
|
Hossain MB, Shinde RK, Oh S, Kwon KC, Kim N. A Systematic Review and Identification of the Challenges of Deep Learning Techniques for Undersampled Magnetic Resonance Image Reconstruction. SENSORS (BASEL, SWITZERLAND) 2024; 24:753. [PMID: 38339469 PMCID: PMC10856856 DOI: 10.3390/s24030753] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/30/2023] [Revised: 01/05/2024] [Accepted: 01/22/2024] [Indexed: 02/12/2024]
Abstract
Deep learning (DL) in magnetic resonance imaging (MRI) shows excellent performance in image reconstruction from undersampled k-space data. Artifact-free and high-quality MRI reconstruction is essential for ensuring accurate diagnosis, supporting clinical decision-making, enhancing patient safety, facilitating efficient workflows, and contributing to the validity of research studies and clinical trials. Recently, deep learning has demonstrated several advantages over conventional MRI reconstruction methods. Conventional methods rely on manual feature engineering to capture complex patterns and are usually computationally demanding due to their iterative nature. Conversely, DL methods use neural networks with hundreds of thousands of parameters and automatically learn relevant features and representations directly from the data. Nevertheless, there are some limitations to DL-based techniques concerning MRI reconstruction tasks, such as the need for large, labeled datasets, the possibility of overfitting, and the complexity of model training. Researchers are striving to develop DL models that are more efficient, adaptable, and capable of providing valuable information for medical practitioners. We provide a comprehensive overview of the current developments and clinical uses by focusing on state-of-the-art DL architectures and tools used in MRI reconstruction. This study has three objectives. Our main objective is to describe how various DL designs have changed over time and talk about cutting-edge tactics, including their advantages and disadvantages. Hence, data pre- and post-processing approaches are assessed using publicly available MRI datasets and source codes. Secondly, this work aims to provide an extensive overview of the ongoing research on transformers and deep convolutional neural networks for rapid MRI reconstruction. Thirdly, we discuss several network training strategies, like supervised, unsupervised, transfer learning, and federated learning for rapid and efficient MRI reconstruction. Consequently, this article provides significant resources for future improvement of MRI data pre-processing and fast image reconstruction.
Collapse
Affiliation(s)
- Md. Biddut Hossain
- School of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Republic of Korea; (M.B.H.); (R.K.S.)
| | - Rupali Kiran Shinde
- School of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Republic of Korea; (M.B.H.); (R.K.S.)
| | - Sukhoon Oh
- Research Equipment Operation Department, Korea Basic Science Institute, Cheongju-si 28119, Chungcheongbuk-do, Republic of Korea;
| | - Ki-Chul Kwon
- School of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Republic of Korea; (M.B.H.); (R.K.S.)
| | - Nam Kim
- School of Information and Communication Engineering, Chungbuk National University, Cheongju-si 28644, Chungcheongbuk-do, Republic of Korea; (M.B.H.); (R.K.S.)
| |
Collapse
|
26
|
Morales MA, Manning WJ, Nezafat R. Present and Future Innovations in AI and Cardiac MRI. Radiology 2024; 310:e231269. [PMID: 38193835 PMCID: PMC10831479 DOI: 10.1148/radiol.231269] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Revised: 10/21/2023] [Accepted: 10/26/2023] [Indexed: 01/10/2024]
Abstract
Cardiac MRI is used to diagnose and treat patients with a multitude of cardiovascular diseases. Despite the growth of clinical cardiac MRI, complicated image prescriptions and long acquisition protocols limit the specialty and restrain its impact on the practice of medicine. Artificial intelligence (AI)-the ability to mimic human intelligence in learning and performing tasks-will impact nearly all aspects of MRI. Deep learning (DL) primarily uses an artificial neural network to learn a specific task from example data sets. Self-driving scanners are increasingly available, where AI automatically controls cardiac image prescriptions. These scanners offer faster image collection with higher spatial and temporal resolution, eliminating the need for cardiac triggering or breath holding. In the future, fully automated inline image analysis will most likely provide all contour drawings and initial measurements to the reader. Advanced analysis using radiomic or DL features may provide new insights and information not typically extracted in the current analysis workflow. AI may further help integrate these features with clinical, genetic, wearable-device, and "omics" data to improve patient outcomes. This article presents an overview of AI and its application in cardiac MRI, including in image acquisition, reconstruction, and processing, and opportunities for more personalized cardiovascular care through extraction of novel imaging markers.
Collapse
Affiliation(s)
- Manuel A. Morales
- From the Department of Medicine, Cardiovascular Division (M.A.M.,
W.J.M., R.N.), and Department of Radiology (W.J.M.), Beth Israel Deaconess
Medical Center and Harvard Medical School, 330 Brookline Ave, Boston, MA
02215
| | - Warren J. Manning
- From the Department of Medicine, Cardiovascular Division (M.A.M.,
W.J.M., R.N.), and Department of Radiology (W.J.M.), Beth Israel Deaconess
Medical Center and Harvard Medical School, 330 Brookline Ave, Boston, MA
02215
| | - Reza Nezafat
- From the Department of Medicine, Cardiovascular Division (M.A.M.,
W.J.M., R.N.), and Department of Radiology (W.J.M.), Beth Israel Deaconess
Medical Center and Harvard Medical School, 330 Brookline Ave, Boston, MA
02215
| |
Collapse
|
27
|
Pan J, Hamdi M, Huang W, Hammernik K, Kuestner T, Rueckert D. Unrolled and rapid motion-compensated reconstruction for cardiac CINE MRI. Med Image Anal 2024; 91:103017. [PMID: 37924751 DOI: 10.1016/j.media.2023.103017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2023] [Revised: 10/06/2023] [Accepted: 10/26/2023] [Indexed: 11/06/2023]
Abstract
In recent years Motion-Compensated MR reconstruction (MCMR) has emerged as a promising approach for cardiac MR (CMR) imaging reconstruction. MCMR estimates cardiac motion and incorporates this information in the reconstruction. However, two obstacles prevent the practical use of MCMR in clinical situations: First, inaccurate motion estimation often leads to inferior CMR reconstruction results. Second, the motion estimation frequently leads to a long processing time for the reconstruction. In this work, we propose a learning-based and unrolled MCMR framework that can perform precise and rapid CMR reconstruction. We achieve accurate reconstruction by developing a joint optimization between the motion estimation and reconstruction, in which a deep learning-based motion estimation framework is unrolled within an iterative optimization procedure. With progressive iterations, a mutually beneficial interaction can be established in which the reconstruction quality is improved with more accurate motion estimation. Further, we propose a groupwise motion estimation framework to speed up the MCMR process. A registration template based on the cardiac sequence average is introduced, while the motion estimation is conducted between the cardiac frames and the template. By applying this framework, cardiac sequence registration can be accomplished with linear time complexity. Experiments on 43 in-house acquired 2D CINE datasets indicate that the proposed unrolled MCMR framework can deliver artifacts-free motion estimation and high-quality CMR reconstruction even for imaging acceleration rates up to 20x. We compare our approach with state-of-the-art reconstruction methods and it outperforms them quantitatively and qualitatively in all adapted metrics across all acceleration rates.
Collapse
Affiliation(s)
- Jiazhen Pan
- Klinikum Rechts der Isar, Technical University of Munich, Munich, Germany.
| | - Manal Hamdi
- Klinikum Rechts der Isar, Technical University of Munich, Munich, Germany
| | - Wenqi Huang
- Klinikum Rechts der Isar, Technical University of Munich, Munich, Germany
| | - Kerstin Hammernik
- Klinikum Rechts der Isar, Technical University of Munich, Munich, Germany; Department of Computing, Imperial College London, London, United Kingdom
| | - Thomas Kuestner
- Medical Image And Data Analysis (MIDAS.lab), University Hospital of Tübingen, Tübingen, Germany
| | - Daniel Rueckert
- Klinikum Rechts der Isar, Technical University of Munich, Munich, Germany; Department of Computing, Imperial College London, London, United Kingdom
| |
Collapse
|
28
|
He Z, Zhu YN, Chen Y, Chen Y, He Y, Sun Y, Wang T, Zhang C, Sun B, Yan F, Zhang X, Sun QF, Yang GZ, Feng Y. A deep unrolled neural network for real-time MRI-guided brain intervention. Nat Commun 2023; 14:8257. [PMID: 38086851 PMCID: PMC10716161 DOI: 10.1038/s41467-023-43966-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2023] [Accepted: 11/24/2023] [Indexed: 12/18/2023] Open
Abstract
Accurate navigation and targeting are critical for neurological interventions including biopsy and deep brain stimulation. Real-time image guidance further improves surgical planning and MRI is ideally suited for both pre- and intra-operative imaging. However, balancing spatial and temporal resolution is a major challenge for real-time interventional MRI (i-MRI). Here, we proposed a deep unrolled neural network, dubbed as LSFP-Net, for real-time i-MRI reconstruction. By integrating LSFP-Net and a custom-designed, MR-compatible interventional device into a 3 T MRI scanner, a real-time MRI-guided brain intervention system is proposed. The performance of the system was evaluated using phantom and cadaver studies. 2D/3D real-time i-MRI was achieved with temporal resolutions of 80/732.8 ms, latencies of 0.4/3.66 s including data communication, processing and reconstruction time, and in-plane spatial resolution of 1 × 1 mm2. The results demonstrated that the proposed method enables real-time monitoring of the remote-controlled brain intervention, and showed the potential to be readily integrated into diagnostic scanners for image-guided neurosurgery.
Collapse
Affiliation(s)
- Zhao He
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200030, China
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, 200240, China
- National Engineering Research Center of Advanced Magnetic Resonance Technologies for Diagnosis and Therapy (NERC-AMRT), School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China
| | - Ya-Nan Zhu
- School of Mathematical Sciences, MOE-LSC and Institute of Natural Sciences, Shanghai Jiao Tong University, Shanghai, 200240, China
| | - Yu Chen
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200030, China
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, 200240, China
- National Engineering Research Center of Advanced Magnetic Resonance Technologies for Diagnosis and Therapy (NERC-AMRT), School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China
| | - Yi Chen
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200030, China
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, 200240, China
- National Engineering Research Center of Advanced Magnetic Resonance Technologies for Diagnosis and Therapy (NERC-AMRT), School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China
| | - Yuchen He
- Department of Mathematics, City University of Hong Kong, Kowloon, Hong Kong SAR
| | - Yuhao Sun
- Department of Neurosurgery, Ruijin Hospital affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Tao Wang
- Department of Neurosurgery, Ruijin Hospital affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Chengcheng Zhang
- Department of Neurosurgery, Ruijin Hospital affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Bomin Sun
- Department of Neurosurgery, Ruijin Hospital affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Fuhua Yan
- Department of Radiology, Ruijin Hospital affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Xiaoqun Zhang
- School of Mathematical Sciences, MOE-LSC and Institute of Natural Sciences, Shanghai Jiao Tong University, Shanghai, 200240, China
- Shanghai Artificial Intelligence Laboratory, Shanghai, 200232, China
| | - Qing-Fang Sun
- Department of Neurosurgery, Ruijin Hospital affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China.
| | - Guang-Zhong Yang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200030, China.
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, 200240, China.
- National Engineering Research Center of Advanced Magnetic Resonance Technologies for Diagnosis and Therapy (NERC-AMRT), School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China.
| | - Yuan Feng
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200030, China.
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, 200240, China.
- National Engineering Research Center of Advanced Magnetic Resonance Technologies for Diagnosis and Therapy (NERC-AMRT), School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China.
- Department of Radiology, Ruijin Hospital affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China.
| |
Collapse
|
29
|
Beetz M, Banerjee A, Ossenberg-Engels J, Grau V. Multi-class point cloud completion networks for 3D cardiac anatomy reconstruction from cine magnetic resonance images. Med Image Anal 2023; 90:102975. [PMID: 37804586 DOI: 10.1016/j.media.2023.102975] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2022] [Revised: 07/08/2023] [Accepted: 09/18/2023] [Indexed: 10/09/2023]
Abstract
Cine magnetic resonance imaging (MRI) is the current gold standard for the assessment of cardiac anatomy and function. However, it typically only acquires a set of two-dimensional (2D) slices of the underlying three-dimensional (3D) anatomy of the heart, thus limiting the understanding and analysis of both healthy and pathological cardiac morphology and physiology. In this paper, we propose a novel fully automatic surface reconstruction pipeline capable of reconstructing multi-class 3D cardiac anatomy meshes from raw cine MRI acquisitions. Its key component is a multi-class point cloud completion network (PCCN) capable of correcting both the sparsity and misalignment issues of the 3D reconstruction task in a unified model. We first evaluate the PCCN on a large synthetic dataset of biventricular anatomies and observe Chamfer distances between reconstructed and gold standard anatomies below or similar to the underlying image resolution for multiple levels of slice misalignment. Furthermore, we find a reduction in reconstruction error compared to a benchmark 3D U-Net by 32% and 24% in terms of Hausdorff distance and mean surface distance, respectively. We then apply the PCCN as part of our automated reconstruction pipeline to 1000 subjects from the UK Biobank study in a cross-domain transfer setting and demonstrate its ability to reconstruct accurate and topologically plausible biventricular heart meshes with clinical metrics comparable to the previous literature. Finally, we investigate the robustness of our proposed approach and observe its capacity to successfully handle multiple common outlier conditions.
Collapse
Affiliation(s)
- Marcel Beetz
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford OX3 7DQ, UK.
| | - Abhirup Banerjee
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford OX3 7DQ, UK; Division of Cardiovascular Medicine, Radcliffe Department of Medicine, University of Oxford, Oxford OX3 9DU, UK.
| | - Julius Ossenberg-Engels
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford OX3 7DQ, UK
| | - Vicente Grau
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford OX3 7DQ, UK
| |
Collapse
|
30
|
Brahma S, Kolbitsch C, Martin J, Schaeffter T, Kofler A. Data-efficient Bayesian learning for radial dynamic MR reconstruction. Med Phys 2023; 50:6955-6977. [PMID: 37367947 DOI: 10.1002/mp.16543] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2023] [Revised: 04/07/2023] [Accepted: 05/20/2023] [Indexed: 06/28/2023] Open
Abstract
BACKGROUND Cardiac MRI has become the gold-standard imaging technique for assessing cardiovascular morphology and function. In spite of this, its slow data acquisition process presents imaging challenges due to the motion from heartbeats, respiration, and blood flow. In recent studies, deep learning (DL) algorithms have shown promising results for the task of image reconstruction. However, there have been instances where they have introduced artifacts that may be misinterpreted as pathologies or may obscure the detection of pathologies. Therefore, it is important to obtain a metric, such as the uncertainty of the network output, that identifies such artifacts. However, this can be quite challenging for large-scale image reconstruction problems such as dynamic multi-coil non-Cartesian MRI. PURPOSE To efficiently quantify uncertainties of a physics-informed DL-based image reconstruction method for a large-scale accelerated 2D multi-coil dynamic radial MRI reconstruction problem, and demonstrate the benefits of physics-informed DL over model-agnostic DL in reducing uncertainties while at the same time improving image quality. METHODS We extended a recently proposed physics-informed 2D U-Net that learns spatio-temporal slices (named XT-YT U-Net), and employed it for the task of uncertainty quantification (UQ) by using Monte Carlo dropout and a Gaussian negative log-likelihood loss function. Our data comprised 2D dynamic MR images acquired with a radial balanced steady-state free precession sequence. The XT-YT U-Net, which allows for training with a limited amount of data, was trained and validated on a dataset of 15 healthy volunteers, and further tested on data from four patients. An extensive comparison between physics-informed and model-agnostic neural networks (NNs) concerning the obtained image quality and uncertainty estimates was performed. Further, we employed calibration plots to assess the quality of the UQ. RESULTS The inclusion of the MR-physics model of data acquisition as a building block in the NN architecture led to higher image quality (NRMSE:- 33 ± 8.2 % $-33 \pm 8.2 \%$ , PSNR:6.3 ± 1.3 % $6.3 \pm 1.3 \%$ , and SSIM:1.9 ± 0.96 % $1.9 \pm 0.96 \%$ ), lower uncertainties (- 46 ± 8.7 % $-46 \pm 8.7 \%$ ), and, based on the calibration plots, an improved UQ compared to its model-agnostic counterpart. Furthermore, the UQ information can be used to differentiate between anatomical structures (e.g., coronary arteries, ventricle boundaries) and artifacts. CONCLUSIONS Using an XT-YT U-Net, we were able to quantify uncertainties of a physics-informed NN for a high-dimensional and computationally demanding 2D multi-coil dynamic MR imaging problem. In addition to improving the image quality, embedding the acquisition model in the network architecture decreased the reconstruction uncertainties as well as quantitatively improved the UQ. The UQ provides additional information to assess the performance of different network approaches.
Collapse
Affiliation(s)
- Sherine Brahma
- Physikalisch-Technische Bundesanstalt (PTB), Braunschweig and Berlin, Germany
- Department of Radiology, Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Christoph Kolbitsch
- Physikalisch-Technische Bundesanstalt (PTB), Braunschweig and Berlin, Germany
- School of Imaging Sciences and Biomedical Engineering, King's College London, London, UK
| | - Joerg Martin
- Physikalisch-Technische Bundesanstalt (PTB), Braunschweig and Berlin, Germany
| | - Tobias Schaeffter
- Physikalisch-Technische Bundesanstalt (PTB), Braunschweig and Berlin, Germany
- School of Imaging Sciences and Biomedical Engineering, King's College London, London, UK
- Department of Medical Engineering, Technical University of Berlin, Berlin, Germany
| | - Andreas Kofler
- Physikalisch-Technische Bundesanstalt (PTB), Braunschweig and Berlin, Germany
| |
Collapse
|
31
|
Li Y, Yang J, Yu T, Chi J, Liu F. Global attention-enabled texture enhancement network for MR image reconstruction. Magn Reson Med 2023; 90:1919-1931. [PMID: 37382206 DOI: 10.1002/mrm.29785] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2023] [Revised: 05/23/2023] [Accepted: 06/14/2023] [Indexed: 06/30/2023]
Abstract
PURPOSE Although recent convolutional neural network (CNN) methodologies have shown promising results in fast MR imaging, there is still a desire to explore how they can be used to learn the frequency characteristics of multicontrast images and reconstruct texture details. METHODS A global attention-enabled texture enhancement network (GATE-Net) with a frequency-dependent feature extraction module (FDFEM) and convolution-based global attention module (GAM) is proposed to address the highly under-sampling MR image reconstruction problem. First, FDFEM enables GATE-Net to effectively extract high-frequency features from shareable information of multicontrast images to improve the texture details of reconstructed images. Second, GAM with less computation complexity has the receptive field of the entire image, which can fully explore useful shareable information of multi-contrast images and suppress less beneficial shareable information. RESULTS The ablation studies are conducted to evaluate the effectiveness of the proposed FDFEM and GAM. Experimental results under various acceleration rates and datasets consistently demonstrate the superiority of GATE-Net, in terms of peak signal-to-noise ratio, structural similarity and normalized mean square error. CONCLUSION A global attention-enabled texture enhancement network is proposed. it can be applied to multicontrast MR image reconstruction tasks with different acceleration rates and datasets and achieves superior performance in comparison with state-of-the-art methods.
Collapse
Affiliation(s)
- Yingnan Li
- College of Electronics and Information, Qingdao University, Qingdao, Shandong, China
| | - Jie Yang
- College of Mechanical and Electrical Engineering, Qingdao University, Qingdao, Shandong, China
| | - Teng Yu
- College of Electronics and Information, Qingdao University, Qingdao, Shandong, China
| | - Jieru Chi
- College of Electronics and Information, Qingdao University, Qingdao, Shandong, China
| | - Feng Liu
- School of Information Technology and Electrical Engineering, University of Queensland, Brisbane, Queensland, Australia
| |
Collapse
|
32
|
Chen H, Chen X, Lin L, Cai S, Cai C, Chen Z, Xu J, Chen L. Learned spatiotemporal correlation priors for CEST image denoising using incorporated global-spectral convolution neural network. Magn Reson Med 2023; 90:2071-2088. [PMID: 37332198 DOI: 10.1002/mrm.29763] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Revised: 05/29/2023] [Accepted: 05/30/2023] [Indexed: 06/20/2023]
Abstract
PURPOSE To develop a deep learning-based method, dubbed Denoising CEST Network (DECENT), to fully exploit the spatiotemporal correlation prior to CEST image denoising. METHODS DECENT is composed of two parallel pathways with different convolution kernel sizes aiming to extract the global and spectral features embedded in CEST images. Each pathway consists of a modified U-Net with residual Encoder-Decoder network and 3D convolution. Fusion pathway with 1 × 1 × 1 convolution kernel is utilized to concatenate two parallel pathways, and the output of DECENT is noise-reduced CEST images. The performance of DECENT was validated in numerical simulations, egg white phantom experiments, and ischemic mouse brain and human skeletal muscle experiments in comparison with existing state-of-the-art denoising methods. RESULTS Rician noise was added to CEST images to mimic a low SNR situation for numerical simulation, egg white phantom experiment, and mouse brain experiments, while human skeletal muscle experiments were of inherently low SNR. From the denoising results evaluated by peak SNR (PSNR) and structural similarity index (SSIM), the proposed deep learning-based denoising method (DECENT) can achieve better performance compared to existing CEST denoising methods such as NLmCED, MLSVD, and BM4D, avoiding complicated parameter tuning or time-consuming iterative processes. CONCLUSIONS DECENT can well exploit the prior spatiotemporal correlation knowledge of CEST images and restore the noise-free images from their noisy observations, outperforming state-of-the-art denoising methods.
Collapse
Affiliation(s)
- Huan Chen
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, School of Electronic Science and Engineering, National Model Microelectronics College, Xiamen University, Xiamen, China
| | - Xinran Chen
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, School of Electronic Science and Engineering, National Model Microelectronics College, Xiamen University, Xiamen, China
| | - Liangjie Lin
- MSC Clinical & Technical Solutions, Philips Healthcare, Beijing, China
| | - Shuhui Cai
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, School of Electronic Science and Engineering, National Model Microelectronics College, Xiamen University, Xiamen, China
| | - Congbo Cai
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, School of Electronic Science and Engineering, National Model Microelectronics College, Xiamen University, Xiamen, China
| | - Zhong Chen
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, School of Electronic Science and Engineering, National Model Microelectronics College, Xiamen University, Xiamen, China
| | - Jiadi Xu
- Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA
- Department of Anesthesiology and Critical Care Medicine, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA
| | - Lin Chen
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, School of Electronic Science and Engineering, National Model Microelectronics College, Xiamen University, Xiamen, China
| |
Collapse
|
33
|
Morales MA, Yoon S, Fahmy A, Ghanbari F, Nakamori S, Rodriguez J, Yue J, Street JA, Herzka DA, Manning WJ, Nezafat R. Highly accelerated free-breathing real-time myocardial tagging for exercise cardiovascular magnetic resonance. J Cardiovasc Magn Reson 2023; 25:56. [PMID: 37784153 PMCID: PMC10544487 DOI: 10.1186/s12968-023-00961-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Accepted: 09/11/2023] [Indexed: 10/04/2023] Open
Abstract
BACKGROUND Exercise cardiovascular magnetic resonance (Ex-CMR) myocardial tagging would enable quantification of myocardial deformation after exercise. However, current electrocardiogram (ECG)-segmented sequences are limited for Ex-CMR. METHODS We developed a highly accelerated balanced steady-state free-precession real-time tagging technique for 3 T. A 12-fold acceleration was achieved using incoherent sixfold random Cartesian sampling, twofold truncated outer phase encoding, and a deep learning resolution enhancement model. The technique was tested in two prospective studies. In a rest study of 27 patients referred for clinical CMR and 19 healthy subjects, a set of ECG-segmented for comparison and two sets of real-time tagging images for repeatability assessment were collected in 2-chamber and short-axis views with spatiotemporal resolution 2.0 × 2.0 mm2 and 29 ms. In an Ex-CMR study of 26 patients with known or suspected cardiac disease and 23 healthy subjects, real-time images were collected before and after exercise. Deformation was quantified using measures of short-axis global circumferential strain (GCS). Two experienced CMR readers evaluated the image quality of all real-time data pooled from both studies using a 4-point Likert scale for tagline quality (1-excellent; 2-good; 3-moderate; 4-poor) and artifact level (1-none; 2-minimal; 3-moderate; 4-significant). Statistical evaluation included Pearson correlation coefficient (r), intraclass correlation coefficient (ICC), and coefficient of variation (CoV). RESULTS In the rest study, deformation was successfully quantified in 90% of cases. There was a good correlation (r = 0.71) between ECG-segmented and real-time measures of GCS, and repeatability was good to excellent (ICC = 0.86 [0.71, 0.94]) with a CoV of 4.7%. In the Ex-CMR study, deformation was successfully quantified in 96% of subjects pre-exercise and 84% of subjects post-exercise. Short-axis and 2-chamber tagline quality were 1.6 ± 0.7 and 1.9 ± 0.8 at rest and 1.9 ± 0.7 and 2.5 ± 0.8 after exercise, respectively. Short-axis and 2-chamber artifact level was 1.2 ± 0.5 and 1.4 ± 0.7 at rest and 1.3 ± 0.6 and 1.5 ± 0.8 post-exercise, respectively. CONCLUSION We developed a highly accelerated real-time tagging technique and demonstrated its potential for Ex-CMR quantification of myocardial deformation. Further studies are needed to assess the clinical utility of our technique.
Collapse
Affiliation(s)
- Manuel A Morales
- Department of Medicine (Cardiovascular Division), Beth Israel Deaconess Medical Center and Harvard Medical School, 330 Brookline Ave., Boston, MA, 02215, USA
| | - Siyeop Yoon
- Department of Medicine (Cardiovascular Division), Beth Israel Deaconess Medical Center and Harvard Medical School, 330 Brookline Ave., Boston, MA, 02215, USA
| | - Ahmed Fahmy
- Department of Medicine (Cardiovascular Division), Beth Israel Deaconess Medical Center and Harvard Medical School, 330 Brookline Ave., Boston, MA, 02215, USA
| | - Fahime Ghanbari
- Department of Medicine (Cardiovascular Division), Beth Israel Deaconess Medical Center and Harvard Medical School, 330 Brookline Ave., Boston, MA, 02215, USA
| | - Shiro Nakamori
- Department of Medicine (Cardiovascular Division), Beth Israel Deaconess Medical Center and Harvard Medical School, 330 Brookline Ave., Boston, MA, 02215, USA
| | - Jennifer Rodriguez
- Department of Medicine (Cardiovascular Division), Beth Israel Deaconess Medical Center and Harvard Medical School, 330 Brookline Ave., Boston, MA, 02215, USA
| | - Jennifer Yue
- Department of Medicine (Cardiovascular Division), Beth Israel Deaconess Medical Center and Harvard Medical School, 330 Brookline Ave., Boston, MA, 02215, USA
| | - Jordan A Street
- Department of Medicine (Cardiovascular Division), Beth Israel Deaconess Medical Center and Harvard Medical School, 330 Brookline Ave., Boston, MA, 02215, USA
| | | | - Warren J Manning
- Department of Medicine (Cardiovascular Division), Beth Israel Deaconess Medical Center and Harvard Medical School, 330 Brookline Ave., Boston, MA, 02215, USA
- Department of Radiology, Beth Israel Deaconess Medical Center and Harvard Medical School, Boston, USA
| | - Reza Nezafat
- Department of Medicine (Cardiovascular Division), Beth Israel Deaconess Medical Center and Harvard Medical School, 330 Brookline Ave., Boston, MA, 02215, USA.
| |
Collapse
|
34
|
Küstner T, Hepp T, Seith F. Multiparametric Oncologic Hybrid Imaging: Machine Learning Challenges and Opportunities. Nuklearmedizin 2023; 62:306-313. [PMID: 37802058 DOI: 10.1055/a-2157-6670] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/08/2023]
Abstract
BACKGROUND Machine learning (ML) is considered an important technology for future data analysis in health care. METHODS The inherently technology-driven fields of diagnostic radiology and nuclear medicine will both benefit from ML in terms of image acquisition and reconstruction. Within the next few years, this will lead to accelerated image acquisition, improved image quality, a reduction of motion artifacts and - for PET imaging - reduced radiation exposure and new approaches for attenuation correction. Furthermore, ML has the potential to support decision making by a combined analysis of data derived from different modalities, especially in oncology. In this context, we see great potential for ML in multiparametric hybrid imaging and the development of imaging biomarkers. RESULTS AND CONCLUSION In this review, we will describe the basics of ML, present approaches in hybrid imaging of MRI, CT, and PET, and discuss the specific challenges associated with it and the steps ahead to make ML a diagnostic and clinical tool in the future. KEY POINTS · ML provides a viable clinical solution for the reconstruction, processing, and analysis of hybrid imaging obtained from MRI, CT, and PET..
Collapse
Affiliation(s)
- Thomas Küstner
- Medical Image and Data Analysis (MIDAS.lab), Department of Diagnostic and Interventional Radiology, University Hospitals Tubingen, Germany
| | - Tobias Hepp
- Medical Image and Data Analysis (MIDAS.lab), Department of Diagnostic and Interventional Radiology, University Hospitals Tubingen, Germany
| | - Ferdinand Seith
- Department of Diagnostic and Interventional Radiology, University Hospitals Tubingen, Germany
| |
Collapse
|
35
|
Terpstra ML, Maspero M, Verhoeff JJC, van den Berg CAT. Accelerated respiratory-resolved 4D-MRI with separable spatio-temporal neural networks. Med Phys 2023; 50:5331-5342. [PMID: 37527331 DOI: 10.1002/mp.16643] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2022] [Revised: 05/30/2023] [Accepted: 06/20/2023] [Indexed: 08/03/2023] Open
Abstract
BACKGROUND Respiratory-resolved four-dimensional magnetic resonance imaging (4D-MRI) provides essential motion information for accurate radiation treatments of mobile tumors. However, obtaining high-quality 4D-MRI suffers from long acquisition and reconstruction times. PURPOSE To develop a deep learning architecture to quickly acquire and reconstruct high-quality 4D-MRI, enabling accurate motion quantification for MRI-guided radiotherapy (MRIgRT). METHODS A small convolutional neural network called MODEST is proposed to reconstruct 4D-MRI by performing a spatial and temporal decomposition, omitting the need for 4D convolutions to use all the spatio-temporal information present in 4D-MRI. This network is trained on undersampled 4D-MRI after respiratory binning to reconstruct high-quality 4D-MRI obtained by compressed sensing reconstruction. The network is trained, validated, and tested on 4D-MRI of 28 lung cancer patients acquired with a T1-weighted golden-angle radial stack-of-stars (GA-SOS) sequence. The 4D-MRI of 18, 5, and 5 patients were used for training, validation, and testing. Network performances are evaluated on image quality measured by the structural similarity index (SSIM) and motion consistency by comparing the position of the lung-liver interface on undersampled 4D-MRI before and after respiratory binning. The network is compared to conventional architectures such as a U-Net, which has 30 times more trainable parameters. RESULTS MODEST can reconstruct high-quality 4D-MRI with higher image quality than a U-Net, despite a thirty-fold reduction in trainable parameters. High-quality 4D-MRI can be obtained using MODEST in approximately 2.5 min, including acquisition, processing, and reconstruction. CONCLUSION High-quality accelerated 4D-MRI can be obtained using MODEST, which is particularly interesting for MRIgRT.
Collapse
Affiliation(s)
- Maarten L Terpstra
- Department of Radiotherapy, University Medical Center Utrecht, Utrecht, The Netherlands
- Computational Imaging Group for MR Diagnostics & Therapy, Center for Image Sciences, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Matteo Maspero
- Department of Radiotherapy, University Medical Center Utrecht, Utrecht, The Netherlands
- Computational Imaging Group for MR Diagnostics & Therapy, Center for Image Sciences, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Joost J C Verhoeff
- Department of Radiotherapy, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Cornelis A T van den Berg
- Department of Radiotherapy, University Medical Center Utrecht, Utrecht, The Netherlands
- Computational Imaging Group for MR Diagnostics & Therapy, Center for Image Sciences, University Medical Center Utrecht, Utrecht, The Netherlands
| |
Collapse
|
36
|
Singh D, Monga A, de Moura HL, Zhang X, Zibetti MVW, Regatte RR. Emerging Trends in Fast MRI Using Deep-Learning Reconstruction on Undersampled k-Space Data: A Systematic Review. Bioengineering (Basel) 2023; 10:1012. [PMID: 37760114 PMCID: PMC10525988 DOI: 10.3390/bioengineering10091012] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Revised: 08/22/2023] [Accepted: 08/24/2023] [Indexed: 09/29/2023] Open
Abstract
Magnetic Resonance Imaging (MRI) is an essential medical imaging modality that provides excellent soft-tissue contrast and high-resolution images of the human body, allowing us to understand detailed information on morphology, structural integrity, and physiologic processes. However, MRI exams usually require lengthy acquisition times. Methods such as parallel MRI and Compressive Sensing (CS) have significantly reduced the MRI acquisition time by acquiring less data through undersampling k-space. The state-of-the-art of fast MRI has recently been redefined by integrating Deep Learning (DL) models with these undersampled approaches. This Systematic Literature Review (SLR) comprehensively analyzes deep MRI reconstruction models, emphasizing the key elements of recently proposed methods and highlighting their strengths and weaknesses. This SLR involves searching and selecting relevant studies from various databases, including Web of Science and Scopus, followed by a rigorous screening and data extraction process using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. It focuses on various techniques, such as residual learning, image representation using encoders and decoders, data-consistency layers, unrolled networks, learned activations, attention modules, plug-and-play priors, diffusion models, and Bayesian methods. This SLR also discusses the use of loss functions and training with adversarial networks to enhance deep MRI reconstruction methods. Moreover, we explore various MRI reconstruction applications, including non-Cartesian reconstruction, super-resolution, dynamic MRI, joint learning of reconstruction with coil sensitivity and sampling, quantitative mapping, and MR fingerprinting. This paper also addresses research questions, provides insights for future directions, and emphasizes robust generalization and artifact handling. Therefore, this SLR serves as a valuable resource for advancing fast MRI, guiding research and development efforts of MRI reconstruction for better image quality and faster data acquisition.
Collapse
Affiliation(s)
- Dilbag Singh
- Center of Biomedical Imaging, Department of Radiology, New York University Grossman School of Medicine, New York, NY 10016, USA; (A.M.); (H.L.d.M.); (X.Z.); (M.V.W.Z.)
| | | | | | | | | | - Ravinder R. Regatte
- Center of Biomedical Imaging, Department of Radiology, New York University Grossman School of Medicine, New York, NY 10016, USA; (A.M.); (H.L.d.M.); (X.Z.); (M.V.W.Z.)
| |
Collapse
|
37
|
Palla A, Ramanarayanan S, Ram K, Sivaprakasam M. Generalizable Deep Learning Method for Suppressing Unseen and Multiple MRI Artifacts Using Meta-learning. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-5. [PMID: 38082950 DOI: 10.1109/embc40787.2023.10341123] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Magnetic Resonance (MR) images suffer from various types of artifacts due to motion, spatial resolution, and under-sampling. Conventional deep learning methods deal with removing a specific type of artifact, leading to separately trained models for each artifact type that lack the shared knowledge generalizable across artifacts. Moreover, training a model for each type and amount of artifact is a tedious process that consumes more training time and storage of models. On the other hand, the shared knowledge learned by jointly training the model on multiple artifacts might be inadequate to generalize under deviations in the types and amounts of artifacts. Model-agnostic meta-learning (MAML), a nested bi-level optimization framework is a promising technique to learn common knowledge across artifacts in the outer level of optimization, and artifact-specific restoration in the inner level. We propose curriculum-MAML (CMAML), a learning process that integrates MAML with curriculum learning to impart the knowledge of variable artifact complexity to adaptively learn restoration of multiple artifacts during training. Comparative studies against Stochastic Gradient Descent and MAML, using two cardiac datasets reveal that CMAML exhibits (i) better generalization with improved PSNR for 83% of unseen types and amounts of artifacts and improved SSIM in all cases, and (ii) better artifact suppression in 4 out of 5 cases of composite artifacts (scans with multiple artifacts).Clinical relevance- Our results show that CMAML has the potential to minimize the number of artifact-specific models; which is essential to deploy deep learning models for clinical use. Furthermore, we have also taken another practical scenario of an image affected by multiple artifacts and show that our method performs better in 80% of cases.
Collapse
|
38
|
Kim D, Coll-Font J, Lobos RA, Stäb D, Pang J, Foster A, Garrett T, Bi X, Speier P, Haldar JP, Nguyen C. Single breath-hold CINE imaging with combined simultaneous multislice and region-optimized virtual coils. Magn Reson Med 2023; 90:222-230. [PMID: 36864561 PMCID: PMC10315014 DOI: 10.1002/mrm.29620] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2022] [Revised: 02/02/2023] [Accepted: 02/03/2023] [Indexed: 03/04/2023]
Abstract
PURPOSE To investigate the feasibility of combining simultaneous multislice (SMS) and region-optimized virtual coils (ROVir) for single breath-hold CINE imaging. METHOD ROVir is a recent virtual coil approach that allows reduced-field of view (FOV) imaging by localizing the signal from a region-of-interest (ROI) and/or suppressing the signal from unwanted spatial regions. In this work, ROVir is used for reduced-FOV SMS bSSFP CINE imaging, which enables whole heart CINE with a single breath-hold acquisition. RESULTS Reduced-FOV CINE with either SMS-only or ROVir-only resulted in significant aliasing, with severely reduced image quality when compared to the full FOV reference CINE, while the visual appearance of aliasing was substantially reduced with the proposed SMS+ROVir. The end diastolic volume, end systolic volume, and ejection fraction obtained using the proposed approach were similar to the clinical reference (correlations of 0.92, 0.94, and 0.88, respectively withp < 0 . 05 $$ p<0.05 $$ in each case, and biases of 0.1, 1.6 mL, and- 0 . 6 % $$ -0.6\% $$ , respectively). No statistically significant differences for these parameters were found with a Wilcoxon rank test (p = 0.96, 0.20, and 0.40, respectively). CONCLUSION We demonstrated that reduced-FOV CINE imaging with SMS+ROVir enables single breath-hold whole-heart imaging without compromising visual image quality or quantitative cardiac function parameters.
Collapse
Affiliation(s)
- Daeun Kim
- Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA
| | - Jaume Coll-Font
- Cardiovascular Research Center and Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA
| | - Rodrigo A. Lobos
- Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA
| | - Daniel Stäb
- MR Research Collaborations, Siemens Healthcare Limited, Melbourne, Australia
| | - Jianing Pang
- Siemens Medical Solutions USA Inc., Los Angeles, CA
| | - Anna Foster
- Cardiovascular Research Center and Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA
| | - Thomas Garrett
- Cardiovascular Research Center and Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA
| | - Xiaoming Bi
- Siemens Medical Solutions USA Inc., Los Angeles, CA
| | | | - Justin P. Haldar
- Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA
| | - Christopher Nguyen
- Cardiovascular Research Center and Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA
- Division of Health Science Technology, Harvard-Massachusetts Institute of Technology, Cambridge, MA
- Cardiovascular Innovation Research Center, Heart, Vascular, and Thoracic Institute, Cleveland Clinic, Cleveland, OH
| |
Collapse
|
39
|
Hamilton JI, Truesdell W, Galizia M, Burris N, Agarwal P, Seiberlich N. A low-rank deep image prior reconstruction for free-breathing ungated spiral functional CMR at 0.55 T and 1.5 T. MAGMA (NEW YORK, N.Y.) 2023; 36:451-464. [PMID: 37043121 PMCID: PMC11017470 DOI: 10.1007/s10334-023-01088-w] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/29/2022] [Revised: 03/02/2023] [Accepted: 04/01/2023] [Indexed: 04/13/2023]
Abstract
OBJECTIVE This study combines a deep image prior with low-rank subspace modeling to enable real-time (free-breathing and ungated) functional cardiac imaging on a commercial 0.55 T scanner. MATERIALS AND METHODS The proposed low-rank deep image prior (LR-DIP) uses two u-nets to generate spatial and temporal basis functions that are combined to yield dynamic images, with no need for additional training data. Simulations and scans in 13 healthy subjects were performed at 0.55 T and 1.5 T using a golden angle spiral bSSFP sequence with images reconstructed using [Formula: see text]-ESPIRiT, low-rank plus sparse (L + S) matrix completion, and LR-DIP. Cartesian breath-held ECG-gated cine images were acquired for reference at 1.5 T. Two cardiothoracic radiologists rated images on a 1-5 scale for various categories, and LV function measurements were compared. RESULTS LR-DIP yielded the lowest errors in simulations, especially at high acceleration factors (R [Formula: see text] 8). LR-DIP ejection fraction measurements agreed with 1.5 T reference values (mean bias - 0.3% at 0.55 T and - 0.2% at 1.5 T). Compared to reference images, LR-DIP images received similar ratings at 1.5 T (all categories above 3.9) and slightly lower at 0.55 T (above 3.4). CONCLUSION Feasibility of real-time functional cardiac imaging using a low-rank deep image prior reconstruction was demonstrated in healthy subjects on a commercial 0.55 T scanner.
Collapse
Affiliation(s)
- Jesse I Hamilton
- Department of Radiology, University of Michigan, 1301 Catherine St, Ann Arbor, MI, 48109-1590, USA.
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, USA.
| | - William Truesdell
- Department of Radiology, University of Michigan, 1301 Catherine St, Ann Arbor, MI, 48109-1590, USA
| | - Mauricio Galizia
- Department of Radiology, University of Michigan, 1301 Catherine St, Ann Arbor, MI, 48109-1590, USA
| | - Nicholas Burris
- Department of Radiology, University of Michigan, 1301 Catherine St, Ann Arbor, MI, 48109-1590, USA
| | - Prachi Agarwal
- Department of Radiology, University of Michigan, 1301 Catherine St, Ann Arbor, MI, 48109-1590, USA
| | - Nicole Seiberlich
- Department of Radiology, University of Michigan, 1301 Catherine St, Ann Arbor, MI, 48109-1590, USA
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, USA
| |
Collapse
|
40
|
Güngör A, Dar SU, Öztürk Ş, Korkmaz Y, Bedel HA, Elmas G, Ozbey M, Çukur T. Adaptive diffusion priors for accelerated MRI reconstruction. Med Image Anal 2023; 88:102872. [PMID: 37384951 DOI: 10.1016/j.media.2023.102872] [Citation(s) in RCA: 21] [Impact Index Per Article: 21.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Revised: 04/13/2023] [Accepted: 06/12/2023] [Indexed: 07/01/2023]
Abstract
Deep MRI reconstruction is commonly performed with conditional models that de-alias undersampled acquisitions to recover images consistent with fully-sampled data. Since conditional models are trained with knowledge of the imaging operator, they can show poor generalization across variable operators. Unconditional models instead learn generative image priors decoupled from the operator to improve reliability against domain shifts related to the imaging operator. Recent diffusion models are particularly promising given their high sample fidelity. Nevertheless, inference with a static image prior can perform suboptimally. Here we propose the first adaptive diffusion prior for MRI reconstruction, AdaDiff, to improve performance and reliability against domain shifts. AdaDiff leverages an efficient diffusion prior trained via adversarial mapping over large reverse diffusion steps. A two-phase reconstruction is executed following training: a rapid-diffusion phase that produces an initial reconstruction with the trained prior, and an adaptation phase that further refines the result by updating the prior to minimize data-consistency loss. Demonstrations on multi-contrast brain MRI clearly indicate that AdaDiff outperforms competing conditional and unconditional methods under domain shifts, and achieves superior or on par within-domain performance.
Collapse
Affiliation(s)
- Alper Güngör
- Department of Electrical and Electronics Engineering, Bilkent University, Ankara 06800, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara 06800, Turkey; ASELSAN Research Center, Ankara 06200, Turkey
| | - Salman Uh Dar
- Department of Electrical and Electronics Engineering, Bilkent University, Ankara 06800, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara 06800, Turkey; Department of Internal Medicine III, Heidelberg University Hospital, Heidelberg 69120, Germany
| | - Şaban Öztürk
- Department of Electrical and Electronics Engineering, Bilkent University, Ankara 06800, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara 06800, Turkey; Department of Electrical and Electronics Engineering, Amasya University, Amasya 05100, Turkey
| | - Yilmaz Korkmaz
- Department of Electrical and Electronics Engineering, Bilkent University, Ankara 06800, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara 06800, Turkey
| | - Hasan A Bedel
- Department of Electrical and Electronics Engineering, Bilkent University, Ankara 06800, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara 06800, Turkey
| | - Gokberk Elmas
- Department of Electrical and Electronics Engineering, Bilkent University, Ankara 06800, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara 06800, Turkey
| | - Muzaffer Ozbey
- Department of Electrical and Electronics Engineering, Bilkent University, Ankara 06800, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara 06800, Turkey
| | - Tolga Çukur
- Department of Electrical and Electronics Engineering, Bilkent University, Ankara 06800, Turkey; National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara 06800, Turkey; Neuroscience Program, Bilkent University, Ankara 06800, Turkey.
| |
Collapse
|
41
|
Yoon S, Nakamori S, Amyar A, Assana S, Cirillo J, Morales MA, Chow K, Bi X, Pierce P, Goddu B, Rodriguez J, H. Ngo L, J. Manning W, Nezafat R. Accelerated Cardiac MRI Cine with Use of Resolution Enhancement Generative Adversarial Inline Neural Network. Radiology 2023; 307:e222878. [PMID: 37249435 PMCID: PMC10315558 DOI: 10.1148/radiol.222878] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2022] [Revised: 03/29/2023] [Accepted: 04/17/2023] [Indexed: 05/31/2023]
Abstract
Background Cardiac cine can benefit from deep learning-based image reconstruction to reduce scan time and/or increase spatial and temporal resolution. Purpose To develop and evaluate a deep learning model that can be combined with parallel imaging or compressed sensing (CS). Materials and Methods The deep learning model was built on the enhanced super-resolution generative adversarial inline neural network, trained with use of retrospectively identified cine images and evaluated in participants prospectively enrolled from September 2021 to September 2022. The model was applied to breath-hold electrocardiography (ECG)-gated segmented and free-breathing real-time cine images collected with reduced spatial resolution with use of generalized autocalibrating partially parallel acquisitions (GRAPPA) or CS. The deep learning model subsequently restored spatial resolution. For comparison, GRAPPA-accelerated cine images were collected. Diagnostic quality and artifacts were evaluated by two readers with use of Likert scales and compared with use of Wilcoxon signed-rank tests. Agreement for left ventricle (LV) function, volume, and strain was assessed with Bland-Altman analysis. Results The deep learning model was trained on 1616 patients (mean age ± SD, 56 years ± 16; 920 men) and evaluated in 181 individuals, 126 patients (mean age, 57 years ± 16; 77 men) and 55 healthy subjects (mean age, 27 years ± 10; 15 men). In breath-hold ECG-gated segmented cine and free-breathing real-time cine, the deep learning model and GRAPPA showed similar diagnostic quality scores (2.9 vs 2.9, P = .41, deep learning vs GRAPPA) and artifact score (4.4 vs 4.3, P = .55, deep learning vs GRAPPA). Deep learning acquired more sections per breath-hold than GRAPPA (3.1 vs one section, P < .001). In free-breathing real-time cine, the deep learning showed a similar diagnostic quality score (2.9 vs 2.9, P = .21, deep learning vs GRAPPA) and lower artifact score (3.9 vs 4.3, P < .001, deep learning vs GRAPPA). For both sequences, the deep learning model showed excellent agreement for LV parameters, with near-zero mean differences and narrow limits of agreement compared with GRAPPA. Conclusion Deep learning-accelerated cardiac cine showed similarly accurate quantification of cardiac function, volume, and strain to a standardized parallel imaging method. © RSNA, 2023 Supplemental material is available for this article. See also the editorial by Vannier and Wang in this issue.
Collapse
Affiliation(s)
- Siyeop Yoon
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Shiro Nakamori
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Amine Amyar
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Salah Assana
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Julia Cirillo
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Manuel A. Morales
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Kelvin Chow
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Xiaoming Bi
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Patrick Pierce
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Beth Goddu
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Jennifer Rodriguez
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Long H. Ngo
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Warren J. Manning
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Reza Nezafat
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| |
Collapse
|
42
|
Neofytou AP, Neji R, Kowalik GT, Mooiweer R, Wong J, Fotaki A, Ferreira J, Evans C, Bosio F, Mughal N, Razavi R, Pushparajah K, Roujol S. Retrospective motion correction through multi-average k-space data elimination (REMAKE) for free-breathing cardiac cine imaging. Magn Reson Med 2023; 89:2242-2254. [PMID: 36763898 PMCID: PMC10952356 DOI: 10.1002/mrm.29613] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2022] [Revised: 01/06/2023] [Accepted: 01/20/2023] [Indexed: 02/12/2023]
Abstract
PURPOSE To develop a motion-robust reconstruction technique for free-breathing cine imaging with multiple averages. METHOD Retrospective motion correction through multiple average k-space data elimination (REMAKE) was developed using iterative removal of k-space segments (from individual k-space samples) that contribute most to motion corruption while combining any remaining segments across multiple signal averages. A variant of REMAKE, termed REMAKE+, was developed to address any losses in SNR due to k-space information removal. With REMAKE+, multiple reconstructions using different initial conditions were performed, co-registered, and averaged. Both techniques were validated against clinical "standard" signal averaging reconstruction in a static phantom (with simulated motion) and 15 patients undergoing free-breathing cine imaging with multiple averages. Quantitative analysis of myocardial sharpness, blood/myocardial SNR, myocardial-blood contrast-to-noise ratio (CNR), as well as subjective assessment of image quality and rate of diagnostic quality images were performed. RESULTS In phantom, motion artifacts using "standard" (RMS error [RMSE]: 2.2 ± 0.5) were substantially reduced using REMAKE/REMAKE+ (RMSE: 1.5 ± 0.4/1.0 ± 0.4, p < 0.01). In patients, REMAKE/REMAKE+ led to higher myocardial sharpness (0.79 ± 0.09/0.79 ± 0.1 vs. 0.74 ± 0.12 for "standard", p = 0.004/0.04), higher image quality (1.8 ± 0.2/1.9 ± 0.2 vs. 1.6 ± 0.4 for "standard", p = 0.02/0.008), and a higher rate of diagnostic quality images (99%/100% vs. 94% for "standard"). Blood/myocardial SNR for "standard" (94 ± 30/33 ± 10) was higher vs. REMAKE (80 ± 25/28 ± 8, p = 0.002/0.005) and tended to be lower vs. REMAKE+ (105 ± 33/36 ± 12, p = 0.02/0.06). Myocardial-blood CNR for "standard" (61 ± 22) was higher vs. REMAKE (53 ± 19, p = 0.003) and lower vs. REMAKE+ (69 ± 24, p = 0.007). CONCLUSIONS Compared to "standard" signal averaging reconstruction, REMAKE and REMAKE+ provide improved myocardial sharpness, image quality, and rate of diagnostic quality images.
Collapse
Affiliation(s)
- Alexander Paul Neofytou
- School of Biomedical Engineering and Imaging Sciences, Faculty of Life Sciences and MedicineKing's College LondonLondonUK
| | - Radhouene Neji
- School of Biomedical Engineering and Imaging Sciences, Faculty of Life Sciences and MedicineKing's College LondonLondonUK
- MR Research CollaborationsSiemens Healthcare LimitedNewton House, Sir William Siemens Square, Frimley, CamberleySurreyUK
| | - Grzegorz Tomasz Kowalik
- School of Biomedical Engineering and Imaging Sciences, Faculty of Life Sciences and MedicineKing's College LondonLondonUK
| | - Ronald Mooiweer
- School of Biomedical Engineering and Imaging Sciences, Faculty of Life Sciences and MedicineKing's College LondonLondonUK
- MR Research CollaborationsSiemens Healthcare LimitedNewton House, Sir William Siemens Square, Frimley, CamberleySurreyUK
| | - James Wong
- Department of Paediatric CardiologyEvelina London Children's HospitalLondonUK
| | - Anastasia Fotaki
- School of Biomedical Engineering and Imaging Sciences, Faculty of Life Sciences and MedicineKing's College LondonLondonUK
| | - Joana Ferreira
- School of Biomedical Engineering and Imaging Sciences, Faculty of Life Sciences and MedicineKing's College LondonLondonUK
| | - Carl Evans
- School of Biomedical Engineering and Imaging Sciences, Faculty of Life Sciences and MedicineKing's College LondonLondonUK
| | - Filippo Bosio
- School of Biomedical Engineering and Imaging Sciences, Faculty of Life Sciences and MedicineKing's College LondonLondonUK
| | - Nabila Mughal
- School of Biomedical Engineering and Imaging Sciences, Faculty of Life Sciences and MedicineKing's College LondonLondonUK
| | - Reza Razavi
- School of Biomedical Engineering and Imaging Sciences, Faculty of Life Sciences and MedicineKing's College LondonLondonUK
| | - Kuberan Pushparajah
- School of Biomedical Engineering and Imaging Sciences, Faculty of Life Sciences and MedicineKing's College LondonLondonUK
- Department of Paediatric CardiologyEvelina London Children's HospitalLondonUK
| | - Sébastien Roujol
- School of Biomedical Engineering and Imaging Sciences, Faculty of Life Sciences and MedicineKing's College LondonLondonUK
| |
Collapse
|
43
|
Jafari M, Shoeibi A, Khodatars M, Ghassemi N, Moridian P, Alizadehsani R, Khosravi A, Ling SH, Delfan N, Zhang YD, Wang SH, Gorriz JM, Alinejad-Rokny H, Acharya UR. Automated diagnosis of cardiovascular diseases from cardiac magnetic resonance imaging using deep learning models: A review. Comput Biol Med 2023; 160:106998. [PMID: 37182422 DOI: 10.1016/j.compbiomed.2023.106998] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2022] [Revised: 03/01/2023] [Accepted: 04/28/2023] [Indexed: 05/16/2023]
Abstract
In recent years, cardiovascular diseases (CVDs) have become one of the leading causes of mortality globally. At early stages, CVDs appear with minor symptoms and progressively get worse. The majority of people experience symptoms such as exhaustion, shortness of breath, ankle swelling, fluid retention, and other symptoms when starting CVD. Coronary artery disease (CAD), arrhythmia, cardiomyopathy, congenital heart defect (CHD), mitral regurgitation, and angina are the most common CVDs. Clinical methods such as blood tests, electrocardiography (ECG) signals, and medical imaging are the most effective methods used for the detection of CVDs. Among the diagnostic methods, cardiac magnetic resonance imaging (CMRI) is increasingly used to diagnose, monitor the disease, plan treatment and predict CVDs. Coupled with all the advantages of CMR data, CVDs diagnosis is challenging for physicians as each scan has many slices of data, and the contrast of it might be low. To address these issues, deep learning (DL) techniques have been employed in the diagnosis of CVDs using CMR data, and much research is currently being conducted in this field. This review provides an overview of the studies performed in CVDs detection using CMR images and DL techniques. The introduction section examined CVDs types, diagnostic methods, and the most important medical imaging techniques. The following presents research to detect CVDs using CMR images and the most significant DL methods. Another section discussed the challenges in diagnosing CVDs from CMRI data. Next, the discussion section discusses the results of this review, and future work in CVDs diagnosis from CMR images and DL techniques are outlined. Finally, the most important findings of this study are presented in the conclusion section.
Collapse
Affiliation(s)
- Mahboobeh Jafari
- Internship in BioMedical Machine Learning Lab, The Graduate School of Biomedical Engineering, UNSW Sydney, Sydney, NSW, 2052, Australia
| | - Afshin Shoeibi
- Internship in BioMedical Machine Learning Lab, The Graduate School of Biomedical Engineering, UNSW Sydney, Sydney, NSW, 2052, Australia; Data Science and Computational Intelligence Institute, University of Granada, Spain.
| | - Marjane Khodatars
- Data Science and Computational Intelligence Institute, University of Granada, Spain
| | - Navid Ghassemi
- Internship in BioMedical Machine Learning Lab, The Graduate School of Biomedical Engineering, UNSW Sydney, Sydney, NSW, 2052, Australia
| | - Parisa Moridian
- Data Science and Computational Intelligence Institute, University of Granada, Spain
| | - Roohallah Alizadehsani
- Institute for Intelligent Systems Research and Innovation, Deakin University, Geelong, Australia
| | - Abbas Khosravi
- Institute for Intelligent Systems Research and Innovation, Deakin University, Geelong, Australia
| | - Sai Ho Ling
- Faculty of Engineering and IT, University of Technology Sydney (UTS), Australia
| | - Niloufar Delfan
- Faculty of Computer Engineering, Dept. of Artificial Intelligence Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Yu-Dong Zhang
- School of Computing and Mathematical Sciences, University of Leicester, Leicester, UK
| | - Shui-Hua Wang
- School of Computing and Mathematical Sciences, University of Leicester, Leicester, UK
| | - Juan M Gorriz
- Data Science and Computational Intelligence Institute, University of Granada, Spain; Department of Psychiatry, University of Cambridge, UK
| | - Hamid Alinejad-Rokny
- BioMedical Machine Learning Lab, The Graduate School of Biomedical Engineering, UNSW Sydney, Sydney, NSW, 2052, Australia; UNSW Data Science Hub, The University of New South Wales, Sydney, NSW, 2052, Australia; Health Data Analytics Program, Centre for Applied Artificial Intelligence, Macquarie University, Sydney, 2109, Australia
| | - U Rajendra Acharya
- School of Mathematics, Physics and Computing, University of Southern Queensland, Springfield, Australia; Dept. of Biomedical Informatics and Medical Engineering, Asia University, Taichung, Taiwan
| |
Collapse
|
44
|
Abdi M, Bilchick KC, Epstein FH. Compensation for respiratory motion-induced signal loss and phase corruption in free-breathing self-navigated cine DENSE using deep learning. Magn Reson Med 2023; 89:1975-1989. [PMID: 36602032 PMCID: PMC9992273 DOI: 10.1002/mrm.29582] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Revised: 11/25/2022] [Accepted: 12/26/2022] [Indexed: 01/06/2023]
Abstract
PURPOSE To introduce a model that describes the effects of rigid translation due to respiratory motion in displacement encoding with stimulated echoes (DENSE) and to use the model to develop a deep convolutional neural network to aid in first-order respiratory motion compensation for self-navigated free-breathing cine DENSE of the heart. METHODS The motion model includes conventional position shifts of magnetization and further describes the phase shift of the stimulated echo due to breathing. These image-domain effects correspond to linear and constant phase errors, respectively, in k-space. The model was validated using phantom experiments and Bloch-equation simulations and was used along with the simulation of respiratory motion to generate synthetic images with phase-shift artifacts to train a U-Net, DENSE-RESP-NET, to perform motion correction. DENSE-RESP-NET-corrected self-navigated free-breathing DENSE was evaluated in human subjects through comparisons with signal averaging, uncorrected self-navigated free-breathing DENSE, and breath-hold DENSE. RESULTS Phantom experiments and Bloch-equation simulations showed that breathing-induced constant phase errors in segmented DENSE leads to signal loss in magnitude images and phase corruption in phase images of the stimulated echo, and that these artifacts can be corrected using the known respiratory motion and the model. For self-navigated free-breathing DENSE where the respiratory motion is not known, DENSE-RESP-NET corrected the signal loss and phase-corruption artifacts and provided reliable strain measurements for systolic and diastolic parameters. CONCLUSION DENSE-RESP-NET is an effective method to correct for breathing-associated constant phase errors. DENSE-RESP-NET used in concert with self-navigation methods provides reliable free-breathing DENSE myocardial strain measurement.
Collapse
Affiliation(s)
- Mohamad Abdi
- Department of Biomedical Engineering, University of Virginia, Charlottesville, Virginia
| | - Kenneth C. Bilchick
- Department of Cardiovascular Medicine, University of Virginia Health System, Charlottesville, Virginia
| | - Frederick H. Epstein
- Department of Biomedical Engineering, University of Virginia, Charlottesville, Virginia
- Department of Radiology, University of Virginia Health System, Charlottesville, Virginia
| |
Collapse
|
45
|
Qiao X, Huang Y, Li W. MEDL-Net: A model-based neural network for MRI reconstruction with enhanced deep learned regularizers. Magn Reson Med 2023; 89:2062-2075. [PMID: 36656129 DOI: 10.1002/mrm.29575] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Revised: 12/09/2022] [Accepted: 12/20/2022] [Indexed: 01/20/2023]
Abstract
PURPOSE To improve the MRI reconstruction performance of model-based networks and to alleviate their large demand for GPU memory. METHODS A model-based neural network with enhanced deep learned regularizers (MEDL-Net) was proposed. The MEDL-Net is separated into several submodules, each of which consists of several cascades to mimic the optimization steps in conventional MRI reconstruction algorithms. Information from shallow cascades is densely connected to latter ones to enrich their inputs in each submodule, and additional revising blocks (RB) are stacked at the end of the submodules to bring more flexibility. Moreover, a composition loss function was designed to explicitly supervise RBs. RESULTS Network performance was evaluated on a publicly available dataset. The MEDL-Net quantitatively outperforms the state-of-the-art methods on different MR image sequences with different acceleration rates (four-fold and six-fold). Moreover, the reconstructed images showed that the detailed textures are better preserved. In addition, fewer cascades are required when achieving the same reconstruction results compared with other model-based networks. CONCLUSION In this study, a more efficient model-based deep network was proposed to reconstruct MR images. The experimental results indicate that the proposed method improves reconstruction performance with fewer cascades, which alleviates the large demand for GPU memory.
Collapse
Affiliation(s)
- Xiaoyu Qiao
- Chongqing Key Laboratory of Image Cognition, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Yuping Huang
- Chongqing Key Laboratory of Image Cognition, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Weisheng Li
- Chongqing Key Laboratory of Image Cognition, Chongqing University of Posts and Telecommunications, Chongqing, China
| |
Collapse
|
46
|
Shimron E, Perlman O. AI in MRI: Computational Frameworks for a Faster, Optimized, and Automated Imaging Workflow. Bioengineering (Basel) 2023; 10:bioengineering10040492. [PMID: 37106679 PMCID: PMC10135995 DOI: 10.3390/bioengineering10040492] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Revised: 04/12/2023] [Accepted: 04/18/2023] [Indexed: 04/29/2023] Open
Abstract
Over the last decade, artificial intelligence (AI) has made an enormous impact on a wide range of fields, including science, engineering, informatics, finance, and transportation [...].
Collapse
Affiliation(s)
- Efrat Shimron
- Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, CA 94720, USA
| | - Or Perlman
- Department of Biomedical Engineering, Tel Aviv University, Tel Aviv 6997801, Israel
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv 6997801, Israel
| |
Collapse
|
47
|
Kravchenko D, Isaak A, Zhang S, Katemann C, Mesropyan N, Bischoff LM, Pieper CC, Kuetting D, Attenberger U, Weber O, Hart C, Luetkens JA. Free-breathing pseudo-golden-angle bSSFP cine cardiac MRI for biventricular functional assessment in congenital heart disease. Eur J Radiol 2023; 163:110831. [PMID: 37059004 DOI: 10.1016/j.ejrad.2023.110831] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2023] [Revised: 03/23/2023] [Accepted: 04/07/2023] [Indexed: 04/16/2023]
Abstract
PURPOSE To compare standard breath-hold (BH) cine imaging to a radial pseudo-golden-angle free-breathing (FB) technique in congenital heart disease (CHD). METHODS In this prospective study, short-axis and 4-chamber BH and FB cardiac MRI sequences of 25 participants with CHD acquired at 1.5 Tesla, were quantitatively compared regarding ventricular volumes, function, interventricular septum thickness (IVSD), apparent signal to noise ratio (aSNR), and estimated contrast to noise ratio (eCNR). For qualitative comparison, three image quality criteria (contrast, endocardial edge definition, and artefacts) were rated on a 5-point Likert scale (5: excellent, 1: non-diagnostic). Paired t-Test was used for group comparisons, Bland-Altman analysis for agreement between techniques. Inter-reader agreement was compared using intraclass correlation coefficient. RESULTS IVSD (BH 7.4 ± 2.1 mm vs FB 7.4 ± 1.9 mm, p =.71), biventricular ejection fraction (left ventricle [LV]: 56.4 ± 10.8% vs 56.1 ± 9.3%, p =.83; right ventricle [RV]: 49.5 ± 8.6% vs 49.7 ± 10.1%, p =.83), and biventricular end diastolic volume (LV: 176.3 ± 63.9 ml vs 173.9 ± 64.9 ml, p =.90; RV: 185.4 ± 63.8 ml vs 189.6 ± 66.6 ml, p =.34) were comparable. Mean measurement time for FB short-axis sequences was 8.1 ± 1.3 compared to 4.4 ± 1.3 min for BH (p <.001). Subjective image quality between sequences was deemed comparable, (4.6 ± 0.6 vs 4.5 ± 0.6, p =.26, for 4-chamber views) with a significant difference regarding short-axis views (4.9 ± 0.3 vs 4.5 ± 0.6, p =.008). aSNR was similar (BH 25.8 ± 11.2 vs FB 22.2 ± 9.5, p =.24), while eCNR was higher for BH (89.1 ± 36.1 vs 68.5 ± 32.1, p =.03). CONCLUSION FB sequences yielded comparable results to BH regarding image quality, biventricular volumetry, and function, though measurement times were longer. The FB sequence described might be clinically valuable when BHs are insufficiently performed.
Collapse
Affiliation(s)
- Dmitrij Kravchenko
- Department of Diagnostic and Interventional Radiology, University Hospital Bonn, Bonn, Germany; Quantitative Imaging Lab Bonn (QILaB), Germany
| | - Alexander Isaak
- Department of Diagnostic and Interventional Radiology, University Hospital Bonn, Bonn, Germany; Quantitative Imaging Lab Bonn (QILaB), Germany
| | - Shuo Zhang
- Philips GmbH Market DACH, Hamburg, Germany
| | | | - Narine Mesropyan
- Department of Diagnostic and Interventional Radiology, University Hospital Bonn, Bonn, Germany; Quantitative Imaging Lab Bonn (QILaB), Germany
| | - Leon M Bischoff
- Department of Diagnostic and Interventional Radiology, University Hospital Bonn, Bonn, Germany; Quantitative Imaging Lab Bonn (QILaB), Germany
| | - Claus C Pieper
- Department of Diagnostic and Interventional Radiology, University Hospital Bonn, Bonn, Germany
| | - Daniel Kuetting
- Department of Diagnostic and Interventional Radiology, University Hospital Bonn, Bonn, Germany; Quantitative Imaging Lab Bonn (QILaB), Germany
| | - Ulrike Attenberger
- Department of Diagnostic and Interventional Radiology, University Hospital Bonn, Bonn, Germany
| | | | - Christopher Hart
- Department of Diagnostic and Interventional Radiology, University Hospital Bonn, Bonn, Germany; Department of Pediatric Cardiology, University Hospital Bonn, Bonn, Germany
| | - Julian A Luetkens
- Department of Diagnostic and Interventional Radiology, University Hospital Bonn, Bonn, Germany; Quantitative Imaging Lab Bonn (QILaB), Germany.
| |
Collapse
|
48
|
Johnson PM, Lin DJ, Zbontar J, Zitnick CL, Sriram A, Muckley M, Babb JS, Kline M, Ciavarra G, Alaia E, Samim M, Walter WR, Calderon L, Pock T, Sodickson DK, Recht MP, Knoll F. Deep Learning Reconstruction Enables Prospectively Accelerated Clinical Knee MRI. Radiology 2023; 307:e220425. [PMID: 36648347 PMCID: PMC10102623 DOI: 10.1148/radiol.220425] [Citation(s) in RCA: 27] [Impact Index Per Article: 27.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2022] [Revised: 10/20/2022] [Accepted: 11/15/2022] [Indexed: 01/18/2023]
Abstract
Background MRI is a powerful diagnostic tool with a long acquisition time. Recently, deep learning (DL) methods have provided accelerated high-quality image reconstructions from undersampled data, but it is unclear if DL image reconstruction can be reliably translated to everyday clinical practice. Purpose To determine the diagnostic equivalence of prospectively accelerated DL-reconstructed knee MRI compared with conventional accelerated MRI for evaluating internal derangement of the knee in a clinical setting. Materials and Methods A DL reconstruction model was trained with images from 298 clinical 3-T knee examinations. In a prospective analysis, patients clinically referred for knee MRI underwent a conventional accelerated knee MRI protocol at 3 T followed by an accelerated DL protocol between January 2020 and February 2021. The equivalence of the DL reconstruction of the images relative to the conventional images for the detection of an abnormality was assessed in terms of interchangeability. Each examination was reviewed by six musculoskeletal radiologists. Analyses pertaining to the detection of meniscal or ligament tears and bone marrow or cartilage abnormalities were based on four-point ordinal scores for the likelihood of an abnormality. Additionally, the protocols were compared with use of four-point ordinal scores for each aspect of image quality: overall image quality, presence of artifacts, sharpness, and signal-to-noise ratio. Results A total of 170 participants (mean age ± SD, 45 years ± 16; 76 men) were evaluated. The DL-reconstructed images were determined to be of diagnostic equivalence with the conventional images for detection of abnormalities. The overall image quality score, averaged over six readers, was significantly better (P < .001) for the DL than for the conventional images. Conclusion In a clinical setting, deep learning reconstruction enabled a nearly twofold reduction in scan time for a knee MRI and was diagnostically equivalent with the conventional protocol. © RSNA, 2023 Supplemental material is available for this article. See also the editorial by Roemer in this issue.
Collapse
Affiliation(s)
- Patricia M. Johnson
- From the Department of Radiology, New York University Grossman School of Medicine, 650 1st Ave, New York, NY 10016 (P.M.J., D.J.L., J.S.B., M.K., G.C., E.A., M.S., W.R.W., L.C., D.K.S., M.P.R., F.K.); Meta AI Research (FAIR), Menlo Park, Calif (J.Z., C.L.Z., A.S.); Meta AI Research, New York, NY (M.M.); Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Austria (T.P.); and Faculty of Engineering, Friedrich Alexander University Erlangen-Nurnberg (FAU), Erlangen, Germany (F.K.)
| | - Dana J. Lin
- From the Department of Radiology, New York University Grossman School of Medicine, 650 1st Ave, New York, NY 10016 (P.M.J., D.J.L., J.S.B., M.K., G.C., E.A., M.S., W.R.W., L.C., D.K.S., M.P.R., F.K.); Meta AI Research (FAIR), Menlo Park, Calif (J.Z., C.L.Z., A.S.); Meta AI Research, New York, NY (M.M.); Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Austria (T.P.); and Faculty of Engineering, Friedrich Alexander University Erlangen-Nurnberg (FAU), Erlangen, Germany (F.K.)
| | - Jure Zbontar
- From the Department of Radiology, New York University Grossman School of Medicine, 650 1st Ave, New York, NY 10016 (P.M.J., D.J.L., J.S.B., M.K., G.C., E.A., M.S., W.R.W., L.C., D.K.S., M.P.R., F.K.); Meta AI Research (FAIR), Menlo Park, Calif (J.Z., C.L.Z., A.S.); Meta AI Research, New York, NY (M.M.); Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Austria (T.P.); and Faculty of Engineering, Friedrich Alexander University Erlangen-Nurnberg (FAU), Erlangen, Germany (F.K.)
| | - C. Lawrence Zitnick
- From the Department of Radiology, New York University Grossman School of Medicine, 650 1st Ave, New York, NY 10016 (P.M.J., D.J.L., J.S.B., M.K., G.C., E.A., M.S., W.R.W., L.C., D.K.S., M.P.R., F.K.); Meta AI Research (FAIR), Menlo Park, Calif (J.Z., C.L.Z., A.S.); Meta AI Research, New York, NY (M.M.); Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Austria (T.P.); and Faculty of Engineering, Friedrich Alexander University Erlangen-Nurnberg (FAU), Erlangen, Germany (F.K.)
| | - Anuroop Sriram
- From the Department of Radiology, New York University Grossman School of Medicine, 650 1st Ave, New York, NY 10016 (P.M.J., D.J.L., J.S.B., M.K., G.C., E.A., M.S., W.R.W., L.C., D.K.S., M.P.R., F.K.); Meta AI Research (FAIR), Menlo Park, Calif (J.Z., C.L.Z., A.S.); Meta AI Research, New York, NY (M.M.); Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Austria (T.P.); and Faculty of Engineering, Friedrich Alexander University Erlangen-Nurnberg (FAU), Erlangen, Germany (F.K.)
| | - Matthew Muckley
- From the Department of Radiology, New York University Grossman School of Medicine, 650 1st Ave, New York, NY 10016 (P.M.J., D.J.L., J.S.B., M.K., G.C., E.A., M.S., W.R.W., L.C., D.K.S., M.P.R., F.K.); Meta AI Research (FAIR), Menlo Park, Calif (J.Z., C.L.Z., A.S.); Meta AI Research, New York, NY (M.M.); Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Austria (T.P.); and Faculty of Engineering, Friedrich Alexander University Erlangen-Nurnberg (FAU), Erlangen, Germany (F.K.)
| | - James S. Babb
- From the Department of Radiology, New York University Grossman School of Medicine, 650 1st Ave, New York, NY 10016 (P.M.J., D.J.L., J.S.B., M.K., G.C., E.A., M.S., W.R.W., L.C., D.K.S., M.P.R., F.K.); Meta AI Research (FAIR), Menlo Park, Calif (J.Z., C.L.Z., A.S.); Meta AI Research, New York, NY (M.M.); Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Austria (T.P.); and Faculty of Engineering, Friedrich Alexander University Erlangen-Nurnberg (FAU), Erlangen, Germany (F.K.)
| | - Mitchell Kline
- From the Department of Radiology, New York University Grossman School of Medicine, 650 1st Ave, New York, NY 10016 (P.M.J., D.J.L., J.S.B., M.K., G.C., E.A., M.S., W.R.W., L.C., D.K.S., M.P.R., F.K.); Meta AI Research (FAIR), Menlo Park, Calif (J.Z., C.L.Z., A.S.); Meta AI Research, New York, NY (M.M.); Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Austria (T.P.); and Faculty of Engineering, Friedrich Alexander University Erlangen-Nurnberg (FAU), Erlangen, Germany (F.K.)
| | - Gina Ciavarra
- From the Department of Radiology, New York University Grossman School of Medicine, 650 1st Ave, New York, NY 10016 (P.M.J., D.J.L., J.S.B., M.K., G.C., E.A., M.S., W.R.W., L.C., D.K.S., M.P.R., F.K.); Meta AI Research (FAIR), Menlo Park, Calif (J.Z., C.L.Z., A.S.); Meta AI Research, New York, NY (M.M.); Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Austria (T.P.); and Faculty of Engineering, Friedrich Alexander University Erlangen-Nurnberg (FAU), Erlangen, Germany (F.K.)
| | - Erin Alaia
- From the Department of Radiology, New York University Grossman School of Medicine, 650 1st Ave, New York, NY 10016 (P.M.J., D.J.L., J.S.B., M.K., G.C., E.A., M.S., W.R.W., L.C., D.K.S., M.P.R., F.K.); Meta AI Research (FAIR), Menlo Park, Calif (J.Z., C.L.Z., A.S.); Meta AI Research, New York, NY (M.M.); Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Austria (T.P.); and Faculty of Engineering, Friedrich Alexander University Erlangen-Nurnberg (FAU), Erlangen, Germany (F.K.)
| | - Mohammad Samim
- From the Department of Radiology, New York University Grossman School of Medicine, 650 1st Ave, New York, NY 10016 (P.M.J., D.J.L., J.S.B., M.K., G.C., E.A., M.S., W.R.W., L.C., D.K.S., M.P.R., F.K.); Meta AI Research (FAIR), Menlo Park, Calif (J.Z., C.L.Z., A.S.); Meta AI Research, New York, NY (M.M.); Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Austria (T.P.); and Faculty of Engineering, Friedrich Alexander University Erlangen-Nurnberg (FAU), Erlangen, Germany (F.K.)
| | - William R. Walter
- From the Department of Radiology, New York University Grossman School of Medicine, 650 1st Ave, New York, NY 10016 (P.M.J., D.J.L., J.S.B., M.K., G.C., E.A., M.S., W.R.W., L.C., D.K.S., M.P.R., F.K.); Meta AI Research (FAIR), Menlo Park, Calif (J.Z., C.L.Z., A.S.); Meta AI Research, New York, NY (M.M.); Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Austria (T.P.); and Faculty of Engineering, Friedrich Alexander University Erlangen-Nurnberg (FAU), Erlangen, Germany (F.K.)
| | - Liz Calderon
- From the Department of Radiology, New York University Grossman School of Medicine, 650 1st Ave, New York, NY 10016 (P.M.J., D.J.L., J.S.B., M.K., G.C., E.A., M.S., W.R.W., L.C., D.K.S., M.P.R., F.K.); Meta AI Research (FAIR), Menlo Park, Calif (J.Z., C.L.Z., A.S.); Meta AI Research, New York, NY (M.M.); Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Austria (T.P.); and Faculty of Engineering, Friedrich Alexander University Erlangen-Nurnberg (FAU), Erlangen, Germany (F.K.)
| | - Thomas Pock
- From the Department of Radiology, New York University Grossman School of Medicine, 650 1st Ave, New York, NY 10016 (P.M.J., D.J.L., J.S.B., M.K., G.C., E.A., M.S., W.R.W., L.C., D.K.S., M.P.R., F.K.); Meta AI Research (FAIR), Menlo Park, Calif (J.Z., C.L.Z., A.S.); Meta AI Research, New York, NY (M.M.); Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Austria (T.P.); and Faculty of Engineering, Friedrich Alexander University Erlangen-Nurnberg (FAU), Erlangen, Germany (F.K.)
| | - Daniel K. Sodickson
- From the Department of Radiology, New York University Grossman School of Medicine, 650 1st Ave, New York, NY 10016 (P.M.J., D.J.L., J.S.B., M.K., G.C., E.A., M.S., W.R.W., L.C., D.K.S., M.P.R., F.K.); Meta AI Research (FAIR), Menlo Park, Calif (J.Z., C.L.Z., A.S.); Meta AI Research, New York, NY (M.M.); Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Austria (T.P.); and Faculty of Engineering, Friedrich Alexander University Erlangen-Nurnberg (FAU), Erlangen, Germany (F.K.)
| | - Michael P. Recht
- From the Department of Radiology, New York University Grossman School of Medicine, 650 1st Ave, New York, NY 10016 (P.M.J., D.J.L., J.S.B., M.K., G.C., E.A., M.S., W.R.W., L.C., D.K.S., M.P.R., F.K.); Meta AI Research (FAIR), Menlo Park, Calif (J.Z., C.L.Z., A.S.); Meta AI Research, New York, NY (M.M.); Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Austria (T.P.); and Faculty of Engineering, Friedrich Alexander University Erlangen-Nurnberg (FAU), Erlangen, Germany (F.K.)
| | - Florian Knoll
- From the Department of Radiology, New York University Grossman School of Medicine, 650 1st Ave, New York, NY 10016 (P.M.J., D.J.L., J.S.B., M.K., G.C., E.A., M.S., W.R.W., L.C., D.K.S., M.P.R., F.K.); Meta AI Research (FAIR), Menlo Park, Calif (J.Z., C.L.Z., A.S.); Meta AI Research, New York, NY (M.M.); Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Austria (T.P.); and Faculty of Engineering, Friedrich Alexander University Erlangen-Nurnberg (FAU), Erlangen, Germany (F.K.)
| |
Collapse
|
49
|
Hilabi BS, Alghamdi SA, Almanaa M. Impact of Magnetic Resonance Imaging on Healthcare in Low- and Middle-Income Countries. Cureus 2023; 15:e37698. [PMID: 37081900 PMCID: PMC10112545 DOI: 10.7759/cureus.37698] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/17/2023] [Indexed: 04/22/2023] Open
Abstract
Magnetic resonance imaging (MRI) played a significant role in the digital health platforms that influenced and supported modern medicine. However, there is a shortage of MRI in low- and middle-income countries (LMICs). The International Society of Radiology offers a detailed plan for LMICs to advance imaging quality in the global health agenda. The overarching objective of this scoping review was to determine the impact of MRI in healthcare in LMICs. This scoping review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines to identify available evidence. We systematically searched four academic databases for peer-reviewed literature published between 2018 and 2021, namely, Medline, PubMed, Web of Science, and Scopus, as well as Google Scholar as a source for gray literature. The search identified 54 articles. We identified a range of reasons for introducing MRI in LMICs. Nonetheless, some challenges to accepting MRI as a method of healthcare have been reported, including technological, regulatory, and economical challenges. To implement the proposed plan, the involvement of professional and international organizations is considered crucial. The establishment of an International Commission on Medical Imaging under the umbrella of international organizations is suggested and collaboration with other diagnostic disciplines is encouraged to raise awareness of the importance of upscale diagnostics at large and to foster its integration into the care pathway globally.
Collapse
|
50
|
Iyer SS, Schauman SS, Sandino CM, Yurt M, Cao X, Liao C, Ruengchaijatuporn N, Chatnuntawech I, Tong E, Setsompop K. Deep Learning Initialized Compressed Sensing (Deli-CS) in Volumetric Spatio-Temporal Subspace Reconstruction. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.03.28.534431. [PMID: 37034586 PMCID: PMC10081201 DOI: 10.1101/2023.03.28.534431] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
Introduction Spatio-temporal MRI methods enable whole-brain multi-parametric mapping at ultra-fast acquisition times through efficient k-space encoding, but can have very long reconstruction times, which limit their integration into clinical practice. Deep learning (DL) is a promising approach to accelerate reconstruction, but can be computationally intensive to train and deploy due to the large dimensionality of spatio-temporal MRI. DL methods also need large training data sets and can produce results that don't match the acquired data if data consistency is not enforced. The aim of this project is to reduce reconstruction time using DL whilst simultaneously limiting the risk of deep learning induced hallucinations, all with modest hardware requirements. Methods Deep Learning Initialized Compressed Sensing (Deli-CS) is proposed to reduce the reconstruction time of iterative reconstructions by "kick-starting" the iterative reconstruction with a DL generated starting point. The proposed framework is applied to volumetric multi-axis spiral projection MRF that achieves whole-brain T1 and T2 mapping at 1-mm isotropic resolution for a 2-minute acquisition. First, the traditional reconstruction is optimized from over two hours to less than 40 minutes while using more than 90% less RAM and only 4.7 GB GPU memory, by using a memory-efficient GPU implementation. The Deli-CS framework is then implemented and evaluated against the above reconstruction. Results Deli-CS achieves comparable reconstruction quality with 50% fewer iterations bringing the full reconstruction time to 20 minutes. Conclusion Deli-CS reduces the reconstruction time of subspace reconstruction of volumetric spatio-temporal acquisitions by providing a warm start to the iterative reconstruction algorithm.
Collapse
Affiliation(s)
- Siddharth S. Iyer
- Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, MA, USA
- Department of Radiology, Stanford University, CA, USA
| | | | | | - Mahmut Yurt
- Department of Electrical Engineering, Stanford University, CA, USA
| | - Xiaozhi Cao
- Department of Radiology, Stanford University, CA, USA
| | - Congyu Liao
- Department of Radiology, Stanford University, CA, USA
| | - Natthanan Ruengchaijatuporn
- Center of Excellence in Computational Molecular Biology, Chulalongkorn University, Bangkok, Thailand
- Center for Artificial Intelligence in Medicine, Chulalongkorn University, Bangkok, Thailand
| | - Itthi Chatnuntawech
- National Nanotechnology Center, National Science and Technology Development Agency, Pathum Thani, Thailand
| | | | - Kawin Setsompop
- Department of Radiology, Stanford University, CA, USA
- Department of Electrical Engineering, Stanford University, CA, USA
| |
Collapse
|