Deep complex convolutional network for fast reconstruction of 3D late gadolinium enhancement cardiac MRI

Knowledge-driven deep learning for fast MR imaging: Undersampled MR image reconstruction from supervised to un-supervised learning

Deep learning (DL) has emerged as a leading approach in accelerating MRI. It employs deep neural networks to extract knowledge from available datasets and then applies the trained networks to reconstruct accurate images from limited measurements. Unlike natural image restoration problems, MRI involves physics-based imaging processes, unique data properties, and diverse imaging tasks. This domain knowledge needs to be integrated with data-driven approaches. Our review will introduce the significant challenges faced by such knowledge-driven DL approaches in the context of fast MRI along with several notable solutions, which include learning neural networks and addressing different imaging application scenarios. The traits and trends of these techniques have also been given which have shifted from supervised learning to semi-supervised learning, and finally, to unsupervised learning methods. In addition, MR vendors' choices of DL reconstruction have been provided along with some discussions on open questions and future directions, which are critical for the reliable imaging systems.

The role of artificial intelligence in cardiovascular magnetic resonance imaging

Cardiovascular magnetic resonance (CMR) imaging is the gold standard test for myocardial tissue characterization and chamber volumetric and functional evaluation. However, manual CMR analysis can be time-consuming and is subject to intra- and inter-observer variability. Artificial intelligence (AI) is a field that permits automated task performance through the identification of high-level and complex data relationships. In this review, we review the rapidly growing role of AI in CMR, including image acquisition, sequence prescription, artifact detection, reconstruction, segmentation, and data reporting and analysis including quantification of volumes, function, myocardial infarction (MI) and scar detection, and prediction of outcomes. We conclude with a discussion of the emerging challenges to widespread adoption and solutions that will allow for successful, broader uptake of this powerful technology.

Improving the efficiency and accuracy of cardiovascular magnetic resonance with artificial intelligence-review of evidence and proposition of a roadmap to clinical translation

BACKGROUND

Cardiovascular magnetic resonance (CMR) is an important imaging modality for the assessment of heart disease; however, limitations of CMR include long exam times and high complexity compared to other cardiac imaging modalities. Recently advancements in artificial intelligence (AI) technology have shown great potential to address many CMR limitations. While the developments are remarkable, translation of AI-based methods into real-world CMR clinical practice remains at a nascent stage and much work lies ahead to realize the full potential of AI for CMR.

METHODS

Herein we review recent cutting-edge and representative examples demonstrating how AI can advance CMR in areas such as exam planning, accelerated image reconstruction, post-processing, quality control, classification and diagnosis.

RESULTS

These advances can be applied to speed up and simplify essentially every application including cine, strain, late gadolinium enhancement, parametric mapping, 3D whole heart, flow, perfusion and others. AI is a unique technology based on training models using data. Beyond reviewing the literature, this paper discusses important AI-specific issues in the context of CMR, including (1) properties and characteristics of datasets for training and validation, (2) previously published guidelines for reporting CMR AI research, (3) considerations around clinical deployment, (4) responsibilities of clinicians and the need for multi-disciplinary teams in the development and deployment of AI in CMR, (5) industry considerations, and (6) regulatory perspectives.

CONCLUSIONS

Understanding and consideration of all these factors will contribute to the effective and ethical deployment of AI to improve clinical CMR.

A motion-corrected deep-learning reconstruction framework for accelerating whole-heart magnetic resonance imaging in patients with congenital heart disease

BACKGROUND

Cardiovascular magnetic resonance (CMR) is an important imaging modality for the assessment and management of adult patients with congenital heart disease (CHD). However, conventional techniques for three-dimensional (3D) whole-heart acquisition involve long and unpredictable scan times and methods that accelerate scans via k-space undersampling often rely on long iterative reconstructions. Deep-learning-based reconstruction methods have recently attracted much interest due to their capacity to provide fast reconstructions while often outperforming existing state-of-the-art methods. In this study, we sought to adapt and validate a non-rigid motion-corrected model-based deep learning (MoCo-MoDL) reconstruction framework for 3D whole-heart MRI in a CHD patient cohort.

METHODS

The previously proposed deep-learning reconstruction framework MoCo-MoDL, which incorporates a non-rigid motion-estimation network and a denoising regularization network within an unrolled iterative reconstruction, was trained in an end-to-end manner using 39 CHD patient datasets. Once trained, the framework was evaluated in eight CHD patient datasets acquired with seven-fold prospective undersampling. Reconstruction quality was compared with the state-of-the-art non-rigid motion-corrected patch-based low-rank reconstruction method (NR-PROST) and against reference images (acquired with three-or-four-fold undersampling and reconstructed with NR-PROST).

RESULTS

Seven-fold undersampled scan times were 2.1 ± 0.3 minutes and reconstruction times were ∼30 seconds, approximately 240 times faster than an NR-PROST reconstruction. Image quality comparable to the reference images was achieved using the proposed MoCo-MoDL framework, with no statistically significant differences found in any of the assessed quantitative or qualitative image quality measures. Additionally, expert image quality scores indicated the MoCo-MoDL reconstructions were consistently of a higher quality than the NR-PROST reconstructions of the same data, with the differences in 12 of the 22 scores measured for individual vascular structures found to be statistically significant.

CONCLUSION

The MoCo-MoDL framework was applied to an adult CHD patient cohort, achieving good quality 3D whole-heart images from ∼2-minute scans with reconstruction times of ∼30 seconds.

High-resolution spiral real-time cardiac cine imaging with deep learning-based rapid image reconstruction and quantification

The objective of the current study was to develop and evaluate a DEep learning-based rapid Spiral Image REconstruction (DESIRE) and deep learning (DL)-based segmentation approach to quantify the left ventricular ejection fraction (LVEF) for high-resolution spiral real-time cine imaging, including 2D balanced steady-state free precession imaging at 1.5 T and gradient echo (GRE) imaging at 1.5 and 3 T. A 3D U-Net-based image reconstruction network and 2D U-Net-based image segmentation network were proposed and evaluated. Low-rank plus sparse (L+S) served as the reference for the image reconstruction network and manual contouring of the left ventricle was the reference of the segmentation network. To assess the image reconstruction quality, structural similarity index, peak signal-to-noise ratio, normalized root-mean-square error, and blind grading by two experienced cardiologists (5: excellent; 1: poor) were performed. To assess the segmentation performance, quantification of the LVEF on GRE imaging at 3 T was compared with the quantification from manual contouring. Excellent performance was demonstrated by the proposed technique. In terms of image quality, there was no difference between L+S and the proposed DESIRE technique. For quantification analysis, the proposed DL method was not different to the manual segmentation method (p > 0.05) in terms of quantification of LVEF. The reconstruction time for DESIRE was ~32 s (including nonuniform fast Fourier transform [NUFFT]) per dynamic series (40 frames), while the reconstruction time of L+S with GPU acceleration was approximately 3 min. The DL segmentation takes less than 5 s. In conclusion, the proposed DL-based image reconstruction and quantification techniques enabled 1-min image reconstruction for the whole heart and quantification with automatic reconstruction and quantification of the left ventricle function for high-resolution spiral real-time cine imaging with excellent performance.

Present and Future Innovations in AI and Cardiac MRI

Cardiac MRI is used to diagnose and treat patients with a multitude of cardiovascular diseases. Despite the growth of clinical cardiac MRI, complicated image prescriptions and long acquisition protocols limit the specialty and restrain its impact on the practice of medicine. Artificial intelligence (AI)-the ability to mimic human intelligence in learning and performing tasks-will impact nearly all aspects of MRI. Deep learning (DL) primarily uses an artificial neural network to learn a specific task from example data sets. Self-driving scanners are increasingly available, where AI automatically controls cardiac image prescriptions. These scanners offer faster image collection with higher spatial and temporal resolution, eliminating the need for cardiac triggering or breath holding. In the future, fully automated inline image analysis will most likely provide all contour drawings and initial measurements to the reader. Advanced analysis using radiomic or DL features may provide new insights and information not typically extracted in the current analysis workflow. AI may further help integrate these features with clinical, genetic, wearable-device, and "omics" data to improve patient outcomes. This article presents an overview of AI and its application in cardiac MRI, including in image acquisition, reconstruction, and processing, and opportunities for more personalized cardiovascular care through extraction of novel imaging markers.

Model-based Deep Learning Reconstruction Using a Folded Image Training Strategy for Abdominal 3D T1-weighted Imaging

PURPOSE

To evaluate the feasibility of folded image training strategy (FITS) and the quality of images reconstructed using the improved model-based deep learning (iMoDL) network trained with FITS (FITS-iMoDL) for abdominal MR imaging.

METHODS

This retrospective study included abdominal 3D T1-weighted images of 122 patients. In the experimental analyses, peak SNR (PSNR) and structure similarity index (SSIM) of images reconstructed with FITS-iMoDL were compared with those with the following reconstruction methods: conventional model-based deep learning (conv-MoDL), MoDL trained with FITS (FITS-MoDL), total variation regularized compressed sensing (CS), and parallel imaging (CG-SENSE). In the clinical analysis, SNR and image contrast were measured on the reference, FITS-iMoDL, and CS images. Three radiologists evaluated the image quality using a 5-point scale to determine the mean opinion score (MOS).

RESULTS

The PSNR of FITS-iMoDL was significantly higher than that of FITS-MoDL, conv-MoDL, CS, and CG-SENSE (P < 0.001). The SSIM of FITS-iMoDL was significantly higher than those of the others (P < 0.001), except for FITS-MoDL (P = 0.056). In the clinical analysis, the SNR of FITS-iMoDL was significantly higher than that of the reference and CS (P < 0.0001). Image contrast was equivalent within an equivalence margin of 10% among these three image sets (P < 0.0001). MOS was significantly improved in FITS-iMoDL (P < 0.001) compared with CS images in terms of liver edge and vessels conspicuity, lesion depiction, artifacts, blurring, and overall image quality.

CONCLUSION

The proposed method, FITS-iMoDL, allowed a deeper MoDL reconstruction network without increasing memory consumption and improved image quality on abdominal 3D T1-weighted imaging compared with CS images.

Automated diagnosis of cardiovascular diseases from cardiac magnetic resonance imaging using deep learning models: A review

In recent years, cardiovascular diseases (CVDs) have become one of the leading causes of mortality globally. At early stages, CVDs appear with minor symptoms and progressively get worse. The majority of people experience symptoms such as exhaustion, shortness of breath, ankle swelling, fluid retention, and other symptoms when starting CVD. Coronary artery disease (CAD), arrhythmia, cardiomyopathy, congenital heart defect (CHD), mitral regurgitation, and angina are the most common CVDs. Clinical methods such as blood tests, electrocardiography (ECG) signals, and medical imaging are the most effective methods used for the detection of CVDs. Among the diagnostic methods, cardiac magnetic resonance imaging (CMRI) is increasingly used to diagnose, monitor the disease, plan treatment and predict CVDs. Coupled with all the advantages of CMR data, CVDs diagnosis is challenging for physicians as each scan has many slices of data, and the contrast of it might be low. To address these issues, deep learning (DL) techniques have been employed in the diagnosis of CVDs using CMR data, and much research is currently being conducted in this field. This review provides an overview of the studies performed in CVDs detection using CMR images and DL techniques. The introduction section examined CVDs types, diagnostic methods, and the most important medical imaging techniques. The following presents research to detect CVDs using CMR images and the most significant DL methods. Another section discussed the challenges in diagnosing CVDs from CMRI data. Next, the discussion section discusses the results of this review, and future work in CVDs diagnosis from CMR images and DL techniques are outlined. Finally, the most important findings of this study are presented in the conclusion section.

Parallel non-Cartesian spatial-temporal dictionary learning neural networks (stDLNN) for accelerating 4D-MRI

Dynamic magnetic resonance imaging (MRI) acquisitions are relatively slow due to physical and physiological limitations. The spatial-temporal dictionary learning (DL) approach accelerates dynamic MRI by learning spatial-temporal correlations, but the regularization parameters need to be manually adjusted, the performance at high acceleration rate is limited, and the reconstruction can be time-consuming. Deep learning techniques have shown good performance in accelerating MRI due to the powerful representational capabilities of neural networks. In this work, we propose a parallel non-Cartesian spatial-temporal dictionary learning neural networks (stDLNN) framework that combines dictionary learning with deep learning algorithms and utilizes the spatial-temporal prior information of dynamic MRI data to achieve better reconstruction quality and efficiency. The coefficient estimation modules (CEM) are designed in the framework to adaptively adjust the regularization coefficients. Experimental results show that combining dictionary learning with deep neural networks and using spatial-temporal dictionaries can obviously improve the image quality and computational efficiency compared with the state-of-the-art non-Cartesian imaging methods for accelerating the 4D-MRI especially at high acceleration rate.

Accelerating 3D MTC-BOOST in patients with congenital heart disease using a joint multi-scale variational neural network reconstruction

PURPOSE

Free-breathing Magnetization Transfer Contrast Bright blOOd phase SensiTive (MTC-BOOST) is a prototype balanced-Steady-State Free Precession sequence for 3D whole-heart imaging, that employs the endogenous magnetisation transfer contrast mechanism. This achieves reduction of flow and off-resonance artefacts, that often arise with the clinical T2prepared balanced-Steady-State Free Precession sequence, enabling high quality, contrast-agent free imaging of the thoracic cardiovascular anatomy. Fully-sampled MTC-BOOST acquisition requires long scan times (~10-24 min) and therefore acceleration is needed to permit its clinical incorporation. The aim of this study is to enable and clinically validate the 5-fold accelerated MTC-BOOST acquisition with joint Multi-Scale Variational Neural Network (jMS-VNN) reconstruction.

METHODS

Thirty-six patients underwent free-breathing, 3D whole-heart imaging with the MTC-BOOST sequence, which is combined with variable density spiral-like Cartesian sampling and 2D image navigators for translational motion estimation. This sequence acquires two differently weighted bright-blood volumes in an interleaved fashion, which are then joined in a phase sensitive inversion recovery reconstruction to obtain a complementary fully co-registered black-blood volume. Data from eighteen patients were used for training, whereas data from the remaining eighteen patients were used for testing/evaluation. The proposed deep-learning based approach adopts a supervised multi-scale variational neural network for joint reconstruction of the two differently weighted bright-blood volumes acquired with the 5-fold accelerated MTC-BOOST. The two contrast images are stacked as different channels in the network to exploit the shared information. The proposed approach is compared to the fully-sampled MTC-BOOST and 5-fold undersampled MTC-BOOST acquisition with Compressed Sensing (CS) reconstruction in terms of scan/reconstruction time and bright-blood image quality. Comparison against conventional 2-fold undersampled T2-prepared 3D bright-blood whole-heart clinical sequence (T2prep-3DWH) is also included.

RESULTS

Acquisition time was 3.0 ± 1.0 min for the 5-fold accelerated MTC-BOOST versus 9.0 ± 1.1 min for the fully-sampled MTC-BOOST and 11.1 ± 2.6 min for the T2prep-3DWH (p < 0.001 and p < 0.001, respectively). Reconstruction time was significantly lower with the jMS-VNN method compared to CS (10 ± 0.5 min vs 20 ± 2 s, p < 0.001). Image quality was higher for the proposed 5-fold undersampled jMS-VNN versus conventional CS, comparable or higher to the corresponding T2prep-3DWH dataset and similar to the fully-sampled MTC-BOOST.

CONCLUSION

The proposed 5-fold accelerated jMS-VNN MTC-BOOST framework provides efficient 3D whole-heart bright-blood imaging in fast acquisition and reconstruction time with concomitant reduction of flow and off-resonance artefacts, that are frequently encountered with the clinical sequence. Image quality of the cardiac anatomy and thoracic vasculature is comparable or superior to the clinical scan and 5-fold CS reconstruction in faster reconstruction time, promising potential clinical adoption.

Application of medical imaging methods and artificial intelligence in tissue engineering and organ-on-a-chip

Organ-on-a-chip (OOC) is a new type of biochip technology. Various types of OOC systems have been developed rapidly in the past decade and found important applications in drug screening and precision medicine. However, due to the complexity in the structure of both the chip-body itself and the engineered-tissue inside, the imaging and analysis of OOC have still been a big challenge for biomedical researchers. Considering that medical imaging is moving towards higher spatial and temporal resolution and has more applications in tissue engineering, this paper aims to review medical imaging methods, including CT, micro-CT, MRI, small animal MRI, and OCT, and introduces the application of 3D printing in tissue engineering and OOC in which medical imaging plays an important role. The achievements of medical imaging assisted tissue engineering are reviewed, and the potential applications of medical imaging in organoids and OOC are discussed. Moreover, artificial intelligence - especially deep learning - has demonstrated its excellence in the analysis of medical imaging; we will also present the application of artificial intelligence in the image analysis of 3D tissues, especially for organoids developed in novel OOC systems.

DEep learning-based rapid Spiral Image REconstruction (DESIRE) for high-resolution spiral first-pass myocardial perfusion imaging

The objective of the current study was to develop and evaluate a DEep learning-based rapid Spiral Image REconstruction (DESIRE) technique for high-resolution spiral first-pass myocardial perfusion imaging with whole-heart coverage, to provide fast and accurate image reconstruction for both single-slice (SS) and simultaneous multislice (SMS) acquisitions. Three-dimensional U-Net-based image enhancement architectures were evaluated for high-resolution spiral perfusion imaging at 3 T. The SS and SMS MB = 2 networks were trained on SS perfusion images from 156 slices from 20 subjects. Structural similarity index (SSIM), peak signal-to-noise ratio (PSNR), and normalized root mean square error (NRMSE) were assessed, and prospective images were blindly graded by two experienced cardiologists (5: excellent; 1: poor). Excellent performance was demonstrated for the proposed technique. For SS, SSIM, PSNR, and NRMSE were 0.977 [0.972, 0.982], 42.113 [40.174, 43.493] dB, and 0.102 [0.080, 0.125], respectively, for the best network. For SMS MB = 2 retrospective data, SSIM, PSNR, and NRMSE were 0.961 [0.950, 0.969], 40.834 [39.619, 42.004] dB, and 0.107 [0.086, 0.133], respectively, for the best network. The image quality scores were 4.5 [4.1, 4.8], 4.5 [4.3, 4.6], 3.5 [3.3, 4], and 3.5 [3.3, 3.8] for SS DESIRE, SS L1-SPIRiT, MB = 2 DESIRE, and MB = 2 SMS-slice-L1-SPIRiT, respectively, showing no statistically significant difference (p = 1 and p = 1 for SS and SMS, respectively) between L1-SPIRiT and the proposed DESIRE technique. The network inference time was ~100 ms per dynamic perfusion series with DESIRE, while the reconstruction time of L1-SPIRiT with GPU acceleration was ~ 30 min. It was concluded that DESIRE enabled fast and high-quality image reconstruction for both SS and SMS MB = 2 whole-heart high-resolution spiral perfusion imaging.

Accelerating susceptibility-weighted imaging with deep learning by complex-valued convolutional neural network (ComplexNet): validation in clinical brain imaging

OBJECTIVES

Susceptibility-weighted imaging (SWI) is crucial for the characterization of intracranial hemorrhage and mineralization, but has the drawback of long acquisition times. We aimed to propose a deep learning model to accelerate SWI, and evaluate the clinical feasibility of this approach.

METHODS

A complex-valued convolutional neural network (ComplexNet) was developed to reconstruct high-quality SWI from highly accelerated k-space data. ComplexNet can leverage the inherently complex-valued nature of SWI data and learn richer representations by using complex-valued network. SWI data were acquired from 117 participants who underwent clinical brain MRI examination between 2019 and 2021, including patients with tumor, stroke, hemorrhage, traumatic brain injury, etc. Reconstruction quality was evaluated using quantitative image metrics and image quality scores, including overall image quality, signal-to-noise ratio, sharpness, and artifacts.

RESULTS

The average reconstruction time of ComplexNet was 19 ms per section (1.33 s per participant). ComplexNet achieved significantly improved quantitative image metrics compared to a conventional compressed sensing method and a real-valued network with acceleration rates of 5 and 8 (p < 0.001). Meanwhile, there was no significant difference between fully sampled and ComplexNet approaches in terms of overall image quality and artifacts (p > 0.05) at both acceleration rates. Furthermore, ComplexNet showed comparable diagnostic performance to the fully sampled SWI for visualizing a wide range of pathology, including hemorrhage, cerebral microbleeds, and brain tumor.

CONCLUSIONS

ComplexNet can effectively accelerate SWI while providing superior performance in terms of overall image quality and visualization of pathology for routine clinical brain imaging.

KEY POINTS

• The complex-valued convolutional neural network (ComplexNet) allowed fast and high-quality reconstruction of highly accelerated SWI data, with an average reconstruction time of 19 ms per section. • ComplexNet achieved significantly improved quantitative image metrics compared to a conventional compressed sensing method and a real-valued network with acceleration rates of 5 and 8 (p < 0.001). • ComplexNet showed comparable diagnostic performance to the fully sampled SWI for visualizing a wide range of pathology, including hemorrhage, cerebral microbleeds, and brain tumor.

The role of artificial intelligence in paediatric cardiovascular magnetic resonance imaging

Artificial intelligence (AI) offers the potential to change many aspects of paediatric cardiac imaging. At present, there are only a few clinically validated examples of AI applications in this field. This review focuses on the use of AI in paediatric cardiovascular MRI, using examples from paediatric cardiovascular MRI, adult cardiovascular MRI and other radiologic experience.

Review and Prospect: Artificial Intelligence in Advanced Medical Imaging

Artificial intelligence (AI) as an emerging technology is gaining momentum in medical imaging. Recently, deep learning-based AI techniques have been actively investigated in medical imaging, and its potential applications range from data acquisition and image reconstruction to image analysis and understanding. In this review, we focus on the use of deep learning in image reconstruction for advanced medical imaging modalities including magnetic resonance imaging (MRI), computed tomography (CT), and positron emission tomography (PET). Particularly, recent deep learning-based methods for image reconstruction will be emphasized, in accordance with their methodology designs and performances in handling volumetric imaging data. It is expected that this review can help relevant researchers understand how to adapt AI for medical imaging and which advantages can be achieved with the assistance of AI.

Emerging Techniques in Cardiac Magnetic Resonance Imaging

Cardiovascular disease is the leading cause of death and a significant contributor of health care costs. Noninvasive imaging plays an essential role in the management of patients with cardiovascular disease. Cardiac magnetic resonance (MR) can noninvasively assess heart and vascular abnormalities, including biventricular structure/function, blood hemodynamics, myocardial tissue composition, microstructure, perfusion, metabolism, coronary microvascular function, and aortic distensibility/stiffness. Its ability to characterize myocardial tissue composition is unique among alternative imaging modalities in cardiovascular disease. Significant growth in cardiac MR utilization, particularly in Europe in the last decade, has laid the necessary clinical groundwork to position cardiac MR as an important imaging modality in the workup of patients with cardiovascular disease. Although lack of availability, limited training, physician hesitation, and reimbursement issues have hampered widespread clinical adoption of cardiac MR in the United States, growing clinical evidence will ultimately overcome these challenges. Advances in cardiac MR techniques, particularly faster image acquisition, quantitative myocardial tissue characterization, and image analysis have been critical to its growth. In this review article, we discuss recent advances in established and emerging cardiac MR techniques that are expected to strengthen its capability in managing patients with cardiovascular disease. LEVEL OF EVIDENCE: 5 TECHNICAL EFFICACY: Stage 1.

Accelerating quantitative susceptibility and R2* mapping using incoherent undersampling and deep neural network reconstruction

Quantitative susceptibility mapping (QSM) and R2* mapping are MRI post-processing methods that quantify tissue magnetic susceptibility and transverse relaxation rate distributions. However, QSM and R2* acquisitions are relatively slow, even with parallel imaging. Incoherent undersampling and compressed sensing reconstruction techniques have been used to accelerate traditional magnitude-based MRI acquisitions; however, most do not recover the full phase signal, as required by QSM, due to its non-convex nature. In this study, a learning-based Deep Complex Residual Network (DCRNet) is proposed to recover both the magnitude and phase images from incoherently undersampled data, enabling high acceleration of QSM and R2* acquisition. Magnitude, phase, R2*, and QSM results from DCRNet were compared with two iterative and one deep learning methods on retrospectively undersampled acquisitions from six healthy volunteers, one intracranial hemorrhage and one multiple sclerosis patients, as well as one prospectively undersampled healthy subject using a 7T scanner. Peak signal to noise ratio (PSNR), structural similarity (SSIM), root-mean-squared error (RMSE), and region-of-interest susceptibility and R2* measurements are reported for numerical comparisons. The proposed DCRNet method substantially reduced artifacts and blurring compared to the other methods and resulted in the highest PSNR, SSIM, and RMSE on the magnitude, R2*, local field, and susceptibility maps. Compared to two iterative and one deep learning methods, the DCRNet method demonstrated a 3.2% to 9.1% accuracy improvement in deep grey matter susceptibility when accelerated by a factor of four. The DCRNet also dramatically shortened the reconstruction time of single 2D brain images from 36-140 seconds using conventional approaches to only 15-70 milliseconds.

Analysis of deep complex-valued convolutional neural networks for MRI reconstruction and phase-focused applications

PURPOSE

Deep learning has had success with MRI reconstruction, but previously published works use real-valued networks. The few works which have tried complex-valued networks have not fully assessed their impact on phase. Therefore, the purpose of this work is to fully investigate end-to-end complex-valued convolutional neural networks (CNNs) for accelerated MRI reconstruction and in several phase-based applications in comparison to 2-channel real-valued networks.

METHODS

Several complex-valued activation functions for MRI reconstruction were implemented, and their performance was compared. Complex-valued convolution was implemented and tested on an unrolled network architecture and a U-Net-based architecture over a wide range of network widths and depths with knee, body, and phase-contrast datasets.

RESULTS

Quantitative and qualitative results demonstrated that complex-valued CNNs with complex-valued convolutions provided superior reconstructions compared to real-valued convolutions with the same number of trainable parameters for both an unrolled network architecture and a U-Net-based architecture, and for 3 different datasets. Complex-valued CNNs consistently had superior normalized RMS error, structural similarity index, and peak SNR compared to real-valued CNNs.

CONCLUSION

Complex-valued CNNs can enable superior accelerated MRI reconstruction and phase-based applications such as fat-water separation, and flow quantification compared to real-valued convolutional neural networks.

Highly accelerated free-breathing real-time phase contrast cardiovascular MRI via complex-difference deep learning

PURPOSE

To develop and evaluate a real-time phase contrast (PC) MRI protocol via complex-difference deep learning (DL) framework.

METHODS

DL used two 3D U-nets to separately filter aliasing artifact from radial real-time velocity-compensated and complex-difference images. U-nets were trained with synthetic real-time PC generated from electrocardiograph (ECG) -gated, breath-hold, segmented PC (ECG-gated segmented PC) acquired at the ascending aorta of 510 patients. In 21 patients, free-breathing, ungated real-time (acceleration rate = 28.8) and ECG-gated segmented (acceleration rate = 2) PC were prospectively acquired at the ascending aorta. Hemodynamic parameters (cardiac output [CO], stroke volume [SV], and mean velocity at peak systole [peak mean velocity]) were measured for ECG-gated segmented and DL-filtered synthetic real-time PC and compared using Bland-Altman and linear regression analyses. Additionally, hemodynamic parameters were quantified from DL-filtered, compressed-sensing (CS) -reconstructed, and gridding reconstructed prospective real-time PC and compared to ECG-gated segmented PC.

RESULTS

Synthetic real-time PC with DL showed strong correlation (R > 0.98) and good agreement with ECG-gated segmented PC for quantified hemodynamic parameters (mean-difference: CO = -0.3 L/min, SV = -4.3 mL, peak mean velocity = -2.3 cm/s). On average, DL required 0.39 s/frame to filter prospective real-time PC, which was 4.6-fold faster than CS. Compared to CS, DL showed superior correlation, tighter limits of agreement (LOAs), better bias for peak mean velocity, and worse bias for CO and SV. Compared to gridding, DL showed similar correlation, tighter LOAs for CO and SV, similar bias for CO, and worse bias for SV and peak mean velocity.

CONCLUSION

The complex-difference DL framework accelerated real-time PC-MRI by nearly 28-fold, enabling rapid free-running real-time assessment of flow hemodynamics.