Statistically Segregated k-Space Sampling for Accelerating Multiple-Acquisition MRI

Deep learning for accelerated and robust MRI reconstruction

Deep learning (DL) has recently emerged as a pivotal technology for enhancing magnetic resonance imaging (MRI), a critical tool in diagnostic radiology. This review paper provides a comprehensive overview of recent advances in DL for MRI reconstruction, and focuses on various DL approaches and architectures designed to improve image quality, accelerate scans, and address data-related challenges. It explores end-to-end neural networks, pre-trained and generative models, and self-supervised methods, and highlights their contributions to overcoming traditional MRI limitations. It also discusses the role of DL in optimizing acquisition protocols, enhancing robustness against distribution shifts, and tackling biases. Drawing on the extensive literature and practical insights, it outlines current successes, limitations, and future directions for leveraging DL in MRI reconstruction, while emphasizing the potential of DL to significantly impact clinical imaging practices.

Evaluation of kernel low-rank compressed sensing in preclinical diffusion magnetic resonance imaging

Compressed sensing (CS) is widely used to accelerate clinical diffusion MRI acquisitions, but it is not widely used in preclinical settings yet. In this study, we optimized and compared several CS reconstruction methods for diffusion imaging. Different undersampling patterns and two reconstruction approaches were evaluated: conventional CS, based on Berkeley Advanced Reconstruction Toolbox (BART-CS) toolbox, and a new kernel low-rank (KLR)-CS, based on kernel principal component analysis and low-resolution-phase (LRP) maps. 3D CS acquisitions were performed at 9.4T using a 4-element cryocoil on mice (wild type and a MAP6 knockout). Comparison metrics were error and structural similarity index measure (SSIM) on fractional anisotropy (FA) and mean diffusivity (MD), as well as reconstructions of the anterior commissure and fornix. Acceleration factors (AF) up to 6 were considered. In the case of retrospective undersampling, the proposed KLR-CS outperformed BART-CS up to AF = 6 for FA and MD maps and tractography. For instance, for AF = 4, the maximum errors were, respectively, 8.0% for BART-CS and 4.9% for KLR-CS, considering both FA and MD in the corpus callosum. Regarding undersampled acquisitions, these maximum errors became, respectively, 10.5% for BART-CS and 7.0% for KLR-CS. This difference between simulations and acquisitions arose mainly from repetition noise, but also from differences in resonance frequency drift, signal-to-noise ratio, and in reconstruction noise. Despite this increased error, fully sampled and AF = 2 yielded comparable results for FA, MD and tractography, and AF = 4 showed minor faults. Altogether, KLR-CS based on LRP maps seems a robust approach to accelerate preclinical diffusion MRI and thereby limit the effect of the frequency drift.

Fast Multi-Contrast MRI Acquisition by Optimal Sampling of Information Complementary to Pre-Acquired MRI Contrast

Recent studies on multi-contrast MRI reconstruction have demonstrated the potential of further accelerating MRI acquisition by exploiting correlation between contrasts. Most of the state-of-the-art approaches have achieved improvement through the development of network architectures for fixed under-sampling patterns, without considering inter-contrast correlation in the under-sampling pattern design. On the other hand, sampling pattern learning methods have shown better reconstruction performance than those with fixed under-sampling patterns. However, most under-sampling pattern learning algorithms are designed for single contrast MRI without exploiting complementary information between contrasts. To this end, we propose a framework to optimize the under-sampling pattern of a target MRI contrast which complements the acquired fully-sampled reference contrast. Specifically, a novel image synthesis network is introduced to extract the redundant information contained in the reference contrast, which is exploited in the subsequent joint pattern optimization and reconstruction network. We have demonstrated superior performance of our learned under-sampling patterns on both public and in-house datasets, compared to the commonly used under-sampling patterns and state-of-the-art methods that jointly optimize the reconstruction network and the under-sampling patterns, up to 8-fold under-sampling factor.

Simultaneously optimizing sampling pattern for joint acceleration of multi-contrast MRI using model-based deep learning

BACKGROUND

Acceleration of MR imaging (MRI) is a popular research area, and usage of deep learning for acceleration has become highly widespread in the MR community. Joint acceleration of multiple-acquisition MRI was proven to be effective over a single-acquisition approach. Also, optimization in the sampling pattern demonstrated its advantage over conventional undersampling pattern. However, optimizing the sampling patterns for joint acceleration of multiple-acquisition MRI has not been investigated well.

PURPOSE

To develop a model-based deep learning scheme to optimize sampling patterns for a joint acceleration of multi-contrast MRI.

METHODS

The proposed scheme combines sampling pattern optimization and multi-contrast MRI reconstruction. It was extended from the physics-guided method of the joint model-based deep learning (J-MoDL) scheme to optimize the separate sampling pattern for each of multiple contrasts simultaneously for their joint reconstruction. Tests were performed with three contrasts of T2-weighted, FLAIR, and T1-weighted images. The proposed multi-contrast method was compared to (i) single-contrast method with sampling optimization (baseline J-MoDL), (ii) multi-contrast method without sampling optimization, and (iii) multi-contrast method with single common sampling optimization for all contrasts. The optimized sampling patterns were analyzed for sampling location overlap across contrasts. The scheme was also tested in a data-driven scenario, where the inversion between input and label was learned from the under-sampled data directly and tested on knee datasets for generalization test.

RESULTS

The proposed scheme demonstrated a quantitative and qualitative advantage over the single-contrast scheme with sampling pattern optimization and the multi-contrast scheme without sampling pattern optimization. Optimizing the separate sampling pattern for each of the multi-contrasts was superior to optimizing only one common sampling pattern for all contrasts. The proposed scheme showed less overlap in sampling locations than the single-contrast scheme. The main hypothesis was also held in the data-driven situation as well. The brain-trained model worked well on the knee images, demonstrating its generalizability.

CONCLUSION

Our study introduced an effective scheme that combines the sampling optimization and the multi-contrast acceleration. The seamless combination resulted in superior performance over the other existing methods.

Varying undersampling directions for accelerating multiple acquisition magnetic resonance imaging

In this study, we propose a new sampling strategy for efficiently accelerating multiple acquisition MRI. The new sampling strategy is to obtain data along different phase-encoding directions across multiple acquisitions. The proposed sampling strategy was evaluated in multicontrast MR imaging (T1, T2, proton density) and multiple phase-cycled (PC) balanced steady-state free precession (bSSFP) imaging by using convolutional neural networks with central and random sampling patterns. In vivo MRI acquisitions as well as a public database were used to test the concept. Based on both visual inspection and quantitative analysis, the proposed sampling strategy showed better performance than sampling along the same phase-encoding direction in both multicontrast MR imaging and multiple PC-bSSFP imaging, regardless of sampling pattern (central, random) or datasets (public, retrospective and prospective in vivo). For the prospective in vivo applications, acceleration was performed by sampling along different phase-encoding directions at the time of acquisition with a conventional rectangular field of view, which demonstrated the advantage of the proposed sampling strategy in the real environment. Preliminary trials on compressed sensing (CS) also demonstrated improvement of CS with the proposed idea. Sampling along different phase-encoding directions across multiple acquisitions is advantageous for accelerating multiacquisition MRI, irrespective of sampling pattern or datasets, with further improvement through transfer learning.

Utilizing the Wavelet Transform's Structure in Compressed Sensing

Compressed sensing has empowered quality image reconstruction with fewer data samples than previously thought possible. These techniques rely on a sparsifying linear transformation. The Daubechies wavelet transform is commonly used for this purpose. In this work, we take advantage of the structure of this wavelet transform and identify an affine transformation that increases the sparsity of the result. After inclusion of this affine transformation, we modify the resulting optimization problem to comply with the form of the Basis Pursuit Denoising problem. Finally, we show theoretically that this yields a lower bound on the error of the reconstruction and present results where solving this modified problem yields images of higher quality for the same sampling patterns using both magnetic resonance and optical images.

Mapping Human Fetal Brain Maturation In Vivo Using Quantitative MRI

BACKGROUND AND PURPOSE

On the basis of a single multidynamic multiecho sequence acquisition, SyMRI generates a variety of quantitative image data that can characterize tissue-specific properties. The aim of this retrospective study was to evaluate the feasibility of SyMRI for the qualitative and quantitative assessment of fetal brain maturation.

MATERIALS AND METHODS

In 52 fetuses, multidynamic multiecho sequence acquisitions were available. SyMRI was used to perform multidynamic multiecho-based postprocessing. Fetal brain maturity was scored qualitatively on the basis of SyMRI-generated MR imaging data. The results were compared with conventionally acquired T1-weighted/T2-weighted contrasts as a standard of reference. Myelin-related changes in T1-/T2-relaxation time/relaxation rate, proton density, and MR imaging signal intensity of the developing fetal brain stem were measured. A Pearson correlation analysis was used to detect correlations between the following: 1) the gestational age at MR imaging and the fetal brain maturity score, and 2) the gestational age at MR imaging and the quantitative measurements.

RESULTS

SyMRI provided images of sufficient quality in 12/52 (23.08%) (range, 23 + 6-34 + 0) fetal multidynamic multiecho sequence acquisitions. The fetal brain maturity score positively correlated with gestational age at MR imaging (SyMRI: r = 0.915, P < .001/standard of reference: r = 0.966, P < .001). Myelination-related changes in the T2 relaxation time/T2 relaxation rate of the medulla oblongata significantly correlated with gestational age at MR imaging (T2-relaxation time: r = -0.739, P = .006/T2-relaxation rate: r = 0.790, P = .002).

CONCLUSIONS

Fetal motion limits the applicability of multidynamic multiecho-based postprocessing. However, SyMRI-generated image data of sufficient quality enable the qualitative assessment of maturity-related changes of the fetal brain. In addition, quantitative T2 relaxation time/T2 relaxation rate mapping characterizes myelin-related changes of the brain stem prenatally. This approach, if successful, opens novel possibilities for the evaluation of structural and biochemical aspects of fetal brain maturation.

J-MoDL: Joint Model-Based Deep Learning for Optimized Sampling and Reconstruction

Modern MRI schemes, which rely on compressed sensing or deep learning algorithms to recover MRI data from undersampled multichannel Fourier measurements, are widely used to reduce the scan time. The image quality of these approaches is heavily dependent on the sampling pattern. We introduce a continuous strategy to optimize the sampling pattern and the network parameters jointly. We use a multichannel forward model, consisting of a non-uniform Fourier transform with continuously defined sampling locations, to realize the data consistency block within a model-based deep learning image reconstruction scheme. This approach facilitates the joint and continuous optimization of the sampling pattern and the CNN parameters to improve image quality. We observe that the joint optimization of the sampling patterns and the reconstruction module significantly improves the performance of most deep learning reconstruction algorithms. The source code is available at https://github.com/hkaggarwal/J-MoDL.

Factorized sensitivity estimation for artifact suppression in phase-cycled bSSFP MRI

OBJECTIVE

Balanced steady-state free precession (bSSFP) imaging suffers from banding artifacts in the presence of magnetic field inhomogeneity. The purpose of this study is to identify an efficient strategy to reconstruct banding-free bSSFP images from multi-coil multi-acquisition datasets.

METHOD

Previous techniques either assume that a naïve coil-combination is performed a priori resulting in suboptimal artifact suppression, or that artifact suppression is performed for each coil separately at the expense of significant computational burden. Here we propose a tailored method that factorizes the estimation of coil and bSSFP sensitivity profiles for improved accuracy and/or speed.

RESULTS

In vivo experiments show that the proposed method outperforms naïve coil-combination and coil-by-coil processing in terms of both reconstruction quality and time.

CONCLUSION

The proposed method enables computationally efficient artifact suppression for phase-cycled bSSFP imaging with modern coil arrays. Rapid imaging applications can efficiently benefit from the improved robustness of bSSFP imaging against field inhomogeneity.

Simultaneous use of individual and joint regularization terms in compressive sensing: Joint reconstruction of multi-channel multi-contrast MRI acquisitions

Multi-contrast images are commonly acquired together to maximize complementary diagnostic information, albeit at the expense of longer scan times. A time-efficient strategy to acquire high-quality multi-contrast images is to accelerate individual sequences and then reconstruct undersampled data with joint regularization terms that leverage common information across contrasts. However, these terms can cause features that are unique to a subset of contrasts to leak into the other contrasts. Such leakage-of-features may appear as artificial tissues, thereby misleading diagnosis. The goal of this study is to develop a compressive sensing method for multi-channel multi-contrast magnetic resonance imaging (MRI) that optimally utilizes shared information while preventing feature leakage. Joint regularization terms group sparsity and colour total variation are used to exploit common features across images while individual sparsity and total variation are also used to prevent leakage of distinct features across contrasts. The multi-channel multi-contrast reconstruction problem is solved via a fast algorithm based on Alternating Direction Method of Multipliers. The proposed method is compared against using only individual and only joint regularization terms in reconstruction. Comparisons were performed on single-channel simulated and multi-channel in-vivo datasets in terms of reconstruction quality and neuroradiologist reader scores. The proposed method demonstrates rapid convergence and improved image quality for both simulated and in-vivo datasets. Furthermore, while reconstructions that solely use joint regularization terms are prone to leakage-of-features, the proposed method reliably avoids leakage via simultaneous use of joint and individual terms, thereby holding great promise for clinical use.

Magnetic Resonance Image Quality Assessment by Using Non-Maximum Suppression and Entropy Analysis

An investigation of diseases using magnetic resonance (MR) imaging requires automatic image quality assessment methods able to exclude low-quality scans. Such methods can be also employed for an optimization of parameters of imaging systems or evaluation of image processing algorithms. Therefore, in this paper, a novel blind image quality assessment (BIQA) method for the evaluation of MR images is introduced. It is observed that the result of filtering using non-maximum suppression (NMS) strongly depends on the perceptual quality of an input image. Hence, in the method, the image is first processed by the NMS with various levels of acceptable local intensity difference. Then, the quality is efficiently expressed by the entropy of a sequence of extrema numbers obtained with the thresholded NMS. The proposed BIQA approach is compared with ten state-of-the-art techniques on a dataset containing MR images and subjective scores provided by 31 experienced radiologists. The Pearson, Spearman, Kendall correlation coefficients and root mean square error for the method assessing images in the dataset were 0.6741, 0.3540, 0.2428, and 0.5375, respectively. The extensive experimental evaluation of the BIQA methods reveals that the introduced measure outperforms related techniques by a large margin as it correlates better with human scores.