Dual-domain self-supervised learning for accelerated non-Cartesian MRI reconstruction

MRI at low field: A review of software solutions for improving SNR

Low magnetic field magnetic resonance imaging (MRI) (B 0 $$ {B}_0 $$  < 1 T) is regaining interest in the magnetic resonance (MR) community as a complementary, more flexible, and cost-effective approach to MRI diagnosis. Yet, the impaired signal-to-noise ratio (SNR) per square root of time, or SNR efficiency, leading in turn to prolonged acquisition times, still challenges its relevance at the clinical level. To address this, researchers investigate various hardware and software solutions to improve SNR efficiency at low field, including the leveraging of latest advances in computing hardware. However, there may not be a single recipe for improving SNR at low field, and it is key to embrace the challenges and limitations of each proposed solution. In other words, suitable solutions depend on the final objective or application envisioned for a low-field scanner and, more importantly, on the characteristics of a specific lowB 0 $$ {B}_0 $$ field. In this review, we aim to provide an overview on software solutions to improve SNR efficiency at low field. First, we cover techniques for efficient k-space sampling and reconstruction. Then, we present post-acquisition techniques that enhance MR images such as denoising and super-resolution. In addition, we summarize recently introduced electromagnetic interference cancellation approaches showing great promises when operating in shielding-free environments. Finally, we discuss the advantages and limitations of these approaches that could provide directions for future applications.

A Flow-based Truncated Denoising Diffusion Model for super-resolution Magnetic Resonance Spectroscopic Imaging

Magnetic Resonance Spectroscopic Imaging (MRSI) is a non-invasive imaging technique for studying metabolism and has become a crucial tool for understanding neurological diseases, cancers and diabetes. High spatial resolution MRSI is needed to characterize lesions, but in practice MRSI is acquired at low resolution due to time and sensitivity restrictions caused by the low metabolite concentrations. Therefore, there is an imperative need for a post-processing approach to generate high-resolution MRSI from low-resolution data that can be acquired fast and with high sensitivity. Deep learning-based super-resolution methods provided promising results for improving the spatial resolution of MRSI, but they still have limited capability to generate accurate and high-quality images. Recently, diffusion models have demonstrated superior learning capability than other generative models in various tasks, but sampling from diffusion models requires iterating through a large number of diffusion steps, which is time-consuming. This work introduces a Flow-based Truncated Denoising Diffusion Model (FTDDM) for super-resolution MRSI, which shortens the diffusion process by truncating the diffusion chain, and the truncated steps are estimated using a normalizing flow-based network. The network is conditioned on upscaling factors to enable multi-scale super-resolution. To train and evaluate the deep learning models, we developed a 1H-MRSI dataset acquired from 25 high-grade glioma patients. We demonstrate that FTDDM outperforms existing generative models while speeding up the sampling process by over 9-fold compared to the baseline diffusion model. Neuroradiologists' evaluations confirmed the clinical advantages of our method, which also supports uncertainty estimation and sharpness adjustment, extending its potential clinical applications.

Enhancing quality and speed in database-free neural network reconstructions of undersampled MRI with SCAMPI

PURPOSE

We present SCAMPI (Sparsity Constrained Application of deep Magnetic resonance Priors for Image reconstruction), an untrained deep Neural Network for MRI reconstruction without previous training on datasets. It expands the Deep Image Prior approach with a multidomain, sparsity-enforcing loss function to achieve higher image quality at a faster convergence speed than previously reported methods.

METHODS

Two-dimensional MRI data from the FastMRI dataset with Cartesian undersampling in phase-encoding direction were reconstructed for different acceleration rates for single coil and multicoil data.

RESULTS

The performance of our architecture was compared to state-of-the-art Compressed Sensing methods and ConvDecoder, another untrained Neural Network for two-dimensional MRI reconstruction. SCAMPI outperforms these by better reducing undersampling artifacts and yielding lower error metrics in multicoil imaging. In comparison to ConvDecoder, the U-Net architecture combined with an elaborated loss-function allows for much faster convergence at higher image quality. SCAMPI can reconstruct multicoil data without explicit knowledge of coil sensitivity profiles. Moreover, it is a novel tool for reconstructing undersampled single coil k-space data.

CONCLUSION

Our approach avoids overfitting to dataset features, that can occur in Neural Networks trained on databases, because the network parameters are tuned only on the reconstruction data. It allows better results and faster reconstruction than the baseline untrained Neural Network approach.

Knowledge-driven deep learning for fast MR imaging: Undersampled MR image reconstruction from supervised to un-supervised learning

Deep learning (DL) has emerged as a leading approach in accelerating MRI. It employs deep neural networks to extract knowledge from available datasets and then applies the trained networks to reconstruct accurate images from limited measurements. Unlike natural image restoration problems, MRI involves physics-based imaging processes, unique data properties, and diverse imaging tasks. This domain knowledge needs to be integrated with data-driven approaches. Our review will introduce the significant challenges faced by such knowledge-driven DL approaches in the context of fast MRI along with several notable solutions, which include learning neural networks and addressing different imaging application scenarios. The traits and trends of these techniques have also been given which have shifted from supervised learning to semi-supervised learning, and finally, to unsupervised learning methods. In addition, MR vendors' choices of DL reconstruction have been provided along with some discussions on open questions and future directions, which are critical for the reliable imaging systems.

Applications, limitations and advancements of ultra-low-field magnetic resonance imaging: A scoping review

Background

Ultra-low-field magnetic resonance imaging (ULF-MRI) has emerged as an alternative with several portable clinical applications. This review aims to comprehensively explore its applications, potential limitations, technological advancements, and expert recommendations.

Methods

A review of the literature was conducted across medical databases to identify relevant studies. Articles on clinical usage of ULF-MRI were included, and data regarding applications, limitations, and advancements were extracted. A total of 25 articles were included for qualitative analysis.

Results

The review reveals ULF-MRI efficacy in intensive care settings and intraoperatively. Technological strides are evident through innovative reconstruction techniques and integration with machine learning approaches. Additional advantages include features such as portability, cost-effectiveness, reduced power requirements, and improved patient comfort. However, alongside these strengths, certain limitations of ULF-MRI were identified, including low signal-to-noise ratio, limited resolution and length of scanning sequences, as well as variety and absence of regulatory-approved contrast-enhanced imaging. Recommendations from experts emphasize optimizing imaging quality, including addressing signal-to-noise ratio (SNR) and resolution, decreasing the length of scan time, and expanding point-of-care magnetic resonance imaging availability.

Conclusion

This review summarizes the potential of ULF-MRI. The technology's adaptability in intensive care unit settings and its diverse clinical and surgical applications, while accounting for SNR and resolution limitations, highlight its significance, especially in resource-limited settings. Technological advancements, alongside expert recommendations, pave the way for refining and expanding ULF-MRI's utility. However, adequate training is crucial for widespread utilization.

IWNeXt: an image-wavelet domain ConvNeXt-based network for self-supervised multi-contrast MRI reconstruction

Objective.Multi-contrast magnetic resonance imaging (MC MRI) can obtain more comprehensive anatomical information of the same scanning object but requires a longer acquisition time than single-contrast MRI. To accelerate MC MRI speed, recent studies only collect partial k-space data of one modality (target contrast) to reconstruct the remaining non-sampled measurements using a deep learning-based model with the assistance of another fully sampled modality (reference contrast). However, MC MRI reconstruction mainly performs the image domain reconstruction with conventional CNN-based structures by full supervision. It ignores the prior information from reference contrast images in other sparse domains and requires fully sampled target contrast data. In addition, because of the limited receptive field, conventional CNN-based networks are difficult to build a high-quality non-local dependency.Approach.In the paper, we propose an Image-Wavelet domain ConvNeXt-based network (IWNeXt) for self-supervised MC MRI reconstruction. Firstly, INeXt and WNeXt based on ConvNeXt reconstruct undersampled target contrast data in the image domain and refine the initial reconstructed result in the wavelet domain respectively. To generate more tissue details in the refinement stage, reference contrast wavelet sub-bands are used as additional supplementary information for wavelet domain reconstruction. Then we design a novel attention ConvNeXt block for feature extraction, which can capture the non-local information of the MC image. Finally, the cross-domain consistency loss is designed for self-supervised learning. Especially, the frequency domain consistency loss deduces the non-sampled data, while the image and wavelet domain consistency loss retain more high-frequency information in the final reconstruction.Main results.Numerous experiments are conducted on the HCP dataset and the M4Raw dataset with different sampling trajectories. Compared with DuDoRNet, our model improves by 1.651 dB in the peak signal-to-noise ratio.Significance.IWNeXt is a potential cross-domain method that can enhance the accuracy of MC MRI reconstruction and reduce reliance on fully sampled target contrast images.

AliasNet: Alias artefact suppression network for accelerated phase-encode MRI

Sparse reconstruction is an important aspect of MRI, helping to reduce acquisition time and improve spatial-temporal resolution. Popular methods are based mostly on compressed sensing (CS), which relies on the random sampling of k-space to produce incoherent (noise-like) artefacts. Due to hardware constraints, 1D Cartesian phase-encode under-sampling schemes are popular for 2D CS-MRI. However, 1D under-sampling limits 2D incoherence between measurements, yielding structured aliasing artefacts (ghosts) that may be difficult to remove assuming a 2D sparsity model. Reconstruction algorithms typically deploy direction-insensitive 2D regularisation for these direction-associated artefacts. Recognising that phase-encode artefacts can be separated into contiguous 1D signals, we develop two decoupling techniques that enable explicit 1D regularisation and leverage the excellent 1D incoherence characteristics. We also derive a combined 1D + 2D reconstruction technique that takes advantage of spatial relationships within the image. Experiments conducted on retrospectively under-sampled brain and knee data demonstrate that combination of the proposed 1D AliasNet modules with existing 2D deep learned (DL) recovery techniques leads to an improvement in image quality. We also find AliasNet enables a superior scaling of performance compared to increasing the size of the original 2D network layers. AliasNet therefore improves the regularisation of aliasing artefacts arising from phase-encode under-sampling, by tailoring the network architecture to account for their expected appearance. The proposed 1D + 2D approach is compatible with any existing 2D DL recovery technique deployed for this application.

DC-SiamNet: Deep contrastive Siamese network for self-supervised MRI reconstruction

Reconstruction methods based on deep learning have greatly shortened the data acquisition time of magnetic resonance imaging (MRI). However, these methods typically utilize massive fully sampled data for supervised training, restricting their application in certain clinical scenarios and posing challenges to the reconstruction effect when high-quality MR images are unavailable. Recently, self-supervised methods have been developed that only undersampled MRI images participate in the network training. Nevertheless, due to the lack of complete referable MR image data, self-supervised reconstruction is prone to produce incorrect structure contents, such as unnatural texture details and over-smoothed tissue sites. To solve this problem, we propose a self-supervised Deep Contrastive Siamese Network (DC-SiamNet) for fast MR imaging. First, DC-SiamNet performs the reconstruction with a Siamese unrolled structure and obtains visual representations in different iterative phases. Particularly, an attention-weighted average pooling module is employed at the bottleneck layer of the U-shape regularization unit, which can effectively aggregate valuable local information of the underlying feature map in the generated representation vector. Then, a novel hybrid loss function is designed to drive the self-supervised reconstruction and contrastive learning simultaneously by forcing the output consistency across different branches in the frequency domain, the image domain, and the latent space. The proposed method is extensively evaluated with different sampling patterns on the IXI brain dataset and the MRINet knee dataset. Experimental results show that DC-SiamNet can achieve 0.93 in structural similarity and 33.984 dB in peak signal-to-noise ratio on the IXI brain dataset under 8x acceleration. It has better reconstruction accuracy than other methods, and the performance is close to the corresponding model trained with full supervision, especially when the sampling rate is low. In addition, generalization experiments verify that our method has a strong cross-domain reconstruction ability for different contrast brain images.

Adaptive channel-modulated personalized federated learning for magnetic resonance image reconstruction

Magnetic resonance imaging (MRI) is extensively utilized in clinical practice for diagnostic purposes, owing to its non-invasive nature and remarkable ability to provide detailed characterization of soft tissues. However, its drawback lies in the prolonged scanning time. To accelerate MR imaging, how to reconstruct MR images from under-sampled data quickly and accurately has drawn intensive research interest; it, however, remains a challenging task. While some deep learning models have achieved promising performance in MRI reconstruction, these models usually require a substantial quantity of paired data for training, which proves challenging to gather and share owing to high scanning costs and data privacy concerns. Federated learning (FL) is a potential tool to alleviate these difficulties. It enables multiple clinical clients to collaboratively train a global model without compromising privacy. However, it is extremely challenging to fit a single model to diverse data distributions of different clients. Moreover, existing FL algorithms treat the features of each channel equally, lacking discriminative learning ability across feature channels, and hence hindering their representational capability. In this study, we propose a novel Adaptive Channel-Modulated Federal learning framework for personalized MRI reconstruction, dubbed as ACM-FedMRI. Specifically, considering each local client may focus on features in different channels, we first design a client-specific hypernetwork to guide the channel selection operation in order to optimize the extracted features. Additionally, we introduce a performance-based channel decoupling scheme, which dynamically separates the global model at the channel level to facilitate personalized adjustments based on the performance of individual clients. This approach eliminates the need for heuristic design of specific personalization layers. Extensive experiments on four datasets under two different settings show that our ACM-FedMRI achieves outstanding results compared to other cutting-edge federated learning techniques in the field of MRI reconstruction.

Motion compensated self supervised deep learning for highly accelerated 3D ultrashort Echo time pulmonary MRI

PURPOSE

To investigate motion compensated, self-supervised, model based deep learning (MBDL) as a method to reconstruct free breathing, 3D pulmonary UTE acquisitions.

THEORY AND METHODS

A self-supervised eXtra dimension MBDL architecture (XD-MBDL) was developed that combined respiratory states to reconstruct a single high-quality 3D image. Non-rigid motion fields were incorporated into this architecture by estimating motion fields from a lower resolution motion resolved (XD-GRASP) reconstruction. Motion compensated XD-MBDL was evaluated on lung UTE datasets with and without contrast and compared to constrained reconstructions and variants of self-supervised MBDL that do not account for dynamic respiratory states or leverage motion correction.

RESULTS

Images reconstructed using XD-MBDL demonstrate improved image quality as measured by apparent SNR (aSNR), contrast to noise ratio (CNR), and visual assessment relative to self-supervised MBDL approaches that do not account for dynamic respiratory states, XD-GRASP and a recently proposed motion compensated iterative reconstruction strategy (iMoCo). Additionally, XD-MBDL reduced reconstruction time relative to both XD-GRASP and iMoCo.

CONCLUSION

A method was developed to allow self-supervised MBDL to combine multiple respiratory states to reconstruct a single image. This method was combined with graphics processing unit (GPU)-based image registration to further improve reconstruction quality. This approach showed promising results reconstructing a user-selected respiratory phase from free breathing 3D pulmonary UTE acquisitions.