Development of fast deep learning quantification for magnetic resonance fingerprinting in vivo

Deep learning-assisted preclinical MR fingerprinting for sub-millimeter T1 and T2 mapping of entire macaque brain

PURPOSE

Preclinical MR fingerprinting (MRF) suffers from long acquisition time for organ-level coverage due to demanding image resolution and limited undersampling capacity. This study aims to develop a deep learning-assisted fast MRF framework for sub-millimeter T1 and T2 mapping of entire macaque brain on a preclinical 9.4 T MR system.

METHODS

Three dimensional MRF images were reconstructed by singular value decomposition (SVD) compressed reconstruction. T1 and T2 mapping for each axial slice exploited a self-attention assisted residual U-Net to suppress aliasing-induced quantification errors, and the transmit-field (B1 + ) measurements for robustness against B1 + inhomogeneity. Supervised network training used MRF images simulated via virtual parametric maps and a desired undersampling scheme. This strategy bypassed the difficulties of acquiring fully sampled preclinical MRF data to guide network training. The proposed fast MRF framework was tested on experimental data acquired from ex vivo and in vivo macaque brains.

RESULTS

The trained network showed reasonable adaptability to experimental MRF images, enabling robust delineation of various T1 and T2 distributions in the brain tissues. Further, the proposed MRF framework outperformed several existing fast MRF methods in handling the aliasing artifacts and capturing detailed cerebral structures in the mapping results. Parametric mapping of entire macaque brain at nominal resolution of 0.35× $$ \times $$ 0.35× $$ \times $$ 1 mm3 can be realized via a 20-min 3D MRF scan, which was sixfold faster than the baseline protocol.

CONCLUSION

Introducing deep learning to MRF framework paves the way for efficient organ-level high-resolution quantitative MRI in preclinical applications.

Three-dimensional multi-parameter brain mapping using MR fingerprinting

The purpose of this study was to develop and test a 3D multi-parameter MR fingerprinting (MRF) method for brain imaging applications. The subject cohort included 5 healthy volunteers, repeatability tests done on 2 healthy volunteers and tested on two multiple sclerosis (MS) patients. A 3D-MRF imaging technique capable of quantifying T1, T2 and T1ρ was used. The imaging sequence was tested in standardized phantoms and 3D-MRF brain imaging with multiple shots (1, 2 and 4) in healthy human volunteers and MS patients. Quantitative parametric maps for T1, T2, T1ρ, were generated. Mean gray matter (GM) and white matter (WM) ROIs were compared for each mapping technique, Bland-Altman plots and intra-class correlation coefficient (ICC) were used to assess repeatability and Student T-tests were used to compare results in MS patients. Standardized phantom studies demonstrated excellent agreement with reference T1/T2/T1ρ mapping techniques. This study demonstrates that the 3D-MRF technique is able to simultaneously quantify T1, T2 and T1ρ for tissue property characterization in a clinically feasible scan time. This multi-parametric approach offers increased potential to detect and differentiate brain lesions and to better test imaging biomarker hypotheses for several neurological diseases, including MS.

3D magnetic resonance fingerprinting for rapid simultaneous T1, T2, and T1ρ volumetric mapping of human articular cartilage at 3 T

Quantitative MRI can detect early biochemical changes in cartilage; however, the conventional techniques only measure one parameter (e.g., T1 , T2 , and T1ρ ) at a time while also being comparatively slow. We implemented a 3D magnetic resonance fingerprinting (3D-MRF) technique for simultaneous, volumetric mapping of T1 , T2 , and T1ρ in knee articular cartilage in under 9 min. It is evaluated on 11 healthy volunteers (mean age: 53 ± 9 years), five mild knee osteoarthritis (OA) patients (Kellgren-Lawrence (KL) score: 2, mean age: 60 ± 4 years), and the National Institute of Standards and Technology (NIST)/International Society for Magnetic Resonance in Medicine (ISMRM) system phantom. Proton density image, and T1 , T2, T1ρ relaxation times, and B1 + were estimated in the NIST/ISMRM system phantom as well as in the human knee medial and lateral femur, medial and lateral tibia, and patellar cartilage. The repeatability and reproducibility of the proposed technique were assessed in the phantom using analysis of the Bland-Altman plots. The intrasubject repeatability was assessed with the coefficient of variation (CV) and root mean square CV (rmsCV). The Mann-Whitney U test was used to assess the difference between healthy subjects and mild knee OA patients. The Bland-Altman plots in the NIST/ISMRM phantom demonstrated an average difference of 0.001% ± 015%, 1.2% ± 7.1%, and 0.47% ± 3% between two scans from the same 3-T scanner (repeatability), and 0.002% ± 015%, 0.62% ± 10.5%, and 0.97% ± 14% between the scans acquired on two different 3-T scanners (reproducibility) for T1 , T2 , and T1ρ , respectively. The in vivo knee study showed excellent repeatability with rmsCV less than 1%, 2%, and 1% for T1 , T2 , and T1ρ , respectively. T1ρ relaxation time in the mild knee OA patients was significantly higher (p < 0.05) than in healthy subjects. The proposed 3D-MRF sequence is fast, reproducible, robust to B1 + inhomogeneity, and can simultaneously measure the T1 , T2 , T1ρ , and B1 + volumetric maps of the knee joint in a single scan within a clinically feasible scan time.

Artificial intelligence in cardiac magnetic resonance fingerprinting

Magnetic resonance fingerprinting (MRF) is a fast MRI-based technique that allows for multiparametric quantitative characterization of the tissues of interest in a single acquisition. In particular, it has gained attention in the field of cardiac imaging due to its ability to provide simultaneous and co-registered myocardial T₁ and T₂ mapping in a single breath-held cardiac MRF scan, in addition to other parameters. Initial results in small healthy subject groups and clinical studies have demonstrated the feasibility and potential of MRF imaging. Ongoing research is being conducted to improve the accuracy, efficiency, and robustness of cardiac MRF. However, these improvements usually increase the complexity of image reconstruction and dictionary generation and introduce the need for sequence optimization. Each of these steps increase the computational demand and processing time of MRF. The latest advances in artificial intelligence (AI), including progress in deep learning and the development of neural networks for MRI, now present an opportunity to efficiently address these issues. Artificial intelligence can be used to optimize candidate sequences and reduce the memory demand and computational time required for reconstruction and post-processing. Recently, proposed machine learning-based approaches have been shown to reduce dictionary generation and reconstruction times by several orders of magnitude. Such applications of AI should help to remove these bottlenecks and speed up cardiac MRF, improving its practical utility and allowing for its potential inclusion in clinical routine. This review aims to summarize the latest developments in artificial intelligence applied to cardiac MRF. Particularly, we focus on the application of machine learning at different steps of the MRF process, such as sequence optimization, dictionary generation and image reconstruction.

Artificial intelligence in multi-parametric magnetic resonance imaging: A review

Multi-parametric magnetic resonance imaging (mpMRI) is an indispensable tool in the clinical workflow for the diagnosis and treatment planning of various diseases. Machine learning-based artificial intelligence (AI) methods, especially those adopting the deep learning technique, have been extensively employed to perform mpMRI image classification, segmentation, registration, detection, reconstruction, and super-resolution. The current availability of increasing computational power and fast-improving AI algorithms have empowered numerous computer-based systems for applying mpMRI to disease diagnosis, imaging-guided radiotherapy, patient risk and overall survival time prediction, and the development of advanced quantitative imaging technology for magnetic resonance fingerprinting. However, the wide application of these developed systems in the clinic is still limited by a number of factors, including robustness, reliability, and interpretability. This survey aims to provide an overview for new researchers in the field as well as radiologists with the hope that they can understand the general concepts, main application scenarios, and remaining challenges of AI in mpMRI. This article is protected by copyright. All rights reserved.

MR fingerprinting of the prostate

Multiparametric magnetic resonance imaging (mpMRI) has been adopted as the key tool for detection, localization, characterization, and risk stratification of patients suspected to have prostate cancer. Despite advantages over systematic biopsy, the interpretation of prostate mpMRI has limitations including a steep learning curve, leading to considerable interobserver variation. There is growing interest in clinical translation of quantitative imaging techniques for more objective lesion assessment. However, traditional mapping techniques are slow, precluding their use in the clinic. Magnetic resonance fingerprinting (MRF) is an efficient approach for quantitative maps of multiple tissue properties simultaneously. The T₁ and T₂ values obtained with MRF have been validated with phantom studies as well as in normal volunteers and patients. Studies have shown that MRF-derived T₁ and T₂ along with ADC values are all significant independent predictors in the differentiation between normal prostate tissue and prostate cancer, and hold promise in differentiating low and intermediate/high-grade cancers. This review seeks to introduce the basics of the prostate MRF technique, discuss the potential applications of prostate MRF for the characterization of prostate cancer, and describes ongoing areas of research.

Channel Attention Networks for Robust MR Fingerprint Matching

Magnetic Resonance Fingerprinting (MRF) enables simultaneous mapping of multiple tissue parameters such as T1 and T2 relaxation times. The working principle of MRF relies on varying acquisition parameters pseudo-randomly, so that each tissue generates its unique signal evolution during scanning. Even though MRF provides faster scanning, it has disadvantages such as erroneous and slow generation of the corresponding parametric maps, which needs to be improved. Moreover, there is a need for explainable architectures for understanding the guiding signals to generate accurate parametric maps. In this paper, we addressed both of these shortcomings by proposing a novel neural network architecture (CONV-ICA) consisting of a channel-wise attention module and a fully convolutional network. The proposed approach, evaluated over 3 simulated MRF signals, reduces error in the reconstruction of tissue parameters by 8.88% for T1 and 75.44% for T2 with respect to state-of-the-art methods. Another contribution of this study is a new channel selection method: attention-based channel selection. Furthermore, the effect of patch size and temporal frames of MRF signal on channel reduction are analyzed by employing a channel-wise attention.

A deep learning approach for magnetic resonance fingerprinting: Scaling capabilities and good training practices investigated by simulations

MR fingerprinting (MRF) is an innovative approach to quantitative MRI. A typical disadvantage of dictionary-based MRF is the explosive growth of the dictionary as a function of the number of reconstructed parameters, an instance of the curse of dimensionality, which determines an explosion of resource requirements. In this work, we describe a deep learning approach for MRF parameter map reconstruction using a fully connected architecture. Employing simulations, we have investigated how the performance of the Neural Networks (NN) approach scales with the number of parameters to be retrieved, compared to the standard dictionary approach. We have also studied optimal training procedures by comparing different strategies for noise addition and parameter space sampling, to achieve better accuracy and robustness to noise. Four MRF sequences were considered: IR-FISP, bSSFP, IR-FISP-B₁, and IR-bSSFP-B₁. A comparison between NN and the dictionary approaches in reconstructing parameter maps as a function of the number of parameters to be retrieved was performed using a numerical brain phantom. Results demonstrated that training with random sampling and different levels of noise variance yielded the best performance. NN performance was at least as good as the dictionary-based approach in reconstructing parameter maps using Gaussian noise as a source of artifacts: the difference in performance increased with the number of estimated parameters because the dictionary method suffers from the coarse resolution of the parameter space sampling. The NN proved to be more efficient in memory usage and computational burden, and has great potential for solving large-scale MRF problems.

Deep learning reconstruction for cardiac magnetic resonance fingerprinting T1 and T2 mapping

PURPOSE

To develop a deep learning method for rapidly reconstructing T₁ and T₂ maps from undersampled electrocardiogram (ECG) triggered cardiac magnetic resonance fingerprinting (cMRF) images.

METHODS

A neural network was developed that outputs T₁ and T₂ values when given a measured cMRF signal time course and cardiac RR interval times recorded by an ECG. Over 8 million cMRF signals, corresponding to 4000 random cardiac rhythms, were simulated for training. The training signals were corrupted by simulated k-space undersampling artifacts and random phase shifts to promote robust learning. The deep learning reconstruction was evaluated in Monte Carlo simulations for a variety of cardiac rhythms and compared with dictionary-based pattern matching in 58 healthy subjects at 1.5T.

RESULTS

In simulations, the normalized root-mean-square error (nRMSE) for T₁ was below 1% in myocardium, blood, and liver for all tested heart rates. For T₂ , the nRMSE was below 4% for myocardium and liver and below 6% for blood for all heart rates. The difference in the mean myocardial T₁ or T₂ observed in vivo between dictionary matching and deep learning was 3.6 ms for T₁ and -0.2 ms for T₂ . Whereas dictionary generation and pattern matching required more than 4 min per slice, the deep learning reconstruction only required 336 ms.

CONCLUSION

A neural network is introduced for reconstructing cMRF T₁ and T₂ maps directly from undersampled spiral images in under 400 ms and is robust to arbitrary cardiac rhythms, which paves the way for rapid online display of cMRF maps.