1
|
Wang S, Wu R, Jia S, Diakite A, Li C, Liu Q, Zheng H, Ying L. Knowledge-driven deep learning for fast MR imaging: Undersampled MR image reconstruction from supervised to un-supervised learning. Magn Reson Med 2024; 92:496-518. [PMID: 38624162 DOI: 10.1002/mrm.30105] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Revised: 03/19/2024] [Accepted: 03/20/2024] [Indexed: 04/17/2024]
Abstract
Deep learning (DL) has emerged as a leading approach in accelerating MRI. It employs deep neural networks to extract knowledge from available datasets and then applies the trained networks to reconstruct accurate images from limited measurements. Unlike natural image restoration problems, MRI involves physics-based imaging processes, unique data properties, and diverse imaging tasks. This domain knowledge needs to be integrated with data-driven approaches. Our review will introduce the significant challenges faced by such knowledge-driven DL approaches in the context of fast MRI along with several notable solutions, which include learning neural networks and addressing different imaging application scenarios. The traits and trends of these techniques have also been given which have shifted from supervised learning to semi-supervised learning, and finally, to unsupervised learning methods. In addition, MR vendors' choices of DL reconstruction have been provided along with some discussions on open questions and future directions, which are critical for the reliable imaging systems.
Collapse
Affiliation(s)
- Shanshan Wang
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Ruoyou Wu
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Sen Jia
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Alou Diakite
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Cheng Li
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Qiegen Liu
- Department of Electronic Information Engineering, Nanchang University, Nanchang, China
| | - Hairong Zheng
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Leslie Ying
- Department of Biomedical Engineering and Department of Electrical Engineering, The State University of New York, Buffalo, New York, USA
| |
Collapse
|
2
|
Davies-Jenkins CW, Döring A, Fasano F, Kleban E, Mueller L, Evans CJ, Afzali M, Jones DK, Ronen I, Branzoli F, Tax CMW. Practical considerations of diffusion-weighted MRS with ultra-strong diffusion gradients. Front Neurosci 2023; 17:1258408. [PMID: 38144210 PMCID: PMC10740196 DOI: 10.3389/fnins.2023.1258408] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2023] [Accepted: 11/03/2023] [Indexed: 12/26/2023] Open
Abstract
Introduction Diffusion-weighted magnetic resonance spectroscopy (DW-MRS) offers improved cellular specificity to microstructure-compared to water-based methods alone-but spatial resolution and SNR is severely reduced and slow-diffusing metabolites necessitate higher b-values to accurately characterize their diffusion properties. Ultra-strong gradients allow access to higher b-values per-unit time, higher SNR for a given b-value, and shorter diffusion times, but introduce additional challenges such as eddy-current artefacts, gradient non-uniformity, and mechanical vibrations. Methods In this work, we present initial DW-MRS data acquired on a 3T Siemens Connectom scanner equipped with ultra-strong (300 mT/m) gradients. We explore the practical issues associated with this manner of acquisition, the steps that may be taken to mitigate their impact on the data, and the potential benefits of ultra-strong gradients for DW-MRS. An in-house DW-PRESS sequence and data processing pipeline were developed to mitigate the impact of these confounds. The interaction of TE, b-value, and maximum gradient amplitude was investigated using simulations and pilot data, whereby maximum gradient amplitude was restricted. Furthermore, two DW-MRS voxels in grey and white matter were acquired using ultra-strong gradients and high b-values. Results Simulations suggest T2-based SNR gains that are experimentally confirmed. Ultra-strong gradient acquisitions exhibit similar artefact profiles to those of lower gradient amplitude, suggesting adequate performance of artefact mitigation strategies. Gradient field non-uniformity influenced ADC estimates by up to 4% when left uncorrected. ADC and Kurtosis estimates for tNAA, tCho, and tCr align with previously published literature. Discussion In conclusion, we successfully implemented acquisition and data processing strategies for ultra-strong gradient DW-MRS and results indicate that confounding effects of the strong gradient system can be ameliorated, while achieving shorter diffusion times and improved metabolite SNR.
Collapse
Affiliation(s)
- Christopher W. Davies-Jenkins
- The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States
- Cardiff University Brain Research Imaging Centre, Cardiff University, Cardiff, United Kingdom
| | - André Döring
- Cardiff University Brain Research Imaging Centre, Cardiff University, Cardiff, United Kingdom
- CIBM Center for Biomedical Imaging, EPFL CIBM-AIT, EPFL Lausanne, Lausanne, Switzerland
| | - Fabrizio Fasano
- Cardiff University Brain Research Imaging Centre, Cardiff University, Cardiff, United Kingdom
- Siemens Healthcare Ltd., Camberly, United Kingdom
| | - Elena Kleban
- Cardiff University Brain Research Imaging Centre, Cardiff University, Cardiff, United Kingdom
- Department of Radiology, Universität Bern, Bern, Switzerland
| | - Lars Mueller
- Cardiff University Brain Research Imaging Centre, Cardiff University, Cardiff, United Kingdom
- Leeds Institute of Cardiovascular & Metabolic Medicine, University of Leeds, Leeds, United Kingdom
| | - C. John Evans
- Cardiff University Brain Research Imaging Centre, Cardiff University, Cardiff, United Kingdom
| | - Maryam Afzali
- Cardiff University Brain Research Imaging Centre, Cardiff University, Cardiff, United Kingdom
- Leeds Institute of Cardiovascular & Metabolic Medicine, University of Leeds, Leeds, United Kingdom
| | - Derek K. Jones
- Cardiff University Brain Research Imaging Centre, Cardiff University, Cardiff, United Kingdom
| | - Itamar Ronen
- Clinical Sciences Institue, Brighton and Sussex Medical School, Brighton, United Kingdom
| | - Francesca Branzoli
- Center for NeuroImaging Research (CENIR), Paris Brain Institute (ICM), Pitié-Salpêtrière Hospital, Paris, France
- Inserm U1127, CNRS U7225, Sorbonne Universités, Paris, France
| | - Chantal M. W. Tax
- Brain Research Imaging Centre, School Physics and Astronomy, Cardiff University, Cardiff, United Kingdom
- Image Sciences Institute, University Medical Center Utrecht, Utrecht, Netherlands
| |
Collapse
|
3
|
Huang YL, Lin YR, Tsai SY. Comparison of convolutional-neural-networks-based method and LCModel on the quantification of in vivo magnetic resonance spectroscopy. MAGMA (NEW YORK, N.Y.) 2023:10.1007/s10334-023-01120-z. [PMID: 37713007 DOI: 10.1007/s10334-023-01120-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Revised: 08/09/2023] [Accepted: 08/30/2023] [Indexed: 09/16/2023]
Abstract
BACKGROUND Quantification of metabolites concentrations in institutional unit (IU) is important for inter-subject and long-term comparisons in the applications of magnetic resonance spectroscopy (MRS). Recently, deep learning (DL) algorithms have found a variety of applications on the process of MRS data. A quantification strategy compatible to DL base MRS spectral processing method is, therefore, useful. MATERIALS AND METHODS This study aims to investigate whether metabolite concentrations quantified using a convolutional neural network (CNN) based method, coupled with a scaling procedure that normalizes spectral signals for CNN input and linear regression, can effectively reflect variations in metabolite concentrations in IU across different brain regions with varying signal-to-noise ratios (SNR) and linewidths (LW). An error index based on standard error (SE) is proposed to indicate the confidence levels associated with metabolite predictions. In vivo MRS spectra were acquired from three brain regions of 43 subjects using a 3T system. RESULTS The metabolite concentrations in IU of five major metabolites, quantified using CNN and LCModel, exhibit similar ranges with Pearson's correlation coefficients ranging from 0.24 to 0.78. The SE of the metabolites shows a positive correlation with Cramer-Rao lower bound (CRLB) (r=0.46) and absolute CRLB (r=0.81), calculated by multiplying CRLBs with the quantified metabolite content. CONCLUSION In conclusion, the CNN based method with the proposed scaling procedures can be employed to quantify in vivo MRS spectra and derive metabolites concentrations in IU. The SE can be used as error index, indicating predicted uncertainties for metabolites and sharing information similar to the absolute CRLB.
Collapse
Affiliation(s)
- Yu-Long Huang
- Department of Electronic and Computer Engineering, National Taiwan University of Science and Technology, Taipei, Taiwan
| | - Yi-Ru Lin
- Department of Electronic and Computer Engineering, National Taiwan University of Science and Technology, Taipei, Taiwan
| | - Shang-Yueh Tsai
- Graduate Institute of Applied Physics, National Chengchi University, No.64, Sec.2, ZhiNan Rd., Wenshan District, Taipei, 11605, Taiwan.
- Research Center for Mind, Brain and Learning, National Chengchi University, Taipei, Taiwan.
| |
Collapse
|