1
|
Zhang H, Qiu B, Xu J, Chan KW, Huang J. CESTsimu: An open-source GUI for spectral and spatial CEST simulation. Magn Reson Med 2025. [PMID: 39834082 DOI: 10.1002/mrm.30430] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2024] [Revised: 12/27/2024] [Accepted: 12/28/2024] [Indexed: 01/22/2025]
Abstract
PURPOSE The aim of this study was to create a user-friendly CEST simulation tool with a GUI for both spectral (1D Z-spectra) and spatial (2D phantom) CEST experiments, making the CEST simulation easier to perform. METHODS CESTsimu was developed using MATLAB App Designer. It consists of three modules: Saturation Settings, Exchange Settings, and Phantom Settings. CESTsimu can not only import/export files in the defined format but can also import files generated by other existing simulation platforms (e.g. pulseq-CEST). RESULTS The 1D Z-spectrum simulation results demonstrated the effectiveness of CESTsimu in simulating Z-spectra under various saturation (B 0 $$ {\mathrm{B}}_0 $$ andB 1 $$ {\mathrm{B}}_1 $$ ) and exchange settings (concentration and exchange rate). The 2D simulation results showed that CESTsimu can generate an arbitrary number of phantoms with different shapes under different noise conditions. Notably, CESTsimu could also simulateB 0 $$ {\mathrm{B}}_0 $$ andB 1 $$ {\mathrm{B}}_1 $$ inhomogeneity in 2D patterns that mimicked practical conditions. Moreover, the accuracy of CESTsimu was validated by simulating 8 cases in the BMsim challenge. CONCLUSION We developed a user-friendly CESTsimu GUI for intuitively simulating CEST experiments under diverse saturation and exchange settings in 1D and 2D conditions. CESTsimu has the potential to facilitate the broad utilization of CEST MRI among a wide range of users.
Collapse
Affiliation(s)
- Huabin Zhang
- Department of Diagnostic Radiology, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong, China
- Department of Electronic Engineering and Information Science, University of Science and Technology of China, Hefei, China
| | - Bensheng Qiu
- Department of Electronic Engineering and Information Science, University of Science and Technology of China, Hefei, China
| | - Jiadi Xu
- Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA
- F. M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, Maryland, USA
| | - Kannie Wy Chan
- Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA
- Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China
| | - Jianpan Huang
- Department of Diagnostic Radiology, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong, China
| |
Collapse
|
2
|
Singh M, Mahmud SZ, Yedavalli V, Zhou J, Kamson DO, van Zijl P, Heo HY. Learning-based motion artifact correction in the Z-spectral domain for chemical exchange saturation transfer MRI. Magn Reson Med 2025. [PMID: 39834104 DOI: 10.1002/mrm.30440] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2024] [Revised: 12/23/2024] [Accepted: 01/05/2025] [Indexed: 01/22/2025]
Abstract
PURPOSE To develop and evaluate a physics-driven, saturation contrast-aware, deep-learning-based framework for motion artifact correction in CEST MRI. METHODS A neural network was designed to correct motion artifacts directly from a Z-spectrum frequency (Ω) domain rather than an image spatial domain. Motion artifacts were simulated by modeling 3D rigid-body motion and readout-related motion during k-space sampling. A saturation-contrast-specific loss function was added to preserve amide proton transfer (APT) contrast, as well as enforce image alignment between motion-corrected and ground-truth images. The proposed neural network was evaluated on simulation data and demonstrated in healthy volunteers and brain tumor patients. RESULTS The experimental results showed the effectiveness of motion artifact correction in the Z-spectrum frequency domain (MOCOΩ) compared to in the image spatial domain. In addition, a temporal convolution applied to a dynamic saturation image series was able to leverage motion artifacts to improve reconstruction results as a denoising process. The MOCOΩ outperformed existing techniques for motion correction in terms of image quality and computational efficiency. At 3 T, human experiments showed that the root mean squared error (RMSE) of APT images decreased from 4.7% to 2.1% at 1 μT and from 6.2% to 3.5% at 1.5 μT in case of "moderate" motion and from 8.7% to 2.8% at 1 μT and from 12.7% to 4.5% at 1.5 μT in case of "severe" motion, after motion artifact correction. CONCLUSION The MOCOΩ could effectively correct motion artifacts in CEST MRI without compromising saturation transfer contrast.
Collapse
Affiliation(s)
- Munendra Singh
- Department of Radiology, Johns Hopkins University, Baltimore, Maryland, USA
| | - Sultan Z Mahmud
- Department of Radiology, Johns Hopkins University, Baltimore, Maryland, USA
| | - Vivek Yedavalli
- Department of Radiology, Johns Hopkins University, Baltimore, Maryland, USA
| | - Jinyuan Zhou
- Department of Radiology, Johns Hopkins University, Baltimore, Maryland, USA
| | - David Olayinka Kamson
- Department of Oncology, Johns Hopkins University, Baltimore, Maryland, USA
- Department of Neurology, Johns Hopkins University, Baltimore, Maryland, USA
| | - Peter van Zijl
- Department of Radiology, Johns Hopkins University, Baltimore, Maryland, USA
- F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, Maryland, USA
| | - Hye-Young Heo
- Department of Radiology, Johns Hopkins University, Baltimore, Maryland, USA
- F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, Maryland, USA
| |
Collapse
|
3
|
Yin L, Viswanathan M, Kurmi Y, Zu Z. Improving quantification accuracy of a nuclear Overhauser enhancement signal at -1.6 ppm at 4.7 T using a machine learning approach. Phys Med Biol 2025; 70:025009. [PMID: 39774035 PMCID: PMC11740009 DOI: 10.1088/1361-6560/ada716] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2024] [Revised: 12/16/2024] [Accepted: 01/07/2025] [Indexed: 01/11/2025]
Abstract
Objective.A new nuclear Overhauser enhancement (NOE)-mediated saturation transfer MRI signal at -1.6 ppm, potentially from choline phospholipids and termed NOE(-1.6), has been reported in biological tissues at high magnetic fields. This signal shows promise for detecting brain tumors and strokes. However, its proximity to the water peak and low signal-to-noise ratio makes accurate quantification challenging, especially at low fields, due to the difficulty in separating it from direct water saturation and other confounding signals. This study proposes using a machine learning (ML) method to address this challenge.Approach.The ML model was trained on a partially synthetic chemical exchange saturation transfer dataset with a curriculum learning denoising approach. The accuracy of our method in quantifying NOE(-1.6) was validated using tissue-mimicking data from Bloch simulations providing ground truth, with subsequent application to an animal tumor model at 4.7 T. The predictions from the proposed ML method were compared with outcomes from traditional Lorentzian fit and ML models trained on other data types, including measured and fully simulated data.Main results.Our tissue-mimicking validation suggests that our method offers superior accuracy compared to all other methods. The results from animal experiments show that our method, despite variations in training data size or simulation models, produces predictions within a narrower range than the ML method trained on other data types.Significance.The ML method proposed in this work significantly enhances the accuracy and robustness of quantifying NOE(-1.6), thereby expanding the potential for applications of this novel molecular imaging mechanism in low-field environments.
Collapse
Affiliation(s)
- Leqi Yin
- Vanderbilt University Institute of Imaging Science, Vanderbilt University Medical Center, Nashville, TN, United States of America
- School of Engineering, Vanderbilt University, Nashville, TN, United States of America
| | - Malvika Viswanathan
- Vanderbilt University Institute of Imaging Science, Vanderbilt University Medical Center, Nashville, TN, United States of America
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, United States of America
| | - Yashwant Kurmi
- Vanderbilt University Institute of Imaging Science, Vanderbilt University Medical Center, Nashville, TN, United States of America
- Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Nashville, TN, United States of America
| | - Zhongliang Zu
- Vanderbilt University Institute of Imaging Science, Vanderbilt University Medical Center, Nashville, TN, United States of America
- Department of Biomedical Engineering, Vanderbilt University, Nashville, TN, United States of America
- Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Nashville, TN, United States of America
| |
Collapse
|
4
|
Lawrence LSP, Maralani PJ, Das S, Sahgal A, Stanisz GJ, Lau AZ. Magnetic resonance imaging techniques for monitoring glioma response to chemoradiotherapy. J Neurooncol 2025; 171:255-264. [PMID: 39527382 DOI: 10.1007/s11060-024-04856-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2024] [Accepted: 10/15/2024] [Indexed: 11/16/2024]
Abstract
PURPOSE Treatment response assessment for gliomas currently uses changes in tumour size as measured with T1- and T2-weighted MRI. However, changes in tumour size may occur many weeks after therapy completion and are confounded by radiation treatment effects. Advanced MRI techniques sensitive to tumour physiology may provide complementary information to evaluate tumour response at early timepoints during therapy. The objective of this review is to provide a summary of the history and current knowledge regarding advanced MRI techniques for early treatment response evaluation in glioma. METHODS The literature survey included perfusion MRI, diffusion-weighted imaging, quantitative magnetization transfer imaging, and chemical exchange transfer MRI. Select articles spanning the history of each technique as applied to treatment response evaluation in glioma were chosen. This report is a narrative review, not formally systematic. RESULTS Chemical exchange saturation transfer imaging potentially offers the earliest method to detect tumour response due to changes in metabolism. Diffusion-weighted imaging is sensitive to changes in tumour cellularity later during radiotherapy and is prognostic for progression-free and overall survival. Substantial evidence suggests that perfusion MRI can differentiate between tumour recurrence and treatment effect, but consensus regarding acquisition, processing, and interpretation is still lacking. Magnetization transfer imaging shows promise for detecting subtle white matter damage which could indicate tumour invasion, but more research in this area is needed. CONCLUSION Advanced MRI techniques show potential for early treatment response assessment, but each technique alone lacks specificity. Multiparametric imaging may be necessary to aid biological interpretation and enable treatment guidance.
Collapse
Affiliation(s)
- Liam S P Lawrence
- Department of Medical Biophysics, University of Toronto, Toronto, ON, Canada
| | - Pejman J Maralani
- Department of Medical Imaging, University of Toronto, Sunnybrook Health Sciences Centre, Toronto, ON, Canada
| | - Sunit Das
- Department of Surgery, St. Michael's Hospital, Toronto, ON, Canada
| | - Arjun Sahgal
- Department of Radiation Oncology, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, ON, Canada
| | - Greg J Stanisz
- Department of Medical Biophysics, University of Toronto, Toronto, ON, Canada
- Physical Sciences, Sunnybrook Research Institute, Toronto, ON, Canada
- Department of Neurosurgery and Paediatric Neurosurgery, Medical University, Lublin, Poland
| | - Angus Z Lau
- Department of Medical Biophysics, University of Toronto, Toronto, ON, Canada.
- Physical Sciences, Sunnybrook Research Institute, Toronto, ON, Canada.
| |
Collapse
|
5
|
Cohen O, Kargar S, Woo S, Vargas A, Otazo R. DCE-Qnet: deep network quantification of dynamic contrast enhanced (DCE) MRI. MAGMA (NEW YORK, N.Y.) 2024; 37:1077-1090. [PMID: 39112813 DOI: 10.1007/s10334-024-01189-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/16/2024] [Accepted: 06/20/2024] [Indexed: 11/22/2024]
Abstract
INTRODUCTION Quantification of dynamic contrast-enhanced (DCE)-MRI has the potential to provide valuable clinical information, but robust pharmacokinetic modeling remains a challenge for clinical adoption. METHODS A 7-layer neural network called DCE-Qnet was trained on simulated DCE-MRI signals derived from the Extended Tofts model with the Parker arterial input function. Network training incorporated B1 inhomogeneities to estimate perfusion (Ktrans, vp, ve), tissue T1 relaxation, proton density and bolus arrival time (BAT). The accuracy was tested in a digital phantom in comparison to a conventional nonlinear least-squares fitting (NLSQ). In vivo testing was conducted in ten healthy subjects. Regions of interest in the cervix and uterine myometrium were used to calculate the inter-subject variability. The clinical utility was demonstrated on a cervical cancer patient. Test-retest experiments were used to assess reproducibility of the parameter maps in the tumor. RESULTS The DCE-Qnet reconstruction outperformed NLSQ in the phantom. The coefficient of variation (CV) in the healthy cervix varied between 5 and 51% depending on the parameter. Parameter values in the tumor agreed with previous studies despite differences in methodology. The CV in the tumor varied between 1 and 47%. CONCLUSION The proposed approach provides comprehensive DCE-MRI quantification from a single acquisition. DCE-Qnet eliminates the need for separate T1 scan or BAT processing, leading to a reduction of 10 min per scan and more accurate quantification.
Collapse
Affiliation(s)
- Ouri Cohen
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, NY, 320 East 61st St 10025, USA.
| | - Soudabeh Kargar
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, NY, 320 East 61st St 10025, USA
| | - Sungmin Woo
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Alberto Vargas
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Ricardo Otazo
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, NY, 320 East 61st St 10025, USA
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| |
Collapse
|
6
|
Heo HY, Singh M, Mahmud SZ, Blair L, Kamson DO, Zhou J. Unraveling contributions to the Z-spectrum signal at 3.5 ppm of human brain tumors. Magn Reson Med 2024; 92:2641-2651. [PMID: 39086185 PMCID: PMC11436306 DOI: 10.1002/mrm.30241] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2024] [Revised: 06/26/2024] [Accepted: 07/17/2024] [Indexed: 08/02/2024]
Abstract
PURPOSE To evaluate the influence of the confounding factors, direct water saturation (DWS), and magnetization transfer contrast (MTC) effects on measured Z-spectra and amide proton transfer (APT) contrast in brain tumors. METHODS High-grade glioma patients were scanned using an RF saturation-encoded 3D MR fingerprinting (MRF) sequence at 3 T. For MRF reconstruction, a recurrent neural network was designed to learn free water and semisolid macromolecule parameter mappings of the underlying multiple tissue properties from saturation-transfer MRF signals. The DWS spectra and MTC spectra were synthesized by solving Bloch-McConnell equations and evaluated in brain tumors. RESULTS The dominant contribution to the saturation effect at 3.5 ppm was from DWS and MTC effects, but 25%-33% of the saturated signal in the gadolinium-enhancing tumor (13%-20% for normal tissue) was due to the APT effect. The APT# signal of the gadolinium-enhancing tumor was significantly higher than that of the normal-appearing white matter (10.1% vs. 8.3% at 1 μT and 11.2% vs. 7.8% at 1.5 μT). CONCLUSION The RF saturation-encoded MRF allowed us to separate contributions to the saturation signal at 3.5 ppm in the Z-spectrum. Although free water and semisolid MTC are the main contributors, significant APT contrast between tumor and normal tissues was observed.
Collapse
Affiliation(s)
- Hye-Young Heo
- Department of Radiology and Radiological Science, Johns Hopkins University, Baltimore, Maryland, USA
- F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, Maryland, USA
| | - Munendra Singh
- Department of Radiology and Radiological Science, Johns Hopkins University, Baltimore, Maryland, USA
| | - Sultan Z Mahmud
- Department of Radiology and Radiological Science, Johns Hopkins University, Baltimore, Maryland, USA
| | - Lindsay Blair
- Department of Neurology, Johns Hopkins University, Baltimore, Maryland, USA
| | - David Olayinka Kamson
- Department of Neurology, Johns Hopkins University, Baltimore, Maryland, USA
- Department of Oncology, Johns Hopkins University, Baltimore, Maryland, USA
| | - Jinyuan Zhou
- Department of Radiology and Radiological Science, Johns Hopkins University, Baltimore, Maryland, USA
| |
Collapse
|
7
|
Power I, Rivlin M, Shmuely H, Zaiss M, Navon G, Perlman O. In vivo mapping of the chemical exchange relayed nuclear Overhauser effect using deep magnetic resonance fingerprinting. iScience 2024; 27:111209. [PMID: 39569380 PMCID: PMC11576397 DOI: 10.1016/j.isci.2024.111209] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2024] [Revised: 09/17/2024] [Accepted: 10/16/2024] [Indexed: 11/22/2024] Open
Abstract
Noninvasive magnetic resonance imaging (MRI) of the relayed nuclear Overhauser effect (rNOE) constitutes a promising approach for gaining biological insights into various pathologies, including brain cancer, kidney injury, ischemic stroke, and liver disease. However, rNOE imaging is time-consuming and prone to biases stemming from the water T1 and the semisolid magnetization transfer (MT) contrasts. Here, we developed a rapid rNOE quantification approach, combining magnetic resonance fingerprinting (MRF) acquisition with deep-learning-based reconstruction. The method was systematically validated using tissue-mimicking phantoms, wild-type mice (n = 7), and healthy human volunteers (n = 5). In vitro rNOE parameter maps generated by MRF were highly correlated with ground truth (r > 0.98, p < 0.001). Simultaneous mapping of the rNOE and the semisolid MT exchange parameters in mice and humans were in agreement with previously reported literature values. Whole-brain 3D parameter mapping in humans took less than 5 min (282 s for acquisition and less than 2 s for reconstruction). With its demonstrated ability to rapidly extract quantitative molecular maps, deep rNOE-MRF can potentially serve as a valuable tool for the characterization and detection of molecular abnormalities in vivo.
Collapse
Affiliation(s)
- Inbal Power
- Department of Biomedical Engineering, Tel Aviv University, Tel Aviv, Israel
| | - Michal Rivlin
- Department of Biomedical Engineering, Tel Aviv University, Tel Aviv, Israel
- School of Chemistry, Tel Aviv University, Tel Aviv, Israel
| | - Hagar Shmuely
- Department of Biomedical Engineering, Tel Aviv University, Tel Aviv, Israel
| | - Moritz Zaiss
- Institute of Neuroradiology, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
- Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Gil Navon
- School of Chemistry, Tel Aviv University, Tel Aviv, Israel
| | - Or Perlman
- Department of Biomedical Engineering, Tel Aviv University, Tel Aviv, Israel
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel
| |
Collapse
|
8
|
Liu B, She H, Du YP. Scan-Specific Unsupervised Highly Accelerated Non-Cartesian CEST Imaging Using Implicit Neural Representation and Explicit Sparse Prior. IEEE Trans Biomed Eng 2024; 71:3032-3045. [PMID: 38814759 DOI: 10.1109/tbme.2024.3407092] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/01/2024]
Abstract
OBJECTIVE Chemical exchange saturation transfer (CEST) is a promising magnetic resonance imaging (MRI) technique. CEST imaging usually requires a long scan time, and reducing acquisition time is highly desirable for clinical applications. METHODS A novel scan-specific unsupervised deep learning algorithm is proposed to accelerate steady-state pulsed CEST imaging with golden-angle stack-of-stars trajectory using hybrid-feature hash encoding implicit neural representation. Additionally, imaging quality is further improved by using the explicit prior knowledge of low rank and weighted joint sparsity in the spatial and Z-spectral domain of CEST data. RESULTS In the retrospective acceleration experiment, the proposed method outperforms other state-of-the-art algorithms (TDDIP, LRTES, kt-SLR, NeRP, CRNN, and PBCS) for the in vivo human brain dataset under various acceleration rates. In the prospective acceleration experiment, the proposed algorithm can still obtain results close to the fully-sampled images. CONCLUSION AND SIGNIFICANCE The hybrid-feature hash encoding implicit neural representation combined with explicit sparse prior (INRESP) can efficiently accelerate CEST imaging. The proposed algorithm achieves reduced error and improved image quality compared to several state-of-the-art algorithms at relatively high acceleration factors. The superior performance and the training database-free characteristic make the proposed algorithm promising for accelerating CEST imaging in various applications.
Collapse
|
9
|
Heckel R, Jacob M, Chaudhari A, Perlman O, Shimron E. Deep learning for accelerated and robust MRI reconstruction. MAGMA (NEW YORK, N.Y.) 2024; 37:335-368. [PMID: 39042206 DOI: 10.1007/s10334-024-01173-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/03/2024] [Revised: 05/24/2024] [Accepted: 05/28/2024] [Indexed: 07/24/2024]
Abstract
Deep learning (DL) has recently emerged as a pivotal technology for enhancing magnetic resonance imaging (MRI), a critical tool in diagnostic radiology. This review paper provides a comprehensive overview of recent advances in DL for MRI reconstruction, and focuses on various DL approaches and architectures designed to improve image quality, accelerate scans, and address data-related challenges. It explores end-to-end neural networks, pre-trained and generative models, and self-supervised methods, and highlights their contributions to overcoming traditional MRI limitations. It also discusses the role of DL in optimizing acquisition protocols, enhancing robustness against distribution shifts, and tackling biases. Drawing on the extensive literature and practical insights, it outlines current successes, limitations, and future directions for leveraging DL in MRI reconstruction, while emphasizing the potential of DL to significantly impact clinical imaging practices.
Collapse
Affiliation(s)
- Reinhard Heckel
- Department of computer engineering, Technical University of Munich, Munich, Germany
| | - Mathews Jacob
- Department of Electrical and Computer Engineering, University of Iowa, Iowa, 52242, IA, USA
| | - Akshay Chaudhari
- Department of Radiology, Stanford University, Stanford, 94305, CA, USA
- Department of Biomedical Data Science, Stanford University, Stanford, 94305, CA, USA
| | - Or Perlman
- Department of Biomedical Engineering, Tel Aviv University, Tel Aviv, Israel
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel
| | - Efrat Shimron
- Department of Electrical and Computer Engineering, Technion-Israel Institute of Technology, Haifa, 3200004, Israel.
- Department of Biomedical Engineering, Technion-Israel Institute of Technology, Haifa, 3200004, Israel.
| |
Collapse
|
10
|
Cohen O, Kargar S, Woo S, Vargas A, Otazo R. DCE-Qnet: Deep Network Quantification of Dynamic Contrast Enhanced (DCE) MRI. ARXIV 2024:arXiv:2405.12360v1. [PMID: 38827459 PMCID: PMC11142325] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 06/04/2024]
Abstract
Introduction Quantification of dynamic contrast-enhanced (DCE)-MRI has the potential to provide valuable clinical information, but robust pharmacokinetic modeling remains a challenge for clinical adoption. Methods A 7-layer neural network called DCE-Qnet was trained on simulated DCE-MRI signals derived from the Extended Tofts model with the Parker arterial input function. Network training incorporated B1 inhomogeneities to estimate perfusion (Ktrans, vp, ve), tissue T1 relaxation, proton density and bolus arrival time (BAT). The accuracy was tested in a digital phantom in comparison to a conventional nonlinear least-squares fitting (NLSQ). In vivo testing was conducted in 10 healthy subjects. Regions of interest in the cervix and uterine myometrium were used to calculate the inter-subject variability. The clinical utility was demonstrated on a cervical cancer patient. Test-retest experiments were used to assess reproducibility of the parameter maps in the tumor. Results The DCE-Qnet reconstruction outperformed NLSQ in the phantom. The coefficient of variation (CV) in the healthy cervix varied between 5-51% depending on the parameter. Parameter values in the tumor agreed with previous studies despite differences in methodology. The CV in the tumor varied between 1-47%. Conclusion The proposed approach provides comprehensive DCE-MRI quantification from a single acquisition. DCE-Qnet eliminates the need for separate T1 scan or BAT processing, leading to a reduction of 10 minutes per scan and more accurate quantification.
Collapse
Affiliation(s)
- Ouri Cohen
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Soudabeh Kargar
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Sungmin Woo
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Alberto Vargas
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Ricardo Otazo
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, NY, USA
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| |
Collapse
|
11
|
Viswanathan M, Yin L, Kurmi Y, Zu Z. Machine learning-based amide proton transfer imaging using partially synthetic training data. Magn Reson Med 2024; 91:1908-1922. [PMID: 38098340 PMCID: PMC10955622 DOI: 10.1002/mrm.29970] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2023] [Revised: 10/30/2023] [Accepted: 11/26/2023] [Indexed: 12/20/2023]
Abstract
PURPOSE Machine learning (ML) has been increasingly used to quantify CEST effect. ML models are typically trained using either measured data or fully simulated data. However, training with measured data often lacks sufficient training data, whereas training with fully simulated data may introduce bias because of limited simulations pools. This study introduces a new platform that combines simulated and measured components to generate partially synthetic CEST data, and to evaluate its feasibility for training ML models to predict amide proton transfer (APT) effect. METHODS Partially synthetic CEST signals were created using an inverse summation of APT effects from simulations and the other components from measurements. Training data were generated by varying APT simulation parameters and applying scaling factors to adjust the measured components, achieving a balance between simulation flexibility and fidelity. First, tissue-mimicking CEST signals along with ground truth information were created using multiple-pool model simulations to validate this method. Second, an ML model was trained individually on partially synthetic data, in vivo data, and fully simulated data, to predict APT effect in rat brains bearing 9 L tumors. RESULTS Experiments on tissue-mimicking data suggest that the ML method using the partially synthetic data is accurate in predicting APT. In vivo experiments suggest that our method provides more accurate and robust prediction than the training using in vivo data and fully synthetic data. CONCLUSION Partially synthetic CEST data can address the challenges in conventional ML methods.
Collapse
Affiliation(s)
- Malvika Viswanathan
- Vanderbilt University Institute of Imaging Science, Vanderbilt University Medical Center, Nashville, US
- Department of Biomedical Engineering, Vanderbilt University, Nashville, US
| | - Leqi Yin
- School of Engineering, Vanderbilt University, Nashville, US
| | - Yashwant Kurmi
- Vanderbilt University Institute of Imaging Science, Vanderbilt University Medical Center, Nashville, US
- Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Nashville, US
| | - Zhongliang Zu
- Vanderbilt University Institute of Imaging Science, Vanderbilt University Medical Center, Nashville, US
- Department of Biomedical Engineering, Vanderbilt University, Nashville, US
- Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Nashville, US
| |
Collapse
|
12
|
Xu J, Zu T, Hsu YC, Wang X, Chan KWY, Zhang Y. Accelerating CEST imaging using a model-based deep neural network with synthetic training data. Magn Reson Med 2024; 91:583-599. [PMID: 37867413 DOI: 10.1002/mrm.29889] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Revised: 08/31/2023] [Accepted: 09/25/2023] [Indexed: 10/24/2023]
Abstract
PURPOSE To develop a model-based deep neural network for high-quality image reconstruction of undersampled multi-coil CEST data. THEORY AND METHODS Inspired by the variational network (VN), the CEST image reconstruction equation is unrolled into a deep neural network (CEST-VN) with a k-space data-sharing block that takes advantage of the inherent redundancy in adjacent CEST frames and 3D spatial-frequential convolution kernels that exploit correlations in the x-ω domain. Additionally, a new pipeline based on multiple-pool Bloch-McConnell simulations is devised to synthesize multi-coil CEST data from publicly available anatomical MRI data. The proposed network is trained on simulated data with a CEST-specific loss function that jointly measures the structural and CEST contrast. The performance of CEST-VN was evaluated on four healthy volunteers and five brain tumor patients using retrospectively or prospectively undersampled data with various acceleration factors, and then compared with other conventional and state-of-the-art reconstruction methods. RESULTS The proposed CEST-VN method generated high-quality CEST source images and amide proton transfer-weighted maps in healthy and brain tumor subjects, consistently outperforming GRAPPA, blind compressed sensing, and the original VN. With the acceleration factors increasing from 3 to 6, CEST-VN with the same hyperparameters yielded similar and accurate reconstruction without apparent loss of details or increase of artifacts. The ablation studies confirmed the effectiveness of the CEST-specific loss function and data-sharing block used. CONCLUSIONS The proposed CEST-VN method can offer high-quality CEST source images and amide proton transfer-weighted maps from highly undersampled multi-coil data by integrating the deep learning prior and multi-coil sensitivity encoding model.
Collapse
Affiliation(s)
- Jianping Xu
- Key Laboratory for Biomedical Engineering of Ministry of Education, Department of Biomedical Engineering, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, People's Republic of China
| | - Tao Zu
- Key Laboratory for Biomedical Engineering of Ministry of Education, Department of Biomedical Engineering, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, People's Republic of China
| | - Yi-Cheng Hsu
- MR Collaboration, Siemens Healthcare Ltd., Shanghai, People's Republic of China
| | - Xiaoli Wang
- School of Medical Imaging, Weifang Medical University, Weifang, People's Republic of China
| | - Kannie W Y Chan
- Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, People's Republic of China
| | - Yi Zhang
- Key Laboratory for Biomedical Engineering of Ministry of Education, Department of Biomedical Engineering, College of Biomedical Engineering & Instrument Science, Zhejiang University, Hangzhou, People's Republic of China
| |
Collapse
|
13
|
Xiao G, Zhang X, Tang H, Huang W, Chen Y, Zhuang C, Chen B, Yang L, Chen Y, Yan G, Wu R. Deep learning for dense Z-spectra reconstruction from CEST images at sparse frequency offsets. Front Neurosci 2024; 17:1323131. [PMID: 38249588 PMCID: PMC10796656 DOI: 10.3389/fnins.2023.1323131] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Accepted: 12/13/2023] [Indexed: 01/23/2024] Open
Abstract
A direct way to reduce scan time for chemical exchange saturation transfer (CEST)-magnetic resonance imaging (MRI) is to reduce the number of CEST images acquired in experiments. In some scenarios, a sufficient number of CEST images acquired in experiments was needed to estimate parameters for quantitative analysis, and this prolonged the scan time. For that, we aim to develop a general deep-learning framework to reconstruct dense CEST Z-spectra from experimentally acquired images at sparse frequency offsets so as to reduce the number of experimentally acquired CEST images and achieve scan time reduction. The main innovation works are outlined as follows: (1) a general sequence-to-sequence (seq2seq) framework is proposed to reconstruct dense CEST Z-spectra from experimentally acquired images at sparse frequency offsets; (2) we create a training set from wide-ranging simulated Z-spectra instead of experimentally acquired CEST data, overcoming the limitation of the time and labor consumption in manual annotation; (3) a new seq2seq network that is capable of utilizing information from both short-range and long-range is developed to improve reconstruction ability. One of our intentions is to establish a simple and efficient framework, i.e., traditional seq2seq can solve the reconstruction task and obtain satisfactory results. In addition, we propose a new seq2seq network that includes the short- and long-range ability to boost dense CEST Z-spectra reconstruction. The experimental results demonstrate that the considered seq2seq models can accurately reconstruct dense CEST images from experimentally acquired images at 11 frequency offsets so as to reduce the scan time by at least 2/3, and our new seq2seq network contributes to competitive advantage.
Collapse
Affiliation(s)
- Gang Xiao
- School of Mathematics and Statistics, Hanshan Normal University, Chaozhou, China
| | - Xiaolei Zhang
- Department of Radiology, Second Affiliated Hospital of Shantou University Medical College, Shantou, China
| | - Hanjing Tang
- College of Engineering, Shantou University, Shantou, China
| | - Weipeng Huang
- Medical Imaging Center, Jieyang People's Hospital, Jieyang, China
| | - Yaowen Chen
- College of Engineering, Shantou University, Shantou, China
| | - Caiyu Zhuang
- Department of Radiology, Second Affiliated Hospital of Shantou University Medical College, Shantou, China
| | - Beibei Chen
- Department of Radiology, Second Affiliated Hospital of Shantou University Medical College, Shantou, China
| | - Lin Yang
- Department of Radiology, Second Affiliated Hospital of Shantou University Medical College, Shantou, China
| | - Yue Chen
- Department of Radiology, Second Affiliated Hospital of Shantou University Medical College, Shantou, China
| | - Gen Yan
- Department of Radiology, Second Affiliated Hospital of Xiamen Medical College, Xiamen, China
| | - Renhua Wu
- Department of Radiology, Second Affiliated Hospital of Shantou University Medical College, Shantou, China
| |
Collapse
|
14
|
Islam MT, Zhou Z, Ren H, Khuzani MB, Kapp D, Zou J, Tian L, Liao JC, Xing L. Revealing hidden patterns in deep neural network feature space continuum via manifold learning. Nat Commun 2023; 14:8506. [PMID: 38129376 PMCID: PMC10739971 DOI: 10.1038/s41467-023-43958-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Accepted: 11/24/2023] [Indexed: 12/23/2023] Open
Abstract
Deep neural networks (DNNs) extract thousands to millions of task-specific features during model training for inference and decision-making. While visualizing these features is critical for comprehending the learning process and improving the performance of the DNNs, existing visualization techniques work only for classification tasks. For regressions, the feature points lie on a high dimensional continuum having an inherently complex shape, making a meaningful visualization of the features intractable. Given that the majority of deep learning applications are regression-oriented, developing a conceptual framework and computational method to reliably visualize the regression features is of great significance. Here, we introduce a manifold discovery and analysis (MDA) method for DNN feature visualization, which involves learning the manifold topology associated with the output and target labels of a DNN. MDA leverages the acquired topological information to preserve the local geometry of the feature space manifold and provides insightful visualizations of the DNN features, highlighting the appropriateness, generalizability, and adversarial robustness of a DNN. The performance and advantages of the MDA approach compared to the existing methods are demonstrated in different deep learning applications.
Collapse
Affiliation(s)
- Md Tauhidul Islam
- Department of Radiation Oncology, Stanford University, Stanford, CA, 94305, USA
| | - Zixia Zhou
- Department of Radiation Oncology, Stanford University, Stanford, CA, 94305, USA
| | - Hongyi Ren
- Department of Radiation Oncology, Stanford University, Stanford, CA, 94305, USA
| | | | - Daniel Kapp
- Department of Radiation Oncology, Stanford University, Stanford, CA, 94305, USA
| | - James Zou
- Department of Biomedical Data Science, Stanford University, Stanford, CA, 94305, USA
| | - Lu Tian
- Department of Biomedical Data Science, Stanford University, Stanford, CA, 94305, USA
| | - Joseph C Liao
- Department of Urology, Stanford University, Stanford, CA, 94305, USA.
| | - Lei Xing
- Department of Radiation Oncology, Stanford University, Stanford, CA, 94305, USA.
| |
Collapse
|
15
|
Viswanathan M, Yin L, Kurmi Y, Zu Z. Amide Proton Transfer (APT) imaging in tumor with a machine learning approach using partially synthetic data. ARXIV 2023:arXiv:2311.01683v2. [PMID: 37961738 PMCID: PMC10635304] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Subscribe] [Scholar Register] [Indexed: 11/15/2023]
Abstract
Purpose Machine learning (ML) has been increasingly used to quantify chemical exchange saturation transfer (CEST) effect. ML models are typically trained using either measured data or fully simulated data. However, training with measured data often lacks sufficient training data, while training with fully simulated data may introduce bias due to limited simulations pools. This study introduces a new platform that combines simulated and measured components to generate partially synthetic CEST data, and to evaluate its feasibility for training ML models to predict amide proton transfer (APT) effect. Methods Partially synthetic CEST signals were created using an inverse summation of APT effects from simulations and the other components from measurements. Training data were generated by varying APT simulation parameters and applying scaling factors to adjust the measured components, achieving a balance between simulation flexibility and fidelity. First, tissue-mimicking CEST signals along with ground truth information were created using multiple-pool model simulations to validate this method. Second, an ML model was trained individually on partially synthetic data, in vivo data, and fully simulated data, to predict APT effect in rat brains bearing 9L tumors. Results Experiments on tissue-mimicking data suggest that the ML method using the partially synthetic data is accurate in predicting APT. In vivo experiments suggest that our method provides more accurate and robust prediction than the training using in vivo data and fully synthetic data. Conclusion Partially synthetic CEST data can address the challenges in conventional ML methods.
Collapse
Affiliation(s)
- Malvika Viswanathan
- Vanderbilt University Institute of Imaging Science, Vanderbilt University Medical Center, Nashville, US
- Department of Biomedical Engineering, Vanderbilt University, Nashville, US
| | - Leqi Yin
- School of Engineering, Vanderbilt University, Nashville, US
| | - Yashwant Kurmi
- Vanderbilt University Institute of Imaging Science, Vanderbilt University Medical Center, Nashville, US
- Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Nashville, US
| | - Zhongliang Zu
- Vanderbilt University Institute of Imaging Science, Vanderbilt University Medical Center, Nashville, US
- Department of Biomedical Engineering, Vanderbilt University, Nashville, US
- Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Nashville, US
| |
Collapse
|
16
|
Nagar D, Vladimirov N, Farrar CT, Perlman O. Dynamic and rapid deep synthesis of chemical exchange saturation transfer and semisolid magnetization transfer MRI signals. Sci Rep 2023; 13:18291. [PMID: 37880343 PMCID: PMC10600114 DOI: 10.1038/s41598-023-45548-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2023] [Accepted: 10/20/2023] [Indexed: 10/27/2023] Open
Abstract
Model-driven analysis of biophysical phenomena is gaining increased attention and utility for medical imaging applications. In magnetic resonance imaging (MRI), the availability of well-established models for describing the relations between the nuclear magnetization, tissue properties, and the externally applied magnetic fields has enabled the prediction of image contrast and served as a powerful tool for designing the imaging protocols that are now routinely used in the clinic. Recently, various advanced imaging techniques have relied on these models for image reconstruction, quantitative tissue parameter extraction, and automatic optimization of acquisition protocols. In molecular MRI, however, the increased complexity of the imaging scenario, where the signals from various chemical compounds and multiple proton pools must be accounted for, results in exceedingly long model simulation times, severely hindering the progress of this approach and its dissemination for various clinical applications. Here, we show that a deep-learning-based system can capture the nonlinear relations embedded in the molecular MRI Bloch-McConnell model, enabling a rapid and accurate generation of biologically realistic synthetic data. The applicability of this simulated data for in-silico, in-vitro, and in-vivo imaging applications is then demonstrated for chemical exchange saturation transfer (CEST) and semisolid macromolecule magnetization transfer (MT) analysis and quantification. The proposed approach yielded 63-99% acceleration in data synthesis time while retaining excellent agreement with the ground truth (Pearson's r > 0.99, p < 0.0001, normalized root mean square error < 3%).
Collapse
Affiliation(s)
- Dinor Nagar
- School of Electrical Engineering, Tel Aviv University, Tel Aviv, Israel
| | - Nikita Vladimirov
- Department of Biomedical Engineering, Tel Aviv University, 6997801, Tel Aviv, Israel
| | - Christian T Farrar
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA, USA
| | - Or Perlman
- Department of Biomedical Engineering, Tel Aviv University, 6997801, Tel Aviv, Israel.
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel.
| |
Collapse
|
17
|
Singh M, Jiang S, Li Y, van Zijl P, Zhou J, Heo HY. Bloch simulator-driven deep recurrent neural network for magnetization transfer contrast MR fingerprinting and CEST imaging. Magn Reson Med 2023; 90:1518-1536. [PMID: 37317675 PMCID: PMC10524222 DOI: 10.1002/mrm.29748] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2022] [Revised: 04/17/2023] [Accepted: 05/18/2023] [Indexed: 06/16/2023]
Abstract
PURPOSE To develop a unified deep-learning framework by combining an ultrafast Bloch simulator and a semisolid macromolecular magnetization transfer contrast (MTC) MR fingerprinting (MRF) reconstruction for estimation of MTC effects. METHODS The Bloch simulator and MRF reconstruction architectures were designed with recurrent neural networks and convolutional neural networks, evaluated with numerical phantoms with known ground truths and cross-linked bovine serum albumin phantoms, and demonstrated in the brain of healthy volunteers at 3 T. In addition, the inherent magnetization-transfer ratio asymmetry effect was evaluated in MTC-MRF, CEST, and relayed nuclear Overhauser enhancement imaging. A test-retest study was performed to evaluate the repeatability of MTC parameters, CEST, and relayed nuclear Overhauser enhancement signals estimated by the unified deep-learning framework. RESULTS Compared with a conventional Bloch simulation, the deep Bloch simulator for generation of the MTC-MRF dictionary or a training data set reduced the computation time by 181-fold, without compromising MRF profile accuracy. The recurrent neural network-based MRF reconstruction outperformed existing methods in terms of reconstruction accuracy and noise robustness. Using the proposed MTC-MRF framework for tissue-parameter quantification, the test-retest study showed a high degree of repeatability in which the coefficients of variance were less than 7% for all tissue parameters. CONCLUSION Bloch simulator-driven, deep-learning MTC-MRF can provide robust and repeatable multiple-tissue parameter quantification in a clinically feasible scan time on a 3T scanner.
Collapse
Affiliation(s)
- Munendra Singh
- Division of MR Research, Department of Radiology, Johns Hopkins University, Baltimore, Maryland, USA
| | - Shanshan Jiang
- Division of MR Research, Department of Radiology, Johns Hopkins University, Baltimore, Maryland, USA
| | - Yuguo Li
- Division of MR Research, Department of Radiology, Johns Hopkins University, Baltimore, Maryland, USA
| | - Peter van Zijl
- Division of MR Research, Department of Radiology, Johns Hopkins University, Baltimore, Maryland, USA
- F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, Maryland, USA
| | - Jinyuan Zhou
- Division of MR Research, Department of Radiology, Johns Hopkins University, Baltimore, Maryland, USA
| | - Hye-Young Heo
- Division of MR Research, Department of Radiology, Johns Hopkins University, Baltimore, Maryland, USA
- F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, Maryland, USA
| |
Collapse
|
18
|
Cui J, Zhao Y, Sun C, Xu J, Zu Z. Evaluation of contributors to amide proton transfer-weighted imaging and nuclear Overhauser enhancement-weighted imaging contrast in tumors at a high magnetic field. Magn Reson Med 2023; 90:596-614. [PMID: 37093984 PMCID: PMC10616782 DOI: 10.1002/mrm.29675] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2022] [Revised: 03/31/2023] [Accepted: 03/31/2023] [Indexed: 04/26/2023]
Abstract
PURPOSE The purpose is to evaluate the relative contribution from confounding factors (T1 weighting and magnetization transfer) to the CEST ratio (CESTR)-quantified amide proton transfer (APT) and nuclear Overhauser enhancement (NOE) (-3.5) in tumors as well as whether the CESTR can reflect the distribution of the solute concentration (fs ). METHODS We first provided a signal model that shows the separate dependence of CESTR on these confounding factors and the clean CEST/NOE effects quantified by an apparent exchange-dependent relaxation (AREX) method. We then measured the change in these effects in the 9-L tumor model in rats, through which we calculated the relative contribution of each confounding factor. fs was also fitted, and its correlations with the CESTR and AREX were assessed to evaluate their capabilities to reflect fs . RESULTS The CESTR-quantified APT shows "positive" contrast in tumors, which arises primarily from R1w at low powers and both R1w and magnetization transfer at high powers. CESTR-quantified NOE (-3.5) shows no or weak contrast in tumors, which is due to the cancelation of R1w and NOE (-3.5), which have opposite contributions. CESTR-quantified APT has a stronger correlation with APT fs than AREX-quantified APT. CESTR-quantified NOE (-3.5) has a weaker correlation with NOE (-3.5) fs than AREX-quantified NOE (-3.5). CONCLUSION CESTR reflects a combined effect of T1 weighting and CEST/NOE. Both factors depend on fs , which contributes positively to the dependence of CESTR on fs in APT imaging and enhances its correlation with fs . In contrast, these factors have opposite contributions to its dependence on fs in NOE (-3.5) imaging, thereby weakening the correlation.
Collapse
Affiliation(s)
- Jing Cui
- Vanderbilt University Institute of Imaging Science, Nashville, US
- Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Nashville, US
| | - Yu Zhao
- Vanderbilt University Institute of Imaging Science, Nashville, US
- Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Nashville, US
| | - Casey Sun
- Vanderbilt University Institute of Imaging Science, Nashville, US
- Department of Chemistry, University of Florida, Gainesville, US
| | - Junzhong Xu
- Vanderbilt University Institute of Imaging Science, Nashville, US
- Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Nashville, US
- Department of Biomedical Engineering, Vanderbilt University, Nashville, US
- Department of Physics and Astronomy, Vanderbilt University, Nashville, US
| | - Zhongliang Zu
- Vanderbilt University Institute of Imaging Science, Nashville, US
- Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Nashville, US
- Department of Biomedical Engineering, Vanderbilt University, Nashville, US
| |
Collapse
|
19
|
Perlman O, Farrar CT, Heo HY. MR fingerprinting for semisolid magnetization transfer and chemical exchange saturation transfer quantification. NMR IN BIOMEDICINE 2023; 36:e4710. [PMID: 35141967 PMCID: PMC9808671 DOI: 10.1002/nbm.4710] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/06/2021] [Revised: 01/18/2022] [Accepted: 02/04/2022] [Indexed: 05/11/2023]
Abstract
Chemical exchange saturation transfer (CEST) MRI has positioned itself as a promising contrast mechanism, capable of providing molecular information at sufficient resolution and amplified sensitivity. However, it has not yet become a routinely employed clinical technique, due to a variety of confounding factors affecting its contrast-weighted image interpretation and the inherently long scan time. CEST MR fingerprinting (MRF) is a novel approach for addressing these challenges, allowing simultaneous quantitation of several proton exchange parameters using rapid acquisition schemes. Recently, a number of deep-learning algorithms have been developed to further boost the performance and speed of CEST and semi-solid macromolecule magnetization transfer (MT) MRF. This review article describes the fundamental theory behind semisolid MT/CEST-MRF and its main applications. It then details supervised and unsupervised learning approaches for MRF image reconstruction and describes artificial intelligence (AI)-based pipelines for protocol optimization. Finally, practical considerations are discussed, and future perspectives are given, accompanied by basic demonstration code and data.
Collapse
Affiliation(s)
- Or Perlman
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA, USA
| | - Christian T. Farrar
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA, USA
| | - Hye-Young Heo
- Division of MR Research, Department of Radiology, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA
- F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, Maryland, USA
| |
Collapse
|
20
|
Weigand-Whittier J, Sedykh M, Herz K, Coll-Font J, Foster AN, Gerstner ER, Nguyen C, Zaiss M, Farrar CT, Perlman O. Accelerated and quantitative three-dimensional molecular MRI using a generative adversarial network. Magn Reson Med 2023; 89:1901-1914. [PMID: 36585915 PMCID: PMC9992146 DOI: 10.1002/mrm.29574] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2022] [Revised: 12/13/2022] [Accepted: 12/15/2022] [Indexed: 01/01/2023]
Abstract
PURPOSE To substantially shorten the acquisition time required for quantitative three-dimensional (3D) chemical exchange saturation transfer (CEST) and semisolid magnetization transfer (MT) imaging and allow for rapid chemical exchange parameter map reconstruction. METHODS Three-dimensional CEST and MT magnetic resonance fingerprinting (MRF) datasets of L-arginine phantoms, whole-brains, and calf muscles from healthy volunteers, cancer patients, and cardiac patients were acquired using 3T clinical scanners at three different sites, using three different scanner models and coils. A saturation transfer-oriented generative adversarial network (GAN-ST) supervised framework was then designed and trained to learn the mapping from a reduced input data space to the quantitative exchange parameter space, while preserving perceptual and quantitative content. RESULTS The GAN-ST 3D acquisition time was 42-52 s, 70% shorter than CEST-MRF. The quantitative reconstruction of the entire brain took 0.8 s. An excellent agreement was observed between the ground truth and GAN-based L-arginine concentration and pH values (Pearson's r > 0.95, ICC > 0.88, NRMSE < 3%). GAN-ST images from a brain-tumor subject yielded a semi-solid volume fraction and exchange rate NRMSE of3 . 8 ± 1 . 3 % $$ 3.8\pm 1.3\% $$ and4 . 6 ± 1 . 3 % $$ 4.6\pm 1.3\% $$ , respectively, and SSIM of96 . 3 ± 1 . 6 % $$ 96.3\pm 1.6\% $$ and95 . 0 ± 2 . 4 % $$ 95.0\pm 2.4\% $$ , respectively. The mapping of the calf-muscle exchange parameters in a cardiac patient, yielded NRMSE < 7% and SSIM > 94% for the semi-solid exchange parameters. In regions with large susceptibility artifacts, GAN-ST has demonstrated improved performance and reduced noise compared to MRF. CONCLUSION GAN-ST can substantially reduce the acquisition time for quantitative semi-solid MT/CEST mapping, while retaining performance even when facing pathologies and scanner models that were not available during training.
Collapse
Affiliation(s)
- Jonah Weigand-Whittier
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Charlestown, Massachusetts
| | - Maria Sedykh
- Institute of Neuroradiology, Friedrich-Alexander Universität Erlangen-Nürnberg (FAU), University Hospital Erlangen, Erlangen, Germany
| | - Kai Herz
- Magnetic Resonance Center, Max Planck Institute for Biological Cybernetics, Tübingen, Germany
- Department of Biomedical Magnetic Resonance, University of Tübingen, Tübingen, Germany
| | - Jaume Coll-Font
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Charlestown, Massachusetts
- Cardiovascular Research Center, Cardiology Division, Massachusetts General Hospital, Charlestown, Massachusetts
| | - Anna N. Foster
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Charlestown, Massachusetts
- Cardiovascular Research Center, Cardiology Division, Massachusetts General Hospital, Charlestown, Massachusetts
| | - Elizabeth R. Gerstner
- Massachusetts General Hospital Cancer Center, Harvard Medical School, Boston, Massachusetts
| | - Christopher Nguyen
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Charlestown, Massachusetts
- Cardiovascular Research Center, Cardiology Division, Massachusetts General Hospital, Charlestown, Massachusetts
- Health Science Technology, Harvard-MIT, Cambridge, Massachusetts
- Cardiovascular Innovation Research Center, Heart, Vascular, and Thoracic Institute, Cleveland Clinic, Cleveland, Ohio
| | - Moritz Zaiss
- Institute of Neuroradiology, Friedrich-Alexander Universität Erlangen-Nürnberg (FAU), University Hospital Erlangen, Erlangen, Germany
- Magnetic Resonance Center, Max Planck Institute for Biological Cybernetics, Tübingen, Germany
- Department Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Christian T. Farrar
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Charlestown, Massachusetts
| | - Or Perlman
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Charlestown, Massachusetts
- Department of Biomedical Engineering, Tel Aviv University, Tel Aviv, Israel
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel
| |
Collapse
|
21
|
Shimron E, Perlman O. AI in MRI: Computational Frameworks for a Faster, Optimized, and Automated Imaging Workflow. Bioengineering (Basel) 2023; 10:492. [PMID: 37106679 PMCID: PMC10135995 DOI: 10.3390/bioengineering10040492] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Revised: 04/12/2023] [Accepted: 04/18/2023] [Indexed: 04/29/2023] Open
Abstract
Over the last decade, artificial intelligence (AI) has made an enormous impact on a wide range of fields, including science, engineering, informatics, finance, and transportation [...].
Collapse
Affiliation(s)
- Efrat Shimron
- Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, CA 94720, USA
| | - Or Perlman
- Department of Biomedical Engineering, Tel Aviv University, Tel Aviv 6997801, Israel
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv 6997801, Israel
| |
Collapse
|
22
|
Cheng F, Liu Y, Chen Y, Yap PT. High-Resolution 3D Magnetic Resonance Fingerprinting With a Graph Convolutional Network. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; 42:674-683. [PMID: 36269931 PMCID: PMC10081960 DOI: 10.1109/tmi.2022.3216527] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Magnetic resonance fingerprinting (MRF) is a novel quantitative imaging framework for rapid and simultaneous quantification of multiple tissue properties. 3D MRF allows higher through-plane resolution, but the acquisition process is slow when whole-brain coverage is needed. Existing methods for acceleration mainly rely on GRAPPA for k-space interpolation in the partition-encoding direction, limiting the acceleration factor to 2 or 3. In this work, we replace GRAPPA with a deep learning approach for accurate tissue quantification with greater acceleration. Specifically, a graph convolution network (GCN) is developed to cater to the non-Cartesian spiral sampling trajectories typical in MRF acquisition. The GCN maintains high quantification accuracy with up to 6-fold acceleration and allows 1mm isotropic resolution whole-brain 3D MRF data to be acquired in 3min and submillimeter 3D MRF (0.8mm) in 5min, greatly improving the feasibility of MRF in clinical settings.
Collapse
|
23
|
Vladimirov N, Perlman O. Molecular MRI-Based Monitoring of Cancer Immunotherapy Treatment Response. Int J Mol Sci 2023; 24:3151. [PMID: 36834563 PMCID: PMC9959624 DOI: 10.3390/ijms24043151] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2023] [Revised: 01/29/2023] [Accepted: 02/02/2023] [Indexed: 02/09/2023] Open
Abstract
Immunotherapy constitutes a paradigm shift in cancer treatment. Its FDA approval for several indications has yielded improved prognosis for cases where traditional therapy has shown limited efficiency. However, many patients still fail to benefit from this treatment modality, and the exact mechanisms responsible for tumor response are unknown. Noninvasive treatment monitoring is crucial for longitudinal tumor characterization and the early detection of non-responders. While various medical imaging techniques can provide a morphological picture of the lesion and its surrounding tissue, a molecular-oriented imaging approach holds the key to unraveling biological effects that occur much earlier in the immunotherapy timeline. Magnetic resonance imaging (MRI) is a highly versatile imaging modality, where the image contrast can be tailored to emphasize a particular biophysical property of interest using advanced engineering of the imaging pipeline. In this review, recent advances in molecular-MRI based cancer immunotherapy monitoring are described. Next, the presentation of the underlying physics, computational, and biological features are complemented by a critical analysis of the results obtained in preclinical and clinical studies. Finally, emerging artificial intelligence (AI)-based strategies to further distill, quantify, and interpret the image-based molecular MRI information are discussed in terms of perspectives for the future.
Collapse
Affiliation(s)
- Nikita Vladimirov
- Department of Biomedical Engineering, Tel Aviv University, Tel Aviv 6997801, Israel
| | - Or Perlman
- Department of Biomedical Engineering, Tel Aviv University, Tel Aviv 6997801, Israel
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv 6997801, Israel
| |
Collapse
|
24
|
Shin SH, Wendland MF, Wang J, Velasquez M, Vandsburger MH. Noninvasively differentiating acute and chronic nephropathies via multiparametric urea-CEST, nuclear Overhauser enhancement-CEST, and quantitative magnetization transfer MRI. Magn Reson Med 2023; 89:774-786. [PMID: 36226662 PMCID: PMC11027791 DOI: 10.1002/mrm.29477] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2022] [Revised: 08/26/2022] [Accepted: 09/14/2022] [Indexed: 12/13/2022]
Abstract
PURPOSE Standardized blood tests often lack adequate sensitivity and specificity to capture the gradual progression of renal injuries. We suggest a multiparametric molecular MRI approach as a noninvasive tool for monitoring renal function loss and distinguishing different types of renal injuries. METHODS CEST and quantitative magnetization transfer (qMT) imaging were performed on cisplatin (n = 16) and aristolochic acid (AA)-induced nephropathy (n = 22) mouse models at 7T with an infusion of either saline or urea. Seven-pool Lorentzian fitting was applied for the analysis of CEST Z-spectra, and the T1 -corrected CEST contrast apparent exchange-dependent relaxation (AREX) from urea (+1 ppm) and two nuclear Overhauser enhancement (NOE) pools (-1.6 and -3.5 ppm) were measured. Similarly, qMT spectra were fitted into two-pool Ramani equation and the relative semi-solid macromolecular pool-size ratio was measured. Histology of mouse kidneys was performed to validate the MR findings. RESULTS AA model showed disrupted spatial gradients of urea in the kidney and significantly decreased NOE CEST and qMT contrast. The cisplatin model showed slightly decreased qMT contrast only. The orrelation of MR parameters to histological features showed that NOE CEST and qMT imaging are sensitive to both acute and chronic injuries, whereas urea CEST shows a significant correlation only to acute injuries. CONCLUSION These results indicate that our multiparametric approach allows comprehensive and totally noninvasive monitoring of renal function and histological changes for distinguishing different nephropathies.
Collapse
Affiliation(s)
- Soo Hyun Shin
- Department of Bioengineering, University of California, Berkeley, Berkeley, CA
| | - Michael F. Wendland
- Berkeley Preclinical Imaging Core (BPIC), University of California, Berkeley, Berkeley, CA
| | - Jingshen Wang
- Department of Biostatistics, University of California, Berkeley, Berkeley, CA
| | - Mark Velasquez
- Department of Bioengineering, University of California, Berkeley, Berkeley, CA
| | | |
Collapse
|
25
|
Liu J, Li L, Zhang R, Xu ZP. The adjacent effect between Gd(III) and Cu(II) in layered double hydroxide nanoparticles synergistically enhances T1-weighted magnetic resonance imaging contrast. NANOSCALE HORIZONS 2023; 8:279-290. [PMID: 36606452 DOI: 10.1039/d2nh00478j] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
Magnetic resonance imaging (MRI) is one key technology in modern diagnostic medicine. However, the development of high-relaxivity contrast agents with favorable properties for imaging applications remains a challenging task. In this work, dual Gd(III) and Cu(II) doped-layered double hydroxide (GdCu-LDH) nanoparticles show significantly higher longitudinal relaxivity compared with sole-metal-based LDH (Gd-LDH and Cu-LDH) nanoparticles. This relaxation enhancement in GdCu-LDH is also much greater than the simple addition of the relaxivity rate of the two paramagnetic ions in Gd-LDH and Cu-LDH, presumably attributed to synergistic T1 shortening between adjacent Gd(III) and Cu(II) in the LDH host layers (adjacent effect). Moreover, our GdCu-LDH nanoparticles exhibit a pH-ultrasensitive property in MRI performance and show much clearer MR imaging for tumor tissues in mice than Gd-LDH and Cu-LDH at the equivalent doses. Thus, these novel Gd/Cu-co-doped LDH nanoparticles provide higher potential for accurate cancer diagnosis in clinic application. To the best of our knowledge, this is the first report that two paramagnetic metal ions in one nanoparticle synergistically improve the T1-MRI contrast.
Collapse
Affiliation(s)
- Jianping Liu
- Australian Institute for Bioengineering and Nanotechnology (AIBN), The University of Queensland, St Lucia, QLD 4072, Australia.
| | - Li Li
- Australian Institute for Bioengineering and Nanotechnology (AIBN), The University of Queensland, St Lucia, QLD 4072, Australia.
| | - Run Zhang
- Australian Institute for Bioengineering and Nanotechnology (AIBN), The University of Queensland, St Lucia, QLD 4072, Australia.
| | - Zhi Ping Xu
- Australian Institute for Bioengineering and Nanotechnology (AIBN), The University of Queensland, St Lucia, QLD 4072, Australia.
- Institute of Biomedical Health Technology and Engineering and Institute of Systems and Physical Biology, Shenzhen Bay Laboratory, Shenzhen, P. R. China, 518107
| |
Collapse
|
26
|
Cohen O, Yu VY, Tringale KR, Young RJ, Perlman O, Farrar CT, Otazo R. CEST MR fingerprinting (CEST-MRF) for brain tumor quantification using EPI readout and deep learning reconstruction. Magn Reson Med 2023; 89:233-249. [PMID: 36128888 PMCID: PMC9617776 DOI: 10.1002/mrm.29448] [Citation(s) in RCA: 26] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2022] [Revised: 08/09/2022] [Accepted: 08/19/2022] [Indexed: 01/21/2023]
Abstract
PURPOSE To develop a clinical CEST MR fingerprinting (CEST-MRF) method for brain tumor quantification using EPI acquisition and deep learning reconstruction. METHODS A CEST-MRF pulse sequence originally designed for animal imaging was modified to conform to hardware limits on clinical scanners while keeping scan time under 2 min. Quantitative MRF reconstruction was performed using a deep reconstruction network (DRONE) to yield the water relaxation and chemical exchange parameters. The feasibility of the six parameter DRONE reconstruction was tested in simulations using a digital brain phantom. A healthy subject was scanned with the CEST-MRF sequence, conventional MRF and CEST sequences for comparison. Reproducibility was assessed via test-retest experiments and the concordance correlation coefficient calculated for white matter and gray matter. The clinical utility of CEST-MRF was demonstrated on four patients with brain metastases in comparison to standard clinical imaging sequences. Tumors were segmented into edema, solid core, and necrotic core regions and the CEST-MRF values compared to the contra-lateral side. RESULTS DRONE reconstruction of the digital phantom yielded a normalized RMS error of ≤7% for all parameters. The CEST-MRF parameters were in good agreement with those from conventional MRF and CEST sequences and previous studies. The mean concordance correlation coefficient for all six parameters was 0.98 ± 0.01 in white matter and 0.98 ± 0.02 in gray matter. The CEST-MRF values in nearly all tumor regions were significantly different (P = 0.05) from each other and the contra-lateral side. CONCLUSION Combination of EPI readout and deep learning reconstruction enabled fast, accurate and reproducible CEST-MRF in brain tumors.
Collapse
Affiliation(s)
- Ouri Cohen
- Department of Medical PhysicsMemorial Sloan Kettering Cancer Center
New YorkNew YorkUSA
| | - Victoria Y. Yu
- Department of Medical PhysicsMemorial Sloan Kettering Cancer Center
New YorkNew YorkUSA
| | - Kathryn R. Tringale
- Department of Radiation OncologyMemorial Sloan Kettering Cancer CenterNew YorkNew YorkUSA
| | - Robert J. Young
- Department of RadiologyMemorial Sloan Kettering Cancer CenterNew YorkNew YorkUSA
| | - Or Perlman
- Athinoula A. Martinos Center for Biomedical Imaging, Department of RadiologyMassachusetts General Hospital and Harvard Medical SchoolCharlestownMassachusettsUSA
- Department of Biomedical EngineeringTel Aviv UniversityTel AvivIsrael
- Sagol School of NeuroscienceTel Aviv UniversityTel AvivIsrael
| | - Christian T. Farrar
- Athinoula A. Martinos Center for Biomedical Imaging, Department of RadiologyMassachusetts General Hospital and Harvard Medical SchoolCharlestownMassachusettsUSA
| | - Ricardo Otazo
- Department of Medical PhysicsMemorial Sloan Kettering Cancer Center
New YorkNew YorkUSA
- Department of RadiologyMemorial Sloan Kettering Cancer CenterNew YorkNew YorkUSA
| |
Collapse
|
27
|
A Deep Neural Network-Based Model for Quantitative Evaluation of the Effects of Swimming Training. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:5508365. [PMID: 36210996 PMCID: PMC9546648 DOI: 10.1155/2022/5508365] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/07/2022] [Revised: 09/06/2022] [Accepted: 09/16/2022] [Indexed: 11/17/2022]
Abstract
This paper analyzes the quantitative assessment model of the swimming training effect based on the deep neural network by constructing a deep neural network model and designing a quantitative assessment model of the swimming training effect. This paper addresses the problem of not considering the influence of the uncertainties existing in the virtual environment when evaluating swimming training and adds the power of the delays in the actual training operation environment, which is used to improve the objectivity and usability of swimming training evaluation results. To better measure the degree of influence of uncertainties, a training evaluation software module is developed to validate the usability of the simulated training evaluation method using simulated case data and compare it with the data after training evaluation using the unimproved evaluation method to verify the correctness and objectivity of the evaluation method in this paper. In the experiments, the feature extractor is a deep neural network, and the classifier is a gradient-boosting decision tree with integrated learning advantages. In the experimental comparison, we can achieve more than 60% accuracy and no more than a 1.00% decrease in recognition rate on DBPNN + GBDT, 78.5% parameter reduction, and 54.5% floating-point reduction on DPBNN. We can effectively reduce 32.1% of video memory occupation. It can be concluded from the experiments that deep neural network models are more effective and easier to obtain relatively accurate experimental results than shallow learning when facing high-dimensional sparse features. At the same time, deep neural networks can also improve the prediction results of external learning models. Therefore, the experimental results of this model are most intuitively accurate when combining deep neural networks with gradient boosting decision trees.
Collapse
|
28
|
Wu J, Kang T, Lan X, Chen X, Wu Z, Wang J, Lin L, Cai C, Lin J, Ding X, Cai S. IMPULSED model based cytological feature estimation with U-Net: Application to human brain tumor at 3T. Magn Reson Med 2022; 89:411-422. [PMID: 36063493 DOI: 10.1002/mrm.29429] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2022] [Revised: 07/06/2022] [Accepted: 08/08/2022] [Indexed: 11/06/2022]
Abstract
PURPOSE This work introduces and validates a deep-learning-based fitting method, which can rapidly provide accurate and robust estimation of cytological features of brain tumor based on the IMPULSED (imaging microstructural parameters using limited spectrally edited diffusion) model fitting with diffusion-weighted MRI data. METHODS The U-Net was applied to rapidly quantify extracellular diffusion coefficient (Dex ), cell size (d), and intracellular volume fraction (vin ) of brain tumor. At the training stage, the image-based training data, synthesized by randomizing quantifiable microstructural parameters within specific ranges, was used to train U-Net. At the test stage, the pre-trained U-Net was applied to estimate the microstructural parameters from simulated data and the in vivo data acquired on patients at 3T. The U-Net was compared with conventional non-linear least-squares (NLLS) fitting in simulations in terms of estimation accuracy and precision. RESULTS Our results confirm that the proposed method yields better fidelity in simulations and is more robust to noise than the NLLS fitting. For in vivo data, the U-Net yields obvious quality improvement in parameter maps, and the estimations of all parameters are in good agreement with the NLLS fitting. Moreover, our method is several orders of magnitude faster than the NLLS fitting (from about 5 min to <1 s). CONCLUSION The image-based training scheme proposed herein helps to improve the quality of the estimated parameters. Our deep-learning-based fitting method can estimate the cell microstructural parameters fast and accurately.
Collapse
Affiliation(s)
- Jian Wu
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, Xiamen University, Xiamen, China
| | - Taishan Kang
- Department of Radiology, Zhongshan Hospital of Xiamen University, School of Medicine, Xiamen University, Xiamen, China
| | - Xinli Lan
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, Xiamen University, Xiamen, China
| | - Xinran Chen
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, Xiamen University, Xiamen, China
| | - Zhigang Wu
- MSC Clinical & Technical Solutions, Philips Healthcare, Beijing, China
| | - Jiazheng Wang
- MSC Clinical & Technical Solutions, Philips Healthcare, Beijing, China
| | - Liangjie Lin
- MSC Clinical & Technical Solutions, Philips Healthcare, Beijing, China
| | - Congbo Cai
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, Xiamen University, Xiamen, China
| | - Jianzhong Lin
- Department of Radiology, Zhongshan Hospital of Xiamen University, School of Medicine, Xiamen University, Xiamen, China
| | - Xin Ding
- Department of Pathology, Zhongshan Hospital of Xiamen University, School of Medicine, Xiamen University, Xiamen, China
| | - Shuhui Cai
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, Xiamen University, Xiamen, China
| |
Collapse
|
29
|
Biochemical and Structural Imaging of Remodeled Myocardium. CURRENT OPINION IN PHYSIOLOGY 2022. [DOI: 10.1016/j.cophys.2022.100570] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
30
|
Perlman O, Zhu B, Zaiss M, Rosen MS, Farrar CT. An end-to-end AI-based framework for automated discovery of rapid CEST/MT MRI acquisition protocols and molecular parameter quantification (AutoCEST). Magn Reson Med 2022. [PMID: 35092076 DOI: 10.6084/m9.figshare.14877765] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/14/2023]
Abstract
PURPOSE To develop an automated machine-learning-based method for the discovery of rapid and quantitative chemical exchange saturation transfer (CEST) MR fingerprinting acquisition and reconstruction protocols. METHODS An MR physics-governed AI system was trained to generate optimized acquisition schedules and the corresponding quantitative reconstruction neural network. The system (termed AutoCEST) is composed of a CEST saturation block, a spin dynamics module, and a deep reconstruction network, all differentiable and jointly connected. The method was validated using a variety of chemical exchange phantoms and in vivo mouse brains at 9.4T. RESULTS The acquisition times for AutoCEST optimized schedules ranged from 35 to 71 s, with a quantitative image reconstruction time of only 29 ms. The resulting exchangeable proton concentration maps for the phantoms were in good agreement with the known solute concentrations for AutoCEST sequences (mean absolute error = 2.42 mM; Pearson's r=0.992 , p<0.0001 ), but not for an unoptimized sequence (mean absolute error = 65.19 mM; Pearson's r=-0.161 , p=0.522 ). Similarly, improved exchange rate agreement was observed between AutoCEST and quantification of exchange using saturation power (QUESP) methods (mean absolute error: 35.8 Hz, Pearson's r=0.971 , p<0.0001 ) compared to an unoptimized schedule and QUESP (mean absolute error = 58.2 Hz; Pearson's r=0.959 , p<0.0001 ). The AutoCEST in vivo mouse brain semi-solid proton volume fractions were lower in the cortex (12.77% ± 0.75%) compared to the white matter (19.80% ± 0.50%), as expected. CONCLUSION AutoCEST can automatically generate optimized CEST/MT acquisition protocols that can be rapidly reconstructed into quantitative exchange parameter maps.
Collapse
Affiliation(s)
- Or Perlman
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA, USA
| | - Bo Zhu
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA, USA
| | - Moritz Zaiss
- Magnetic Resonance Center, Max Planck Institute For Biological Cybernetics, Tübingen, Germany
- Department of Neuroradiology, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Matthew S Rosen
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA, USA
- Department of Physics, Harvard University, Cambridge, MA, USA
| | - Christian T Farrar
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Charlestown, MA, USA
| |
Collapse
|
31
|
Perlman O, Zhu B, Zaiss M, Rosen MS, Farrar CT. An end-to-end AI-based framework for automated discovery of rapid CEST/MT MRI acquisition protocols and molecular parameter quantification (AutoCEST). Magn Reson Med 2022; 87:2792-2810. [PMID: 35092076 PMCID: PMC9305180 DOI: 10.1002/mrm.29173] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2021] [Revised: 01/04/2022] [Accepted: 01/07/2022] [Indexed: 12/28/2022]
Abstract
PURPOSE To develop an automated machine-learning-based method for the discovery of rapid and quantitative chemical exchange saturation transfer (CEST) MR fingerprinting acquisition and reconstruction protocols. METHODS An MR physics-governed AI system was trained to generate optimized acquisition schedules and the corresponding quantitative reconstruction neural network. The system (termed AutoCEST) is composed of a CEST saturation block, a spin dynamics module, and a deep reconstruction network, all differentiable and jointly connected. The method was validated using a variety of chemical exchange phantoms and in vivo mouse brains at 9.4T. RESULTS The acquisition times for AutoCEST optimized schedules ranged from 35 to 71 s, with a quantitative image reconstruction time of only 29 ms. The resulting exchangeable proton concentration maps for the phantoms were in good agreement with the known solute concentrations for AutoCEST sequences (mean absolute error = 2.42 mM; Pearson's r = 0.992 , p < 0.0001 ), but not for an unoptimized sequence (mean absolute error = 65.19 mM; Pearson's r = - 0.161 , p = 0.522 ). Similarly, improved exchange rate agreement was observed between AutoCEST and quantification of exchange using saturation power (QUESP) methods (mean absolute error: 35.8 Hz, Pearson's r = 0.971 , p < 0.0001 ) compared to an unoptimized schedule and QUESP (mean absolute error = 58.2 Hz; Pearson's r = 0.959 , p < 0.0001 ). The AutoCEST in vivo mouse brain semi-solid proton volume fractions were lower in the cortex (12.77% ± 0.75%) compared to the white matter (19.80% ± 0.50%), as expected. CONCLUSION AutoCEST can automatically generate optimized CEST/MT acquisition protocols that can be rapidly reconstructed into quantitative exchange parameter maps.
Collapse
Affiliation(s)
- Or Perlman
- Athinoula A. Martinos Center for Biomedical Imaging, Department of RadiologyMassachusetts General Hospital and Harvard Medical SchoolCharlestownMAUSA
| | - Bo Zhu
- Athinoula A. Martinos Center for Biomedical Imaging, Department of RadiologyMassachusetts General Hospital and Harvard Medical SchoolCharlestownMAUSA
| | - Moritz Zaiss
- Magnetic Resonance CenterMax Planck Institute For Biological CyberneticsTübingenGermany
- Department of NeuroradiologyUniversity Hospital ErlangenFriedrich‐Alexander‐Universität Erlangen‐Nürnberg (FAU)ErlangenGermany
| | - Matthew S. Rosen
- Athinoula A. Martinos Center for Biomedical Imaging, Department of RadiologyMassachusetts General Hospital and Harvard Medical SchoolCharlestownMAUSA
- Department of PhysicsHarvard UniversityCambridgeMAUSA
| | - Christian T. Farrar
- Athinoula A. Martinos Center for Biomedical Imaging, Department of RadiologyMassachusetts General Hospital and Harvard Medical SchoolCharlestownMAUSA
| |
Collapse
|
32
|
Huang J, Chen Z, Park SW, Lai JHC, Chan KWY. Molecular Imaging of Brain Tumors and Drug Delivery Using CEST MRI: Promises and Challenges. Pharmaceutics 2022; 14:451. [PMID: 35214183 PMCID: PMC8880023 DOI: 10.3390/pharmaceutics14020451] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2022] [Revised: 02/16/2022] [Accepted: 02/17/2022] [Indexed: 12/10/2022] Open
Abstract
Chemical exchange saturation transfer (CEST) magnetic resonance imaging (MRI) detects molecules in their natural forms in a sensitive and non-invasive manner. This makes it a robust approach to assess brain tumors and related molecular alterations using endogenous molecules, such as proteins/peptides, and drugs approved for clinical use. In this review, we will discuss the promises of CEST MRI in the identification of tumors, tumor grading, detecting molecular alterations related to isocitrate dehydrogenase (IDH) and O-6-methylguanine-DNA methyltransferase (MGMT), assessment of treatment effects, and using multiple contrasts of CEST to develop theranostic approaches for cancer treatments. Promising applications include (i) using the CEST contrast of amide protons of proteins/peptides to detect brain tumors, such as glioblastoma multiforme (GBM) and low-grade gliomas; (ii) using multiple CEST contrasts for tumor stratification, and (iii) evaluation of the efficacy of drug delivery without the need of metallic or radioactive labels. These promising applications have raised enthusiasm, however, the use of CEST MRI is not trivial. CEST contrast depends on the pulse sequences, saturation parameters, methods used to analyze the CEST spectrum (i.e., Z-spectrum), and, importantly, how to interpret changes in CEST contrast and related molecular alterations in the brain. Emerging pulse sequence designs and data analysis approaches, including those assisted with deep learning, have enhanced the capability of CEST MRI in detecting molecules in brain tumors. CEST has become a specific marker for tumor grading and has the potential for prognosis and theranostics in brain tumors. With increasing understanding of the technical aspects and associated molecular alterations detected by CEST MRI, this young field is expected to have wide clinical applications in the near future.
Collapse
Affiliation(s)
- Jianpan Huang
- Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China; (J.H.); (Z.C.); (S.-W.P.); (J.H.C.L.)
| | - Zilin Chen
- Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China; (J.H.); (Z.C.); (S.-W.P.); (J.H.C.L.)
| | - Se-Weon Park
- Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China; (J.H.); (Z.C.); (S.-W.P.); (J.H.C.L.)
- Hong Kong Centre for Cerebro-Cardiovascular Health Engineering (COCHE), Hong Kong, China
| | - Joseph H. C. Lai
- Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China; (J.H.); (Z.C.); (S.-W.P.); (J.H.C.L.)
| | - Kannie W. Y. Chan
- Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China; (J.H.); (Z.C.); (S.-W.P.); (J.H.C.L.)
- Hong Kong Centre for Cerebro-Cardiovascular Health Engineering (COCHE), Hong Kong, China
- Russell H. Morgan Department of Radiology and Radiological Science, The Johns Hopkins University School of Medicine, Baltimore, MD 21205, USA
- Shenzhen Research Institute, City University of Hong Kong, Shenzhen 518057, China
- Tung Biomedical Science Centre, City University of Hong Kong, Hong Kong, China
| |
Collapse
|