1
|
Huang HM. Calculation of intravoxel incoherent motion parameter maps using a kernelized total difference-based method. NMR IN BIOMEDICINE 2024:e5201. [PMID: 38863271 DOI: 10.1002/nbm.5201] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Revised: 05/13/2024] [Accepted: 05/23/2024] [Indexed: 06/13/2024]
Abstract
Quantitative analysis of diffusion-weighted magnetic resonance imaging (DW-MRI) has been explored for many clinical applications since its development. In particular, the intravoxel incoherent motion (IVIM) model for DW-MRI has been commonly utilized in various organs. However, because of the presence of excessive noise, the IVIM parameter maps obtained from pixel-wise fitting are often unreliable. In this study, we propose a kernelized total difference-based curve-fitting method to estimate the IVIM parameters. Simulated DW-MRI data at five signal-to-noise ratios (i.e., 10, 20, 30, 50, and 100) and real abdominal DW-MRI data acquired on a 1.5-T MRI scanner with nine b-values (i.e., 0, 10, 25, 50, 100, 200, 300, 400, and 500 s/mm2) and six diffusion-encoding gradient directions were used to evaluate the performance of the proposed method. The results were compared with those obtained by three existing methods: trust-region reflective (TRR) algorithm, Bayesian probability (BP), and deep neural network (DNN). Our simulation results showed that the proposed method outperformed the other three comparing methods in terms of root-mean-square error. Moreover, the proposed method could preserve small details in the estimated IVIM parameter maps. The experimental results showed that, compared with the TRR method, the proposed method as well as the BP (and DNN) method could reduce the overestimation of the pseudodiffusion coefficient and improve the quality of IVIM parameter maps. For all studied abdominal organs except the pancreas, both the proposed method and the BP method could provide IVIM parameter estimates close to the reference values; the former had higher precision. The kernelized total difference-based curve-fitting method has the potential to improve the reliability of IVIM parametric imaging.
Collapse
Affiliation(s)
- Hsuan-Ming Huang
- Institute of Medical Device and Imaging, College of Medicine, National Taiwan University, Taipei City, Taiwan
- Program for Precision Health and Intelligent Medicine, Graduate School of Advanced Technology, National Taiwan University, Taipei City, Taiwan
| |
Collapse
|
2
|
Yoon D, Lutz AM. Diffusion Tensor Imaging of Peripheral Nerves: Current Status and New Developments. Semin Musculoskelet Radiol 2023; 27:641-648. [PMID: 37935210 DOI: 10.1055/s-0043-1775742] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2023]
Abstract
Diffusion tensor imaging (DTI) is an emerging technique for peripheral nerve imaging that can provide information about the microstructural organization and connectivity of these nerves and complement the information gained from anatomical magnetic resonance imaging (MRI) sequences. With DTI it is possible to reconstruct nerve pathways and visualize the three-dimensional trajectory of nerve fibers, as in nerve tractography. More importantly, DTI allows for quantitative evaluation of peripheral nerves by the calculation of several important parameters that offer insight into the functional status of a nerve. Thus DTI has a high potential to add value to the work-up of peripheral nerve pathologies, although it is more technically demanding. Peripheral nerves pose specific challenges to DTI due to their small diameter and DTI's spatial resolution, contrast, location, and inherent field inhomogeneities when imaging certain anatomical locations. Numerous efforts are underway to resolve these technical challenges and thus enable wider acceptance of DTI in peripheral nerve MRI.
Collapse
Affiliation(s)
- Daehyun Yoon
- Department of Radiology and Biomedical Imaging, School of Medicine, University of California at San Francisco, San Francisco, California
| | - Amelie M Lutz
- Department of Radiology, Kantonal Hospital Thurgau, Muensterlingen, Switzerland
| |
Collapse
|
3
|
Yuan N, Wang L, Ye C, Deng Z, Zhang J, Zhu Y. Self-supervised structural similarity-based convolutional neural network for cardiac diffusion tensor image denoising. Med Phys 2023; 50:6137-6150. [PMID: 36775901 DOI: 10.1002/mp.16301] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2022] [Revised: 12/12/2022] [Accepted: 01/03/2023] [Indexed: 02/14/2023] Open
Abstract
BACKGROUND Diffusion tensor imaging (DTI) is a promising technique for non-invasively investigating the myocardial fiber structures of human heart. However, low signal-to-noise ratio (SNR) has been a major limit of cardiac DTI to prevent us from detecting myocardium structure accurately. Therefore, it is important to remove the effect of noise on diffusion weighted (DW) images. PURPOSE Although the conventional and deep learning-based denoising methods have shown the potential to deal with effectively the noise in DW images, most of them are redundant information dependent or require the noise-free images as golden standard. In addition, the existed DW image denoising methods often suffer from problems of over-smoothing. To address these issues, we propose a self-supervised learning model, structural similarity based convolutional neural network with edge-weighted loss (SSECNN), to remove the noise effectively in cardiac DTI. METHODS Considering that the DW images acquired along different diffusion directions have structural similarity, and the noise in these DW images is independent and identically distributed, the structural similarity-based matching algorithm is proposed to search for the most similar DW images. Such similar noisy DW image pairs are then used as the input and target of the denoising network SSECNN, which consists of several convolutional and residual blocks. Through the self-supervised training with these image pairs, the network can restore the clean DW images and retain the correlations between the denoised DW images along different directions. To avoid the over-smoothing problem, we design a novel edge-weighted loss which enables the network to adaptively adjust the loss weights with iterations and therefore to improve the detail preserve ability of the model. To verify the superiority of the proposed method, comparisons with state-of-the-art (SOTA) denoising methods are performed on both synthetic and real acquired DTI datasets. RESULTS Experimental results show that SSECNN can effectively reduce the noise in the DW images while preserving detailed texture and edge information and therefore achieve better performance in DTI reconstruction. For synthetic dataset, compared to the SOTA method, the root mean square error (RMSE), peak signal-to-noise ratio (PSNR), and structure similarity index measure (SSIM) between the denoised DW images obtained with SSECNN and noise-free DW images are improved by 6.94%, 1.98%, and 0.76% respectively when the noise level is 10%. As for the acquired cardiac DTI dataset, the SSECNN method could significantly improve SNR and contrast to noise ratio (CNR) of cardiac DW images and achieve more regular helix angle (HA) and transverse angle (TA) maps. The ablation experimental results validate that using the structure similarity-based method to search the similar DW image pairs yield the smallest loss, and with the help of the edge-weighted loss, the denoised DW images and diffusion metric maps can preserve more details. CONCLUSIONS The proposed SSECNN method can fully explore the similarity between the DW images along different diffusion directions. Using such similarity and an edge-weighted loss enable us to denoise cardiac DTI effectively in a self-supervised manner. Our method can overcome the redundancy information dependence and over-smoothing problem of the SOTA methods.
Collapse
Affiliation(s)
- Nannan Yuan
- Key Laboratory of Intelligent Medical Image Analysis and Precise Diagnosis of Guizhou Province, State Key Laboratory of Public Big Data, College of Computer Science and Technology, Guizhou University, Guiyang, China
| | - Lihui Wang
- Key Laboratory of Intelligent Medical Image Analysis and Precise Diagnosis of Guizhou Province, State Key Laboratory of Public Big Data, College of Computer Science and Technology, Guizhou University, Guiyang, China
| | - Chen Ye
- Key Laboratory of Intelligent Medical Image Analysis and Precise Diagnosis of Guizhou Province, State Key Laboratory of Public Big Data, College of Computer Science and Technology, Guizhou University, Guiyang, China
| | - Zeyu Deng
- Key Laboratory of Intelligent Medical Image Analysis and Precise Diagnosis of Guizhou Province, State Key Laboratory of Public Big Data, College of Computer Science and Technology, Guizhou University, Guiyang, China
| | - Jian Zhang
- Key Laboratory of Intelligent Medical Image Analysis and Precise Diagnosis of Guizhou Province, State Key Laboratory of Public Big Data, College of Computer Science and Technology, Guizhou University, Guiyang, China
| | - Yuemin Zhu
- Univ Lyon, INSA Lyon, CNRS, Inserm, CREATIS UMR 5220, U1206, Lyon, France
| |
Collapse
|
4
|
Saleh M, Virarkar M, Javadi S, Mathew M, Vulasala SSR, Son JB, Sun J, Bayram E, Wang X, Ma J, Szklaruk J, Bhosale P. A Feasibility Study on Deep Learning Reconstruction to Improve Image Quality With PROPELLER Acquisition in the Setting of T2-Weighted Gynecologic Pelvic Magnetic Resonance Imaging. J Comput Assist Tomogr 2023; 47:721-728. [PMID: 37707401 DOI: 10.1097/rct.0000000000001491] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
OBJECTIVES Evaluate deep learning (DL) to improve the image quality of the PROPELLER (Periodically Rotated Overlapping Parallel Lines with Enhanced Reconstruction technique) for 3 T magnetic resonance imaging of the female pelvis. METHODS Three radiologists prospectively and independently compared non-DL and DL PROPELLER sequences from 20 patients with a history of gynecologic malignancy. Sequences with different noise reduction factors (DL 25%, DL 50%, and DL 75%) were blindly reviewed and scored based on artifacts, noise, relative sharpness, and overall image quality. The generalized estimating equation method was used to assess the effect of methods on the Likert scales. Quantitatively, the contrast-to-noise ratio and signal-to-noise ratio (SNR) of the iliac muscle were calculated, and pairwise comparisons were performed based on a linear mixed model. P values were adjusted using the Dunnett method. Interobserver agreement was assessed using the κ statistic. P value was considered statistically significant at less than 0.05. RESULTS Qualitatively, DL 50 and DL 75 were ranked as the best sequences in 86% of cases. Images generated by the DL method were significantly better than non-DL images ( P < 0.0001). Iliacus muscle SNR on DL 50 and DL 75 was significantly better than non-DL images ( P < 0.0001). There was no difference in contrast-to-noise ratio between the DL and non-DL techniques in the iliac muscle. There was a high percent agreement (97.1%) in terms of DL sequences' superior image quality (97.1%) and sharpness (100%) relative to non-DL images. CONCLUSION The utilization of DL reconstruction improves the image quality of PROPELLER sequences with improved SNR quantitatively.
Collapse
Affiliation(s)
- Mohammed Saleh
- From the Department of Internal Medicine, University of Texas health Science Center at Houston, Houston, TX
| | - Mayur Virarkar
- Department of Diagnostic Radiology, University of Florida College of Medicine, Jacksonville, FL
| | - Sanaz Javadi
- Department of Abdominal Imaging, University of Texas MD Anderson Cancer Center, Houston, TX
| | - Manoj Mathew
- Department of Radiology, Stanford University, Stanford, CA
| | | | | | - Jia Sun
- Biostatistics, University of Texas MD Anderson Cancer Center
| | - Ersin Bayram
- Global MR Applications and Workflow, GE Healthcare, Houston, TX
| | - Xinzeng Wang
- Global MR Applications and Workflow, GE Healthcare, Houston, TX
| | | | - Janio Szklaruk
- Department of Diagnostic Radiology, University of Florida College of Medicine, Jacksonville, FL
| | - Priya Bhosale
- Department of Diagnostic Radiology, University of Florida College of Medicine, Jacksonville, FL
| |
Collapse
|
5
|
Wang J, Geng W, Wu J, Kang T, Wu Z, Lin J, Yang Y, Cai C, Cai S. Intravoxel incoherent motion magnetic resonance imaging reconstruction from highly under-sampled diffusion-weighted PROPELLER acquisition data via physics-informed residual feedback unrolled network. Phys Med Biol 2023; 68:175022. [PMID: 37541226 DOI: 10.1088/1361-6560/aced77] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2023] [Accepted: 08/04/2023] [Indexed: 08/06/2023]
Abstract
Objective. The acquisition of diffusion-weighted images for intravoxel incoherent motion (IVIM) imaging is time consuming. This work aims to accelerate the scan through a highly under-sampling diffusion-weighted turbo spin echo PROPELLER (DW-TSE-PROPELLER) scheme and to develop a reconstruction method for accurate IVIM parameter mapping from the under-sampled data.Approach.The proposed under-sampling DW-TSE-PROPELLER scheme for IVIM imaging is that a few blades perb-value are acquired and rotated along theb-value dimension to cover high-frequency information. A physics-informed residual feedback unrolled network (PIRFU-Net) is proposed to directly estimate distortion-free and artifact-free IVIM parametric maps (i.e., the perfusion-free diffusion coefficientDand the perfusion fractionf) from highly under-sampled DW-TSE-PROPELLER data. PIRFU-Net used an unrolled convolution network to explore data redundancy in the k-q space to remove under-sampling artifacts. An empirical IVIM physical constraint was incorporated into the network to ensure that the signal evolution curves along theb-value follow a bi-exponential decay. The residual between the realistic and estimated measurements was fed into the network to refine the parametric maps. Meanwhile, the use of synthetic training data eliminated the need for genuine DW-TSE-PROPELLER data.Main results.The experimental results show that the DW-TSE-PROPELLER acquisition was six times faster than full k-space coverage PROPELLER acquisition and within a clinically acceptable time. Compared with the state-of-the-art methods, the distortion-freeDandfmaps estimated by PIRFU-Net were more accurate and had better-preserved tissue boundaries on a simulated human brain and realistic phantom/rat brain/human brain data.Significance.Our proposed method greatly accelerates IVIM imaging. It is capable of directly and simultaneously reconstructing distortion-free, artifact-free, and accurateDandfmaps from six-fold under-sampled DW-TSE-PROPELLER data.
Collapse
Affiliation(s)
- Jiechao Wang
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, Xiamen University, Xiamen, 361005, People's Republic of China
| | - Wenhua Geng
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, Xiamen University, Xiamen, 361005, People's Republic of China
| | - Jian Wu
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, Xiamen University, Xiamen, 361005, People's Republic of China
| | - Taishan Kang
- Department of Radiology, Zhongshan Hospital of Xiamen University, School of Medicine, Xiamen University, Xiamen, 361004, People's Republic of China
| | - Zhigang Wu
- Clinical & Technical Solutions, Philips Healthcare, Shenzhen, 518000, People's Republic of China
| | - Jianzhong Lin
- Department of Radiology, Zhongshan Hospital of Xiamen University, School of Medicine, Xiamen University, Xiamen, 361004, People's Republic of China
| | - Yu Yang
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, Xiamen University, Xiamen, 361005, People's Republic of China
| | - Congbo Cai
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, Xiamen University, Xiamen, 361005, People's Republic of China
| | - Shuhui Cai
- Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, Xiamen University, Xiamen, 361005, People's Republic of China
| |
Collapse
|
6
|
Hamilton JI, Truesdell W, Galizia M, Burris N, Agarwal P, Seiberlich N. A low-rank deep image prior reconstruction for free-breathing ungated spiral functional CMR at 0.55 T and 1.5 T. MAGMA (NEW YORK, N.Y.) 2023; 36:451-464. [PMID: 37043121 PMCID: PMC11017470 DOI: 10.1007/s10334-023-01088-w] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/29/2022] [Revised: 03/02/2023] [Accepted: 04/01/2023] [Indexed: 04/13/2023]
Abstract
OBJECTIVE This study combines a deep image prior with low-rank subspace modeling to enable real-time (free-breathing and ungated) functional cardiac imaging on a commercial 0.55 T scanner. MATERIALS AND METHODS The proposed low-rank deep image prior (LR-DIP) uses two u-nets to generate spatial and temporal basis functions that are combined to yield dynamic images, with no need for additional training data. Simulations and scans in 13 healthy subjects were performed at 0.55 T and 1.5 T using a golden angle spiral bSSFP sequence with images reconstructed using [Formula: see text]-ESPIRiT, low-rank plus sparse (L + S) matrix completion, and LR-DIP. Cartesian breath-held ECG-gated cine images were acquired for reference at 1.5 T. Two cardiothoracic radiologists rated images on a 1-5 scale for various categories, and LV function measurements were compared. RESULTS LR-DIP yielded the lowest errors in simulations, especially at high acceleration factors (R [Formula: see text] 8). LR-DIP ejection fraction measurements agreed with 1.5 T reference values (mean bias - 0.3% at 0.55 T and - 0.2% at 1.5 T). Compared to reference images, LR-DIP images received similar ratings at 1.5 T (all categories above 3.9) and slightly lower at 0.55 T (above 3.4). CONCLUSION Feasibility of real-time functional cardiac imaging using a low-rank deep image prior reconstruction was demonstrated in healthy subjects on a commercial 0.55 T scanner.
Collapse
Affiliation(s)
- Jesse I Hamilton
- Department of Radiology, University of Michigan, 1301 Catherine St, Ann Arbor, MI, 48109-1590, USA.
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, USA.
| | - William Truesdell
- Department of Radiology, University of Michigan, 1301 Catherine St, Ann Arbor, MI, 48109-1590, USA
| | - Mauricio Galizia
- Department of Radiology, University of Michigan, 1301 Catherine St, Ann Arbor, MI, 48109-1590, USA
| | - Nicholas Burris
- Department of Radiology, University of Michigan, 1301 Catherine St, Ann Arbor, MI, 48109-1590, USA
| | - Prachi Agarwal
- Department of Radiology, University of Michigan, 1301 Catherine St, Ann Arbor, MI, 48109-1590, USA
| | - Nicole Seiberlich
- Department of Radiology, University of Michigan, 1301 Catherine St, Ann Arbor, MI, 48109-1590, USA
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, USA
| |
Collapse
|
7
|
Chen Z, Pawar K, Ekanayake M, Pain C, Zhong S, Egan GF. Deep Learning for Image Enhancement and Correction in Magnetic Resonance Imaging-State-of-the-Art and Challenges. J Digit Imaging 2023; 36:204-230. [PMID: 36323914 PMCID: PMC9984670 DOI: 10.1007/s10278-022-00721-9] [Citation(s) in RCA: 18] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2022] [Revised: 09/09/2022] [Accepted: 10/17/2022] [Indexed: 11/06/2022] Open
Abstract
Magnetic resonance imaging (MRI) provides excellent soft-tissue contrast for clinical diagnoses and research which underpin many recent breakthroughs in medicine and biology. The post-processing of reconstructed MR images is often automated for incorporation into MRI scanners by the manufacturers and increasingly plays a critical role in the final image quality for clinical reporting and interpretation. For image enhancement and correction, the post-processing steps include noise reduction, image artefact correction, and image resolution improvements. With the recent success of deep learning in many research fields, there is great potential to apply deep learning for MR image enhancement, and recent publications have demonstrated promising results. Motivated by the rapidly growing literature in this area, in this review paper, we provide a comprehensive overview of deep learning-based methods for post-processing MR images to enhance image quality and correct image artefacts. We aim to provide researchers in MRI or other research fields, including computer vision and image processing, a literature survey of deep learning approaches for MR image enhancement. We discuss the current limitations of the application of artificial intelligence in MRI and highlight possible directions for future developments. In the era of deep learning, we highlight the importance of a critical appraisal of the explanatory information provided and the generalizability of deep learning algorithms in medical imaging.
Collapse
Affiliation(s)
- Zhaolin Chen
- Monash Biomedical Imaging, Monash University, Melbourne, VIC, 3168, Australia.
- Department of Data Science and AI, Monash University, Melbourne, VIC, Australia.
| | - Kamlesh Pawar
- Monash Biomedical Imaging, Monash University, Melbourne, VIC, 3168, Australia
| | - Mevan Ekanayake
- Monash Biomedical Imaging, Monash University, Melbourne, VIC, 3168, Australia
- Department of Electrical and Computer Systems Engineering, Monash University, Melbourne, VIC, Australia
| | - Cameron Pain
- Monash Biomedical Imaging, Monash University, Melbourne, VIC, 3168, Australia
- Department of Electrical and Computer Systems Engineering, Monash University, Melbourne, VIC, Australia
| | - Shenjun Zhong
- Monash Biomedical Imaging, Monash University, Melbourne, VIC, 3168, Australia
- National Imaging Facility, Brisbane, QLD, Australia
| | - Gary F Egan
- Monash Biomedical Imaging, Monash University, Melbourne, VIC, 3168, Australia
- Turner Institute for Brain and Mental Health, Monash University, Melbourne, VIC, Australia
| |
Collapse
|
8
|
Cheng H, Vinci-Booher S, Wang J, Caron B, Wen Q, Newman S, Pestilli F. Denoising diffusion weighted imaging data using convolutional neural networks. PLoS One 2022; 17:e0274396. [PMID: 36108272 PMCID: PMC9477507 DOI: 10.1371/journal.pone.0274396] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2022] [Accepted: 08/26/2022] [Indexed: 11/17/2022] Open
Abstract
Diffusion weighted imaging (DWI) with multiple, high b-values is critical for extracting tissue microstructure measurements; however, high b-value DWI images contain high noise levels that can overwhelm the signal of interest and bias microstructural measurements. Here, we propose a simple denoising method that can be applied to any dataset, provided a low-noise, single-subject dataset is acquired using the same DWI sequence. The denoising method uses a one-dimensional convolutional neural network (1D-CNN) and deep learning to learn from a low-noise dataset, voxel-by-voxel. The trained model can then be applied to high-noise datasets from other subjects. We validated the 1D-CNN denoising method by first demonstrating that 1D-CNN denoising resulted in DWI images that were more similar to the noise-free ground truth than comparable denoising methods, e.g., MP-PCA, using simulated DWI data. Using the same DWI acquisition but reconstructed with two common reconstruction methods, i.e. SENSE1 and sum-of-square, to generate a pair of low-noise and high-noise datasets, we then demonstrated that 1D-CNN denoising of high-noise DWI data collected from human subjects showed promising results in three domains: DWI images, diffusion metrics, and tractography. In particular, the denoised images were very similar to a low-noise reference image of that subject, more than the similarity between repeated low-noise images (i.e. computational reproducibility). Finally, we demonstrated the use of the 1D-CNN method in two practical examples to reduce noise from parallel imaging and simultaneous multi-slice acquisition. We conclude that the 1D-CNN denoising method is a simple, effective denoising method for DWI images that overcomes some of the limitations of current state-of-the-art denoising methods, such as the need for a large number of training subjects and the need to account for the rectified noise floor.
Collapse
Affiliation(s)
- Hu Cheng
- Department of Psychological and Brain Sciences, Indiana University, Bloomington, IN, United States of America
- Program of Neuroscience, Indiana University, Bloomington, IN, United States of America
| | - Sophia Vinci-Booher
- Department of Psychological and Brain Sciences, Indiana University, Bloomington, IN, United States of America
- Department of Psychology and Human Development, Vanderbilt University, Nashville, TN, United States of America
| | - Jian Wang
- School of Information Science and Engineering, Shandong Normal University, Jinan, China
| | - Bradley Caron
- Department of Psychology, Center for Perceptual Systems and Center for Theoretical and Computational Neuroscience, The University of Texas at Austin, Austin, TX, United States of America
| | - Qiuting Wen
- Department of Radiology and Imaging Sciences, Indiana University School of Medicine, Indianapolis, IN, United States of America
| | - Sharlene Newman
- Alabama Life Research Institute, The University of Alabama, Tuscaloosa, AL, United States of America
| | - Franco Pestilli
- Department of Psychology, Center for Perceptual Systems and Center for Theoretical and Computational Neuroscience, The University of Texas at Austin, Austin, TX, United States of America
| |
Collapse
|
9
|
Hamilton JI. A Self-Supervised Deep Learning Reconstruction for Shortening the Breathhold and Acquisition Window in Cardiac Magnetic Resonance Fingerprinting. Front Cardiovasc Med 2022; 9:928546. [PMID: 35811730 PMCID: PMC9260051 DOI: 10.3389/fcvm.2022.928546] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2022] [Accepted: 06/06/2022] [Indexed: 01/14/2023] Open
Abstract
The aim of this study is to shorten the breathhold and diastolic acquisition window in cardiac magnetic resonance fingerprinting (MRF) for simultaneous T1, T2, and proton spin density (M0) mapping to improve scan efficiency and reduce motion artifacts. To this end, a novel reconstruction was developed that combines low-rank subspace modeling with a deep image prior, termed DIP-MRF. A system of neural networks is used to generate spatial basis images and quantitative tissue property maps, with training performed using only the undersampled k-space measurements from the current scan. This approach avoids difficulties with obtaining in vivo MRF training data, as training is performed de novo for each acquisition. Calculation of the forward model during training is accelerated by using GRAPPA operator gridding to shift spiral k-space data to Cartesian grid points, and by using a neural network to rapidly generate fingerprints in place of a Bloch equation simulation. DIP-MRF was evaluated in simulations and at 1.5 T in a standardized phantom, 18 healthy subjects, and 10 patients with suspected cardiomyopathy. In addition to conventional mapping, two cardiac MRF sequences were acquired, one with a 15-heartbeat(HB) breathhold and 254 ms acquisition window, and one with a 5HB breathhold and 150 ms acquisition window. In simulations, DIP-MRF yielded decreased nRMSE compared to dictionary matching and a sparse and locally low rank (SLLR-MRF) reconstruction. Strong correlation (R2 > 0.999) with T1 and T2 reference values was observed in the phantom using the 5HB/150 ms scan with DIP-MRF. DIP-MRF provided better suppression of noise and aliasing artifacts in vivo, especially for the 5HB/150 ms scan, and lower intersubject and intrasubject variability compared to dictionary matching and SLLR-MRF. Furthermore, it yielded a better agreement between myocardial T1 and T2 from 15HB/254 ms and 5HB/150 ms MRF scans, with a bias of −9 ms for T1 and 2 ms for T2. In summary, this study introduces an extension of the deep image prior framework for cardiac MRF tissue property mapping, which does not require pre-training with in vivo scans, and has the potential to reduce motion artifacts by enabling a shortened breathhold and acquisition window.
Collapse
Affiliation(s)
- Jesse I. Hamilton
- Department of Radiology, University of Michigan, Ann Arbor, MI, United States
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, United States
- *Correspondence: Jesse I. Hamilton,
| |
Collapse
|
10
|
Onishi Y, Hashimoto F, Ote K, Ohba H, Ota R, Yoshikawa E, Ouchi Y. Anatomical-guided attention enhances unsupervised PET image denoising performance. Med Image Anal 2021; 74:102226. [PMID: 34563861 DOI: 10.1016/j.media.2021.102226] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2021] [Revised: 08/02/2021] [Accepted: 09/05/2021] [Indexed: 10/20/2022]
Abstract
Although supervised convolutional neural networks (CNNs) often outperform conventional alternatives for denoising positron emission tomography (PET) images, they require many low- and high-quality reference PET image pairs. Herein, we propose an unsupervised 3D PET image denoising method based on an anatomical information-guided attention mechanism. The proposed magnetic resonance-guided deep decoder (MR-GDD) utilizes the spatial details and semantic features of MR-guidance image more effectively by introducing encoder-decoder and deep decoder subnetworks. Moreover, the specific shapes and patterns of the guidance image do not affect the denoised PET image, because the guidance image is input to the network through an attention gate. In a Monte Carlo simulation of [18F]fluoro-2-deoxy-D-glucose (FDG), the proposed method achieved the highest peak signal-to-noise ratio and structural similarity (27.92 ± 0.44 dB/0.886 ± 0.007), as compared with Gaussian filtering (26.68 ± 0.10 dB/0.807 ± 0.004), image guided filtering (27.40 ± 0.11 dB/0.849 ± 0.003), deep image prior (DIP) (24.22 ± 0.43 dB/0.737 ± 0.017), and MR-DIP (27.65 ± 0.42 dB/0.879 ± 0.007). Furthermore, we experimentally visualized the behavior of the optimization process, which is often unknown in unsupervised CNN-based restoration problems. For preclinical (using [18F]FDG and [11C]raclopride) and clinical (using [18F]florbetapir) studies, the proposed method demonstrates state-of-the-art denoising performance while retaining spatial resolution and quantitative accuracy, despite using a common network architecture for various noisy PET images with 1/10th of the full counts. These results suggest that the proposed MR-GDD can reduce PET scan times and PET tracer doses considerably without impacting patients.
Collapse
Affiliation(s)
- Yuya Onishi
- Central Research Laboratory, Hamamatsu Photonics K. K., 5000 Hirakuchi, Hamakita-ku, Hamamatsu 434-8601, Japan.
| | - Fumio Hashimoto
- Central Research Laboratory, Hamamatsu Photonics K. K., 5000 Hirakuchi, Hamakita-ku, Hamamatsu 434-8601, Japan
| | - Kibo Ote
- Central Research Laboratory, Hamamatsu Photonics K. K., 5000 Hirakuchi, Hamakita-ku, Hamamatsu 434-8601, Japan
| | - Hiroyuki Ohba
- Central Research Laboratory, Hamamatsu Photonics K. K., 5000 Hirakuchi, Hamakita-ku, Hamamatsu 434-8601, Japan
| | - Ryosuke Ota
- Central Research Laboratory, Hamamatsu Photonics K. K., 5000 Hirakuchi, Hamakita-ku, Hamamatsu 434-8601, Japan
| | - Etsuji Yoshikawa
- Central Research Laboratory, Hamamatsu Photonics K. K., 5000 Hirakuchi, Hamakita-ku, Hamamatsu 434-8601, Japan
| | - Yasuomi Ouchi
- Department of Biofunctional Imaging, Preeminent Medical Photonics Education & Research Center, Hamamatsu University School of Medicine, 1-20-1 Handayama, Higashi-ku, Hamamatsu 431-3192, Japan
| |
Collapse
|
11
|
Yu N, Wang B, Ren J, Wu H, Gao Y, Liu A, Niu G. The clinical guiding value of a radiomics model for androgen deprivation therapy for prostate cancer. J Int Med Res 2021; 49:3000605211014301. [PMID: 34187217 PMCID: PMC8258766 DOI: 10.1177/03000605211014301] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022] Open
Abstract
OBJECTIVE Three models were used to evaluate prostate cancer after androgen deprivation therapy (ADT) and to determine the value of detecting residual lesions after treatment. METHODS We retrospectively analysed patients with prostate cancer who received ADT from January 2018 to June 2019. Patients were divided into ADT responder and ADT non-responder groups, and clinical risk factors were determined. Regions of interest were manually contoured on each slice on fat-saturated-T2-weighted imaging, and radiomic features were extracted. Uni- and multivariate logistic regression were used to establish radiomics, clinical and combined models. RESULTS There were 23 ADT non-responders and 20 ADT responders. In the clinical model, total prostate-specific antigen concentration and T stage were independent predictors of efficacy (area under the curve (AUC) = 0.774). The characteristics, MinIntensity and Correlation_ angle135_offset4 indicated an effective clinical model (AUC = 0.807). GLCMEntropy_ AllDirection_offset1_SD was the best feature to differentiate residual lesions from the central gland (CG) (Lesion-CG model, AUC = 0.955). Correlation_angle135_offset4, GLCMEntropy_ AllDirection_offset4_SD and GLCMEntropy_AllDirection_offset7_SD differentiated residual lesions from the peripheral zone (PZ) (Lesion-PZ model, AUC = 0.855). The AUC for the combined model was 0.904. CONCLUSIONS Our models can guide the clinical treatment of patients with different ADT responses. Furthermore, the radiomics model can detect prostate cancer that is non-responsive to ADT.
Collapse
Affiliation(s)
- Na Yu
- Department of Imaging Diagnosis, The Fifth People's Hospital of Datong, Datong, Shanxi Province, China
| | - Baoping Wang
- Department of Imaging Diagnosis, The Fifth People's Hospital of Datong, Datong, Shanxi Province, China
| | - Jialiang Ren
- General Electric Pharmaceutical (Shanghai), Beijing, China
| | - Hui Wu
- Department of Imaging Diagnosis, Affiliated Hospital of Inner Mongolia Medical University, Hohhot, Inner Mongolia, China
| | - Yang Gao
- Department of Imaging Diagnosis, Affiliated Hospital of Inner Mongolia Medical University, Hohhot, Inner Mongolia, China
| | - Aishi Liu
- Department of Imaging Diagnosis, Affiliated Hospital of Inner Mongolia Medical University, Hohhot, Inner Mongolia, China
| | - Guangming Niu
- Department of Imaging Diagnosis, Affiliated Hospital of Inner Mongolia Medical University, Hohhot, Inner Mongolia, China
| |
Collapse
|
12
|
Hashimoto F, Ohba H, Ote K, Kakimoto A, Tsukada H, Ouchi Y. 4D deep image prior: dynamic PET image denoising using an unsupervised four-dimensional branch convolutional neural network. Phys Med Biol 2021; 66:015006. [PMID: 33227725 DOI: 10.1088/1361-6560/abcd1a] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Abstract
Although convolutional neural networks (CNNs) demonstrate the superior performance in denoising positron emission tomography (PET) images, a supervised training of the CNN requires a pair of large, high-quality PET image datasets. As an unsupervised learning method, a deep image prior (DIP) has recently been proposed; it can perform denoising with only the target image. In this study, we propose an innovative procedure for the DIP approach with a four-dimensional (4D) branch CNN architecture in end-to-end training to denoise dynamic PET images. Our proposed 4D CNN architecture can be applied to end-to-end dynamic PET image denoising by introducing a feature extractor and a reconstruction branch for each time frame of the dynamic PET image. In the proposed DIP method, it is not necessary to prepare high-quality and large patient-related PET images. Instead, a subject's own static PET image is used as additional information, dynamic PET images are treated as training labels, and denoised dynamic PET images are obtained from the CNN outputs. Both simulation with [18F]fluoro-2-deoxy-D-glucose (FDG) and preclinical data with [18F]FDG and [11C]raclopride were used to evaluate the proposed framework. The results showed that our 4D DIP framework quantitatively and qualitatively outperformed 3D DIP and other unsupervised denoising methods. The proposed 4D DIP framework thus provides a promising procedure for dynamic PET image denoising.
Collapse
Affiliation(s)
- Fumio Hashimoto
- Central Research Laboratory, Hamamatsu Photonics K. K., 5000 Hirakuchi, Hamakita-ku, Hamamatsu 434-8601, Japan
| | | | | | | | | | | |
Collapse
|
13
|
Dercle L, Henry T, Carré A, Paragios N, Deutsch E, Robert C. Reinventing radiation therapy with machine learning and imaging bio-markers (radiomics): State-of-the-art, challenges and perspectives. Methods 2020; 188:44-60. [PMID: 32697964 DOI: 10.1016/j.ymeth.2020.07.003] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2020] [Revised: 07/02/2020] [Accepted: 07/06/2020] [Indexed: 12/14/2022] Open
Abstract
Radiation therapy is a pivotal cancer treatment that has significantly progressed over the last decade due to numerous technological breakthroughs. Imaging is now playing a critical role on deployment of the clinical workflow, both for treatment planning and treatment delivery. Machine-learning analysis of predefined features extracted from medical images, i.e. radiomics, has emerged as a promising clinical tool for a wide range of clinical problems addressing drug development, clinical diagnosis, treatment selection and implementation as well as prognosis. Radiomics denotes a paradigm shift redefining medical images as a quantitative asset for data-driven precision medicine. The adoption of machine-learning in a clinical setting and in particular of radiomics features requires the selection of robust, representative and clinically interpretable biomarkers that are properly evaluated on a representative clinical data set. To be clinically relevant, radiomics must not only improve patients' management with great accuracy but also be reproducible and generalizable. Hence, this review explores the existing literature and exposes its potential technical caveats, such as the lack of quality control, standardization, sufficient sample size, type of data collection, and external validation. Based upon the analysis of 165 original research studies based on PET, CT-scan, and MRI, this review provides an overview of new concepts, and hypotheses generating findings that should be validated. In particular, it describes evolving research trends to enhance several clinical tasks such as prognostication, treatment planning, response assessment, prediction of recurrence/relapse, and prediction of toxicity. Perspectives regarding the implementation of an AI-based radiotherapy workflow are presented.
Collapse
Affiliation(s)
- Laurent Dercle
- Department of Radiology, New York Presbyterian Hospital, Columbia University Medical Center, New York, USA
| | - Theophraste Henry
- Molecular Radiotherapy and Innovative Therapeutics, INSERM UMR1030, Gustave Roussy Cancer Campus, Université Paris Saclay, Villejuif, France; Department of Nuclear Medicine and Endocrine Oncology, Gustave Roussy Cancer Campus, Villejuif, France
| | - Alexandre Carré
- Molecular Radiotherapy and Innovative Therapeutics, INSERM UMR1030, Gustave Roussy Cancer Campus, Université Paris Saclay, Villejuif, France; Department of Radiation Oncology, Gustave Roussy Cancer Campus, Villejuif, France
| | | | - Eric Deutsch
- Molecular Radiotherapy and Innovative Therapeutics, INSERM UMR1030, Gustave Roussy Cancer Campus, Université Paris Saclay, Villejuif, France; Department of Radiation Oncology, Gustave Roussy Cancer Campus, Villejuif, France
| | - Charlotte Robert
- Molecular Radiotherapy and Innovative Therapeutics, INSERM UMR1030, Gustave Roussy Cancer Campus, Université Paris Saclay, Villejuif, France; Department of Radiation Oncology, Gustave Roussy Cancer Campus, Villejuif, France.
| |
Collapse
|