1
|
Huang J, Ferreira PF, Wang L, Wu Y, Aviles-Rivero AI, Schönlieb CB, Scott AD, Khalique Z, Dwornik M, Rajakulasingam R, De Silva R, Pennell DJ, Nielles-Vallespin S, Yang G. Deep learning-based diffusion tensor cardiac magnetic resonance reconstruction: a comparison study. Sci Rep 2024; 14:5658. [PMID: 38454072 PMCID: PMC10920645 DOI: 10.1038/s41598-024-55880-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2023] [Accepted: 02/27/2024] [Indexed: 03/09/2024] Open
Abstract
In vivo cardiac diffusion tensor imaging (cDTI) is a promising Magnetic Resonance Imaging (MRI) technique for evaluating the microstructure of myocardial tissue in living hearts, providing insights into cardiac function and enabling the development of innovative therapeutic strategies. However, the integration of cDTI into routine clinical practice poses challenging due to the technical obstacles involved in the acquisition, such as low signal-to-noise ratio and prolonged scanning times. In this study, we investigated and implemented three different types of deep learning-based MRI reconstruction models for cDTI reconstruction. We evaluated the performance of these models based on the reconstruction quality assessment, the diffusion tensor parameter assessment as well as the computational cost assessment. Our results indicate that the models discussed in this study can be applied for clinical use at an acceleration factor (AF) of × 2 and × 4 , with the D5C5 model showing superior fidelity for reconstruction and the SwinMR model providing higher perceptual scores. There is no statistical difference from the reference for all diffusion tensor parameters at AF × 2 or most DT parameters at AF × 4 , and the quality of most diffusion tensor parameter maps is visually acceptable. SwinMR is recommended as the optimal approach for reconstruction at AF × 2 and AF × 4 . However, we believe that the models discussed in this study are not yet ready for clinical use at a higher AF. At AF × 8 , the performance of all models discussed remains limited, with only half of the diffusion tensor parameters being recovered to a level with no statistical difference from the reference. Some diffusion tensor parameter maps even provide wrong and misleading information.
Collapse
Grants
- Wellcome Trust
- RG/19/1/34160 British Heart Foundation
- This study was supported in part by the UKRI Future Leaders Fellowship (MR/V023799/1), BHF (RG/19/1/34160), the ERC IMI (101005122), the H2020 (952172), the MRC (MC/PC/21013), the Royal Society (IEC/NSFC/211235), the NVIDIA Academic Hardware Grant Program, EPSRC (EP/V029428/1, EP/S026045/1, EP/T003553/1, EP/N014588/1, EP/T017961/1), and the Cambridge Mathematics of Information in Healthcare Hub (CMIH) Partnership Fund.
Collapse
Affiliation(s)
- Jiahao Huang
- National Heart and Lung Institute, Imperial College London, London, SW7 2AZ, UK.
- Cardiovascular Research Centre, Royal Brompton Hospital, London, SW7 2AZ, UK.
- Bioengineering Department and Imperial-X, Imperial College London, London, W12 7SL, UK.
| | - Pedro F Ferreira
- National Heart and Lung Institute, Imperial College London, London, SW7 2AZ, UK
- Cardiovascular Research Centre, Royal Brompton Hospital, London, SW7 2AZ, UK
| | - Lichao Wang
- National Heart and Lung Institute, Imperial College London, London, SW7 2AZ, UK
- Department of Computing, Imperial College London, London, UK
| | - Yinzhe Wu
- National Heart and Lung Institute, Imperial College London, London, SW7 2AZ, UK
- Cardiovascular Research Centre, Royal Brompton Hospital, London, SW7 2AZ, UK
| | - Angelica I Aviles-Rivero
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, UK
| | - Carola-Bibiane Schönlieb
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, UK
| | - Andrew D Scott
- National Heart and Lung Institute, Imperial College London, London, SW7 2AZ, UK
- Cardiovascular Research Centre, Royal Brompton Hospital, London, SW7 2AZ, UK
| | - Zohya Khalique
- National Heart and Lung Institute, Imperial College London, London, SW7 2AZ, UK
- Cardiovascular Research Centre, Royal Brompton Hospital, London, SW7 2AZ, UK
| | - Maria Dwornik
- National Heart and Lung Institute, Imperial College London, London, SW7 2AZ, UK
- Cardiovascular Research Centre, Royal Brompton Hospital, London, SW7 2AZ, UK
| | - Ramyah Rajakulasingam
- National Heart and Lung Institute, Imperial College London, London, SW7 2AZ, UK
- Cardiovascular Research Centre, Royal Brompton Hospital, London, SW7 2AZ, UK
| | - Ranil De Silva
- National Heart and Lung Institute, Imperial College London, London, SW7 2AZ, UK
- Cardiovascular Research Centre, Royal Brompton Hospital, London, SW7 2AZ, UK
| | - Dudley J Pennell
- National Heart and Lung Institute, Imperial College London, London, SW7 2AZ, UK
- Cardiovascular Research Centre, Royal Brompton Hospital, London, SW7 2AZ, UK
| | - Sonia Nielles-Vallespin
- National Heart and Lung Institute, Imperial College London, London, SW7 2AZ, UK
- Cardiovascular Research Centre, Royal Brompton Hospital, London, SW7 2AZ, UK
| | - Guang Yang
- National Heart and Lung Institute, Imperial College London, London, SW7 2AZ, UK.
- Cardiovascular Research Centre, Royal Brompton Hospital, London, SW7 2AZ, UK.
- Bioengineering Department and Imperial-X, Imperial College London, London, W12 7SL, UK.
| |
Collapse
|
2
|
Aja-Fernández S, Martín-Martín C, Planchuelo-Gómez Á, Faiyaz A, Uddin MN, Schifitto G, Tiwari A, Shigwan SJ, Kumar Singh R, Zheng T, Cao Z, Wu D, Blumberg SB, Sen S, Goodwin-Allcock T, Slator PJ, Yigit Avci M, Li Z, Bilgic B, Tian Q, Wang X, Tang Z, Cabezas M, Rauland A, Merhof D, Manzano Maria R, Campos VP, Santini T, da Costa Vieira MA, HashemizadehKolowri S, DiBella E, Peng C, Shen Z, Chen Z, Ullah I, Mani M, Abdolmotalleby H, Eckstrom S, Baete SH, Filipiak P, Dong T, Fan Q, de Luis-García R, Tristán-Vega A, Pieciak T. Validation of deep learning techniques for quality augmentation in diffusion MRI for clinical studies. Neuroimage Clin 2023; 39:103483. [PMID: 37572514 PMCID: PMC10440596 DOI: 10.1016/j.nicl.2023.103483] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Revised: 07/24/2023] [Accepted: 07/25/2023] [Indexed: 08/14/2023]
Abstract
The objective of this study is to evaluate the efficacy of deep learning (DL) techniques in improving the quality of diffusion MRI (dMRI) data in clinical applications. The study aims to determine whether the use of artificial intelligence (AI) methods in medical images may result in the loss of critical clinical information and/or the appearance of false information. To assess this, the focus was on the angular resolution of dMRI and a clinical trial was conducted on migraine, specifically between episodic and chronic migraine patients. The number of gradient directions had an impact on white matter analysis results, with statistically significant differences between groups being drastically reduced when using 21 gradient directions instead of the original 61. Fourteen teams from different institutions were tasked to use DL to enhance three diffusion metrics (FA, AD and MD) calculated from data acquired with 21 gradient directions and a b-value of 1000 s/mm2. The goal was to produce results that were comparable to those calculated from 61 gradient directions. The results were evaluated using both standard image quality metrics and Tract-Based Spatial Statistics (TBSS) to compare episodic and chronic migraine patients. The study results suggest that while most DL techniques improved the ability to detect statistical differences between groups, they also led to an increase in false positive. The results showed that there was a constant growth rate of false positives linearly proportional to the new true positives, which highlights the risk of generalization of AI-based tasks when assessing diverse clinical cohorts and training using data from a single group. The methods also showed divergent performance when replicating the original distribution of the data and some exhibited significant bias. In conclusion, extreme caution should be exercised when using AI methods for harmonization or synthesis in clinical studies when processing heterogeneous data in clinical studies, as important information may be altered, even when global metrics such as structural similarity or peak signal-to-noise ratio appear to suggest otherwise.
Collapse
Affiliation(s)
- Santiago Aja-Fernández
- Laboratorio de Procesado de Imagen (LPI), ETSI Telecomunicación, Universidad de Valladolid, Spain.
| | - Carmen Martín-Martín
- Laboratorio de Procesado de Imagen (LPI), ETSI Telecomunicación, Universidad de Valladolid, Spain
| | - Álvaro Planchuelo-Gómez
- Laboratorio de Procesado de Imagen (LPI), ETSI Telecomunicación, Universidad de Valladolid, Spain; Cardiff University Brain Research Imaging Centre (CUBRIC), School of Psychology, Cardiff University, Cardiff, UK
| | | | | | | | | | | | | | | | | | - Dan Wu
- Zhejiang University, China
| | | | | | | | | | | | - Zihan Li
- Athinoula A. Martinos Center for Biomedical Imaging, USA
| | - Berkin Bilgic
- Athinoula A. Martinos Center for Biomedical Imaging, USA
| | - Qiyuan Tian
- Athinoula A. Martinos Center for Biomedical Imaging, USA
| | | | | | | | | | | | | | | | | | | | | | | | | | | | - Zan Chen
- Zhejiang University of Technology, China
| | | | | | | | | | | | | | | | | | - Rodrigo de Luis-García
- Laboratorio de Procesado de Imagen (LPI), ETSI Telecomunicación, Universidad de Valladolid, Spain
| | - Antonio Tristán-Vega
- Laboratorio de Procesado de Imagen (LPI), ETSI Telecomunicación, Universidad de Valladolid, Spain
| | - Tomasz Pieciak
- Laboratorio de Procesado de Imagen (LPI), ETSI Telecomunicación, Universidad de Valladolid, Spain
| |
Collapse
|
3
|
Tian Q, Bilgic B, Fan Q, Liao C, Ngamsombat C, Hu Y, Witzel T, Setsompop K, Polimeni JR, Huang SY. DeepDTI: High-fidelity six-direction diffusion tensor imaging using deep learning. Neuroimage 2020; 219:117017. [PMID: 32504817 PMCID: PMC7646449 DOI: 10.1016/j.neuroimage.2020.117017] [Citation(s) in RCA: 47] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2020] [Revised: 05/15/2020] [Accepted: 06/02/2020] [Indexed: 12/14/2022] Open
Abstract
Diffusion tensor magnetic resonance imaging (DTI) is unsurpassed in its ability to map tissue microstructure and structural connectivity in the living human brain. Nonetheless, the angular sampling requirement for DTI leads to long scan times and poses a critical barrier to performing high-quality DTI in routine clinical practice and large-scale research studies. In this work we present a new processing framework for DTI entitled DeepDTI that minimizes the data requirement of DTI to six diffusion-weighted images (DWIs) required by conventional voxel-wise fitting methods for deriving the six unique unknowns in a diffusion tensor using data-driven supervised deep learning. DeepDTI maps the input non-diffusion-weighted (b = 0) image and six DWI volumes sampled along optimized diffusion-encoding directions, along with T1-weighted and T2-weighted image volumes, to the residuals between the input and high-quality output b = 0 image and DWI volumes using a 10-layer three-dimensional convolutional neural network (CNN). The inputs and outputs of DeepDTI are uniquely formulated, which not only enables residual learning to boost CNN performance but also enables tensor fitting of resultant high-quality DWIs to generate orientational DTI metrics for tractography. The very deep CNN used by DeepDTI leverages the redundancy in local and non-local spatial information and across diffusion-encoding directions and image contrasts in the data. The performance of DeepDTI was systematically quantified in terms of the quality of the output images, DTI metrics, DTI-based tractography and tract-specific analysis results. We demonstrate rotationally-invariant and robust estimation of DTI metrics from DeepDTI that are comparable to those obtained with two b = 0 images and 21 DWIs for the primary eigenvector derived from DTI and two b = 0 images and 26-30 DWIs for various scalar metrics derived from DTI, achieving 3.3-4.6 × acceleration, and twice as good as those of a state-of-the-art denoising algorithm at the group level. The twenty major white-matter tracts can be accurately identified from the tractography of DeepDTI results. The mean distance between the core of the major white-matter tracts identified from DeepDTI results and those from the ground-truth results using 18 b = 0 images and 90 DWIs measures around 1-1.5 mm. DeepDTI leverages domain knowledge of diffusion MRI physics and power of deep learning to render DTI, DTI-based tractography, major white-matter tracts identification and tract-specific analysis more feasible for a wider range of neuroscientific and clinical studies.
Collapse
Affiliation(s)
- Qiyuan Tian
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown, MA, United States; Harvard Medical School, Boston, MA, United States.
| | - Berkin Bilgic
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown, MA, United States; Harvard Medical School, Boston, MA, United States; Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - Qiuyun Fan
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown, MA, United States; Harvard Medical School, Boston, MA, United States
| | - Congyu Liao
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown, MA, United States; Harvard Medical School, Boston, MA, United States
| | - Chanon Ngamsombat
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown, MA, United States; Department of Radiology, Faculty of Medicine, Siriraj Hospital, Mahidol University, Thailand
| | - Yuxin Hu
- Department of Electrical Engineering, Stanford University, Stanford, CA, United States
| | - Thomas Witzel
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown, MA, United States; Harvard Medical School, Boston, MA, United States
| | - Kawin Setsompop
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown, MA, United States; Harvard Medical School, Boston, MA, United States; Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - Jonathan R Polimeni
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown, MA, United States; Harvard Medical School, Boston, MA, United States; Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - Susie Y Huang
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown, MA, United States; Harvard Medical School, Boston, MA, United States; Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA, United States
| |
Collapse
|
4
|
Chen G, Dong B, Zhang Y, Lin W, Yap PT. Denoising of Diffusion MRI Data via Graph Framelet Matching in x-q Space. IEEE TRANSACTIONS ON MEDICAL IMAGING 2019; 38:2838-2848. [PMID: 31071025 PMCID: PMC8325050 DOI: 10.1109/tmi.2019.2915629] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/17/2023]
Abstract
Diffusion magnetic resonance imaging (DMRI) suffers from lower signal-to-noise-ratio (SNR) due to MR signal attenuation associated with the motion of water molecules. To improve SNR, the non-local means (NLM) algorithm has demonstrated state-of-the-art performance in noise reduction. However, existing NLM algorithms do not take into account explicitly the fact that DMRI signal can vary significantly with local fiber orientations. Applying NLM naïvely can hence blur subtle structures and aggravate partial volume effects. To overcome this limitation, we improve NLM by performing neighborhood matching in non-flat domains and removing noise with information from both x -space (spatial domain) and q -space (wavevector domain). Specifically, we first encode the q -space sampling domain using a graph. We then perform graph framelet transforms to extract robust rotation-invariant features for each sampling point in x-q space. The resulting features are employed for robust neighborhood matching to locate recurrent information. Finally, we remove noise via an NLM framework. To adapt to the various types of noise in multi-coil MR imaging, we transform the signal before denoising so that it is Gaussian-distributed, allowing noise removal to be carried out in an unbiased manner. Our method is able to more effectively locate recurrent information in white matter structures with different orientations, avoiding the blurring effects caused by naïvely applying NLM. Experiments on synthetic, repetitively-acquired, and infant DMRI data demonstrate that our method is able to preserve subtle structures while effectively removing noise.
Collapse
Affiliation(s)
- Geng Chen
- Department of Radiology and Biomedical Research Imaging Center (BRIC), University of North Carolina at Chapel Hill, NC, U.S.A. D. Shen is also with the Department of Brain and Cognitive Engineering, Korea University, Seoul, Korea
| | - Bin Dong
- Beijing International Center for Mathematical Research, Peking University, Beijing, China
| | - Yong Zhang
- Vancouver Research Center, Huawei, Burnaby, Canada
| | | | | |
Collapse
|
5
|
Chen G, Wu Y, Shen D, Yap PT. Noise reduction in diffusion MRI using non-local self-similar information in joint x-q space. Med Image Anal 2019; 53:79-94. [PMID: 30703580 PMCID: PMC6397790 DOI: 10.1016/j.media.2019.01.006] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2018] [Revised: 12/25/2018] [Accepted: 01/14/2019] [Indexed: 10/27/2022]
Abstract
Diffusion MRI affords valuable insights into white matter microstructures, but suffers from low signal-to-noise ratio (SNR), especially at high diffusion weighting (i.e., b-value). To avoid time-intensive repeated acquisition, post-processing algorithms are often used to reduce noise. Among existing methods, non-local means (NLM) has been shown to be particularly effective. However, most NLM algorithms for diffusion MRI focus on patch matching in the spatial domain (i.e., x-space) and disregard the fact that the data live in a combined 6D space covering both spatial domain and diffusion wavevector domain (i.e., q-space). This drawback leads to inaccurate patch matching in curved white matter structures and hence the inability to effectively use recurrent information for noise reduction. The goal of this paper is to overcome this limitation by extending NLM to the joint x-q space. Specifically, we define for each point in the x-q space a spherical patch from which we extract rotation-invariant features for patch matching. The ability to perform patch matching across q-samples allows patches from differentially orientated structures to be used for effective noise removal. Extensive experiments on synthetic, repeated-acquisition, and HCP data demonstrate that our method outperforms state-of-the-art methods, both qualitatively and quantitatively.
Collapse
Affiliation(s)
- Geng Chen
- Department of Radiology and Biomedical Research Imaging Center (BRIC), University of North Carolina at Chapel Hill, NC, USA.
| | - Yafeng Wu
- Data Processing Center, Northwestern Polytechnical University, Xi'an, China.
| | - Dinggang Shen
- Department of Radiology and Biomedical Research Imaging Center (BRIC), University of North Carolina at Chapel Hill, NC, USA; Department of Brain and Cognitive Engineering, Korea University, Seoul, Korea.
| | - Pew-Thian Yap
- Department of Radiology and Biomedical Research Imaging Center (BRIC), University of North Carolina at Chapel Hill, NC, USA.
| |
Collapse
|
6
|
Chen G, Zhang J, Zhang Y, Dong B, Shen D, Yap PT. Multi-channel framelet denoising of diffusion-weighted images. PLoS One 2019; 14:e0211621. [PMID: 30726257 PMCID: PMC6364918 DOI: 10.1371/journal.pone.0211621] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2018] [Accepted: 01/17/2019] [Indexed: 11/18/2022] Open
Abstract
Diffusion MRI derives its contrast from MR signal attenuation induced by the movement of water molecules in microstructural environments. Associated with the signal attenuation is the reduction of signal-to-noise ratio (SNR). Methods based on total variation (TV) have shown superior performance in image noise reduction. However, TV denoising can result in stair-casing effects due to the inherent piecewise-constant assumption. In this paper, we propose a tight wavelet frame based approach for edge-preserving denoising of diffusion-weighted (DW) images. Specifically, we employ the unitary extension principle (UEP) to generate frames that are discrete analogues to differential operators of various orders, which will help avoid stair-casing effects. Instead of denoising each DW image separately, we collaboratively denoise groups of DW images acquired with adjacent gradient directions. In addition, we introduce a very efficient method for solving an ℓ0 denoising problem that involves only thresholding and solving a trivial inverse problem. We demonstrate the effectiveness of our method qualitatively and quantitatively using synthetic and real data.
Collapse
Affiliation(s)
- Geng Chen
- Department of Radiology and Biomedical Research Imaging Center (BRIC) University of North Carolina, Chapel Hill, United States of America
| | - Jian Zhang
- Department of Radiology and Biomedical Research Imaging Center (BRIC) University of North Carolina, Chapel Hill, United States of America
- School of Information and Electrical Engineering, Hunan University of Science & Technology, Xiangtan, China
| | - Yong Zhang
- Vancouver Research Center, Huawei, Burnaby, Canada
| | - Bin Dong
- Beijing International Center for Mathematical Research, Peking University, Beijing, China
| | - Dinggang Shen
- Department of Radiology and Biomedical Research Imaging Center (BRIC) University of North Carolina, Chapel Hill, United States of America
- Department of Brain and Cognitive Engineering, Korea University, Seoul, Korea
| | - Pew-Thian Yap
- Department of Radiology and Biomedical Research Imaging Center (BRIC) University of North Carolina, Chapel Hill, United States of America
| |
Collapse
|