1
|
van Lohuizen Q, Roest C, Simonis FFJ, Fransen SJ, Kwee TC, Yakar D, Huisman H. Assessing deep learning reconstruction for faster prostate MRI: visual vs. diagnostic performance metrics. Eur Radiol 2024; 34:7364-7372. [PMID: 38724765 PMCID: PMC11519109 DOI: 10.1007/s00330-024-10771-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2024] [Revised: 02/16/2024] [Accepted: 03/09/2024] [Indexed: 05/31/2024]
Abstract
OBJECTIVE Deep learning (DL) MRI reconstruction enables fast scan acquisition with good visual quality, but the diagnostic impact is often not assessed because of large reader study requirements. This study used existing diagnostic DL to assess the diagnostic quality of reconstructed images. MATERIALS AND METHODS A retrospective multisite study of 1535 patients assessed biparametric prostate MRI between 2016 and 2020. Likely clinically significant prostate cancer (csPCa) lesions (PI-RADS ≥ 4) were delineated by expert radiologists. T2-weighted scans were retrospectively undersampled, simulating accelerated protocols. DL reconstruction (DLRecon) and diagnostic DL detection (DLDetect) were developed. The effect on the partial area under (pAUC), the Free-Response Operating Characteristic (FROC) curve, and the structural similarity (SSIM) were compared as metrics for diagnostic and visual quality, respectively. DLDetect was validated with a reader concordance analysis. Statistical analysis included Wilcoxon, permutation, and Cohen's kappa tests for visual quality, diagnostic performance, and reader concordance. RESULTS DLRecon improved visual quality at 4- and 8-fold (R4, R8) subsampling rates, with SSIM (range: -1 to 1) improved to 0.78 ± 0.02 (p < 0.001) and 0.67 ± 0.03 (p < 0.001) from 0.68 ± 0.03 and 0.51 ± 0.03, respectively. However, diagnostic performance at R4 showed a pAUC FROC of 1.33 (CI 1.28-1.39) for DL and 1.29 (CI 1.23-1.35) for naive reconstructions, both significantly lower than fully sampled pAUC of 1.58 (DL: p = 0.024, naïve: p = 0.02). Similar trends were noted for R8. CONCLUSION DL reconstruction produces visually appealing images but may reduce diagnostic accuracy. Incorporating diagnostic AI into the assessment framework offers a clinically relevant metric essential for adopting reconstruction models into clinical practice. CLINICAL RELEVANCE STATEMENT In clinical settings, caution is warranted when using DL reconstruction for MRI scans. While it recovered visual quality, it failed to match the prostate cancer detection rates observed in scans not subjected to acceleration and DL reconstruction.
Collapse
Affiliation(s)
- Quintin van Lohuizen
- University Medical Centre Groningen, Hanzeplein 1, 9713 GZ, Groningen, The Netherlands.
| | - Christian Roest
- University Medical Centre Groningen, Hanzeplein 1, 9713 GZ, Groningen, The Netherlands
| | - Frank F J Simonis
- University of Twente, Drienerlolaan 5, 7522 NB, Enschede, The Netherlands
| | - Stefan J Fransen
- University Medical Centre Groningen, Hanzeplein 1, 9713 GZ, Groningen, The Netherlands
| | - Thomas C Kwee
- University Medical Centre Groningen, Hanzeplein 1, 9713 GZ, Groningen, The Netherlands
| | - Derya Yakar
- University Medical Centre Groningen, Hanzeplein 1, 9713 GZ, Groningen, The Netherlands
- Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX, Amsterdam, The Netherlands
| | - Henkjan Huisman
- Radboud University Medical Centre, Geert Grooteplein Zuid 10, 6525 GA, Nijmegen, The Netherlands
- Norwegian University of Science and Technology, Høgskoleringen 1, 7034, Trondheim, Norway
| |
Collapse
|
2
|
de Buck MHS, Jezzard P, Hess AT. Optimization of undersampling parameters for 3D intracranial compressed sensing MR angiography at 7 T. Magn Reson Med 2022; 88:880-889. [PMID: 35344622 PMCID: PMC9314035 DOI: 10.1002/mrm.29236] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2022] [Revised: 02/23/2022] [Accepted: 02/25/2022] [Indexed: 01/26/2023]
Abstract
PURPOSE 3D time-of-flight MRA can accurately visualize the intracranial vasculature but is limited by long acquisition times. Compressed sensing reconstruction can be used to substantially accelerate acquisitions. The quality of those reconstructions depends on the undersampling patterns used. In this work, we optimize sets of undersampling parameters for various acceleration factors of Cartesian 3D time-of-flight MRA. METHODS Fully sampled datasets, acquired at 7 Tesla, were retrospectively undersampled using variable-density Poisson disk sampling with various autocalibration region sizes, polynomial orders, and acceleration factors. The accuracy of reconstructions from the different undersampled datasets was assessed using the vessel-masked structural similarity index. Identified optimal undersampling parameters were then evaluated in additional prospectively undersampled datasets. Compressed sensing reconstruction parameters were chosen based on a preliminary reconstruction parameter optimization. RESULTS For all acceleration factors, using a fully sampled calibration area of 12 × 12 k-space lines and a polynomial order of 2 resulted in the highest image quality. The importance of parameter optimization of the sampling was found to increase for higher acceleration factors. The results were consistent across resolutions and regions of interest with vessels of varying sizes and tortuosity. The number of visible small vessels increased by 7.0% and 14.2% when compared to standard parameters for acceleration factors of 7.2 and 15, respectively. CONCLUSION The image quality of compressed sensing time-of-flight MRA can be improved by appropriate choice of undersampling parameters. The optimized sets of parameters are independent of the acceleration factor and enable a larger number of vessels to be visualized.
Collapse
Affiliation(s)
- Matthijs H. S. de Buck
- Wellcome Centre for Integrative Neuroimaging, FMRIB Division, Nuffield Department of Clinical NeurosciencesUniversity of OxfordOxfordUK
| | - Peter Jezzard
- Wellcome Centre for Integrative Neuroimaging, FMRIB Division, Nuffield Department of Clinical NeurosciencesUniversity of OxfordOxfordUK
| | - Aaron T. Hess
- Wellcome Centre for Integrative Neuroimaging, FMRIB Division, Nuffield Department of Clinical NeurosciencesUniversity of OxfordOxfordUK
| |
Collapse
|
3
|
Tran AQ, Nguyen TA, Doan PT, Tran DN, Tran DT. Parallel magnetic resonance imaging acceleration with a hybrid sensing approach. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2021; 18:2288-2302. [PMID: 33892546 DOI: 10.3934/mbe.2021116] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
In magnetic resonance imaging (MRI), the scan time for acquiring an image is relatively long, resulting in patient uncomfortable and error artifacts. Fortunately, the compressed sensing (CS) and parallel magnetic resonance imaging (pMRI) can reduce the scan time of the MRI without significantly compromising the quality of the images. It has been found that the combination of pMRI and CS can better improve the image reconstruction, which will accelerate the speed of MRI acquisition because the number of measurements is much smaller than that by pMRI. In this paper, we propose combining a combined CS method and pMRI for better accelerating the MRI acquisition. In the combined CS method, the under-sampled data of the K-space is performed by taking both regular sampling and traditional random under-sampling approaches. MRI image reconstruction is then performed by using nonlinear conjugate gradient optimization. The performance of the proposed method is simulated and evaluated using the reconstruction error measure, the universal image quality Q-index, and the peak signal-to-noise ratio (PSNR). The numerical simulations confirmed that, the average error, the Q index, and the PSNR ratio of the appointed scheme are remarkably improved up to 59, 63, and 39% respectively as compared to the traditional scheme. For the first time, instead of using highly computational approaches, a simple and efficient combination of CS and pMRI is proposed for the better MRI reconstruction. These findings are very meaningful for reducing the imaging time of MRI systems.
Collapse
Affiliation(s)
- Anh Quang Tran
- Department of Biomedical Engineering, Le Quy Don Technical University, Hanoi City, Vietnam
| | - Tien-Anh Nguyen
- Department of Physics, Le Quy Don Technical University, Hanoi City, Vietnam
| | - Phuc Thinh Doan
- NTT Hi-Tech Institute, Nguyen Tat Thanh University, Ho Chi Minh City, Vietnam
- Faculty of Mechanical, Electrical, Electronic and Automotive Engineering, Nguyen Tat Thanh University, Ho Chi Minh City, Vietnam
| | - Duc-Nghia Tran
- Institute of Information Technology, Vietnam Academy of Science and Technology, Hanoi City, Vietnam
| | - Duc-Tan Tran
- Faculty of Electrical and Electronic Engineering, Phenikaa University, Hanoi 12116, Vietnam
| |
Collapse
|
4
|
Takahashi J, Machida Y, Aoba M, Nawa Y, Kamoshida R, Fukuzawa K, Ohmoto-Sekine Y. Noise power spectrum in compressed sensing magnetic resonance imaging. Radiol Phys Technol 2021; 14:93-99. [PMID: 33484401 DOI: 10.1007/s12194-021-00608-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2019] [Revised: 11/13/2020] [Accepted: 01/07/2021] [Indexed: 12/25/2022]
Abstract
Compressed sensing magnetic resonance imaging (CS-MRI) uses random undersampling and nonlinear iterative reconstruction. This study was conducted to clarify the noise power spectrum (NPS) characteristics of CS-MRI. We measured two-dimensional (2D) NPS of CS-MRI with various acceleration factors (AF) and denoising factors (DF) and compared their appearance to those of conventional parallel MR images. Results showed that the 2D NPS of CS-MRI exhibited the following characteristics: (1) local decrease in the low-frequency region, (2) gradual decrease in the high-frequency region, and (3) a stripe pattern aligned at unequal intervals in the phase-encoding direction. Specifically, the 2D NPS of CS-MRI reflects the random undersampling pattern of k-space data. Additionally, 2D NPS allowed visualization of AF-dependent noise characteristics of CS-MRI. Furthermore, 1D NPS graph shapes clarified the CS-MRI noise characteristic dependence on AF and DF.
Collapse
Affiliation(s)
- Junji Takahashi
- Department of Radiological Technology, Toranomon Hospital, 2-2-2 Toranomon, Minato-ku, Tokyo, 105-8470, Japan. .,Medical Imaging and Applied Radiology, Tohoku University Graduate School of Medicine, 2-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8575, Japan.
| | - Yoshio Machida
- Medical Imaging and Applied Radiology, Tohoku University Graduate School of Medicine, 2-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8575, Japan
| | - Minami Aoba
- Medical Imaging and Applied Radiology, Tohoku University Graduate School of Medicine, 2-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8575, Japan
| | - Yuki Nawa
- Medical Imaging and Applied Radiology, Tohoku University Graduate School of Medicine, 2-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8575, Japan
| | - Ryo Kamoshida
- Medical Imaging and Applied Radiology, Tohoku University Graduate School of Medicine, 2-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, 980-8575, Japan
| | - Kei Fukuzawa
- Department of Radiological Technology, Toranomon Hospital, 2-2-2 Toranomon, Minato-ku, Tokyo, 105-8470, Japan
| | - Yuki Ohmoto-Sekine
- Health Management Center, Toranomon Hospital, 2-2-2 Toranomon, Minato-ku, Tokyo, 105-8470, Japan
| |
Collapse
|
5
|
Murtha N, Mason A, Bowen C, Clarke S, Rioux J, Beyea S. Evaluation of Golden-Angle-Sampled Dynamic Contrast-Enhanced MRI Reconstruction Using Objective Image Quality Measures: A Simulated Phantom Study. Tomography 2020; 6:362-372. [PMID: 33364426 PMCID: PMC7744192 DOI: 10.18383/j.tom.2020.00045] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/02/2022] Open
Abstract
We aim to extend the use of image quality metrics (IQMs) from static magnetic resonance imaging (MRI) applications to dynamic MRI studies. We assessed the use of 2 IQMs, the root mean square error and structural similarity index, in evaluating the reconstruction of quantitative dynamic contrast-enhanced (DCE) MRI data acquired using golden-angle sampling and compressed sensing (CS). To address the difficulty of obtaining ground-truth knowledge of parameters describing dynamics in real patient data, we developed a Matlab simulation framework to assess quantitative CS-DCE-MRI. We began by validating the response of each IQM to the CS-MRI reconstruction process using static data and the performance of our simulation framework with simple dynamic data. We then extended the simulations to the more realistic extended Tofts model. When assessing the Tofts model, we tested 4 different methods of selecting a reference image for the IQMs. Results from the retrospective static CS-MRI reconstructions showed that each IQM is responsive to the CS-MRI reconstruction process. Simulations of a simple contrast evolution model validated the performance of our framework. Despite the complexity of the Tofts model, both IQM scores correlated well with the recovery accuracy of a central model parameter for all reference cases studied. This finding may form the basis of algorithms for automated selection of image reconstruction aspects, such as temporal resolution, in golden-angle-sampled CS-DCE-MRI. These further suggest that objective measures of image quality may find use in general dynamic MRI applications.
Collapse
Affiliation(s)
- Nathan Murtha
- Department of Physics, Carleton University, Ottawa, ON, Canada
| | - Allister Mason
- Department of Physics and Atmospheric Science, Dalhousie University, Halifax, NS, Canada
| | - Chris Bowen
- Department of Diagnostic Radiology, Dalhousie University, Halifax, NS, Canada; and
- BIOmedical Translational Imaging Centre (BIOTIC), Halifax, NS, Canada
| | - Sharon Clarke
- Department of Diagnostic Radiology, Dalhousie University, Halifax, NS, Canada; and
- BIOmedical Translational Imaging Centre (BIOTIC), Halifax, NS, Canada
| | - James Rioux
- Department of Diagnostic Radiology, Dalhousie University, Halifax, NS, Canada; and
- BIOmedical Translational Imaging Centre (BIOTIC), Halifax, NS, Canada
| | - Steven Beyea
- Department of Diagnostic Radiology, Dalhousie University, Halifax, NS, Canada; and
- BIOmedical Translational Imaging Centre (BIOTIC), Halifax, NS, Canada
| |
Collapse
|
6
|
Mason A, Rioux J, Clarke SE, Costa A, Schmidt M, Keough V, Huynh T, Beyea S. Comparison of Objective Image Quality Metrics to Expert Radiologists' Scoring of Diagnostic Quality of MR Images. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:1064-1072. [PMID: 31535985 DOI: 10.1109/tmi.2019.2930338] [Citation(s) in RCA: 43] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Image quality metrics (IQMs) such as root mean square error (RMSE) and structural similarity index (SSIM) are commonly used in the evaluation and optimization of accelerated magnetic resonance imaging (MRI) acquisition and reconstruction strategies. However, it is unknown how well these indices relate to a radiologist's perception of diagnostic image quality. In this study, we compare the image quality scores of five radiologists with the RMSE, SSIM, and other potentially useful IQMs: peak signal to noise ratio (PSNR) multi-scale SSIM (MSSSIM), information-weighted SSIM (IWSSIM), gradient magnitude similarity deviation (GMSD), feature similarity index (FSIM), high dynamic range visible difference predictor (HDRVDP), noise quality metric (NQM), and visual information fidelity (VIF). The comparison uses a database of MR images of the brain and abdomen that have been retrospectively degraded by noise, blurring, undersampling, motion, and wavelet compression for a total of 414 degraded images. A total of 1017 subjective scores were assigned by five radiologists. IQM performance was measured via the Spearman rank order correlation coefficient (SROCC) and statistically significant differences in the residuals of the IQM scores and radiologists' scores were tested. When considering SROCC calculated from combining scores from all radiologists across all image types, RMSE and SSIM had lower SROCC than six of the other IQMs included in the study (VIF, FSIM, NQM, GMSD, IWSSIM, and HDRVDP). In no case did SSIM have a higher SROCC or significantly smaller residuals than RMSE. These results should be considered when choosing an IQM in future imaging studies.
Collapse
|
7
|
Sartoretti E, Sartoretti T, Binkert C, Najafi A, Schwenk Á, Hinnen M, van Smoorenburg L, Eichenberger B, Sartoretti-Schefer S. Reduction of procedure times in routine clinical practice with Compressed SENSE magnetic resonance imaging technique. PLoS One 2019; 14:e0214887. [PMID: 30978232 PMCID: PMC6461228 DOI: 10.1371/journal.pone.0214887] [Citation(s) in RCA: 54] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2019] [Accepted: 03/21/2019] [Indexed: 11/18/2022] Open
Abstract
Objectives Acceleration of MR sequences beyond current parallel imaging techniques is possible with the Compressed SENSE technique that has recently become available for 1.5 and 3 Tesla scanners, for nearly all image contrasts and for 2D and 3D sequences. The impact of this technique on examination timing parameters and MR protocols in a clinical setting was investigated in this retrospective study. Material and methods A numerical analysis of the examination timing parameters (scan time, exam time, procedure time, interscan delay time, changeover time, nonscan time) based on the MR protocols of 6 different body regions (brain, knee, lumbar spine, breast, shoulder) using MR log files was performed and the total number of examinations acquired from January to April both in 2017 and 2018 on a 1.5 T MR scanner was registered. Percentages, box plots and unpaired two-sided t tests were obtained for statistical evaluation. Results All examination timing parameters of the six anatomical regions analysed were significantly shortened after implementation of Compressed SENSE. On average, scan times were accelerated by 20.2% (p<0.0001) while procedure times were shortened by 16% (p<0.0001). Considering all anatomical regions and all MR protocols, 27% more examinations were performed over the same 4 month period in 2018 compared to 2017. Conclusion Compressed SENSE allows for a significant acceleration of MR examinations and a considerable increase in the total number of MR examinations is possible.
Collapse
Affiliation(s)
- Elisabeth Sartoretti
- Institute of Radiology and Nuclear Medicine, Kantonsspital Winterthur, Winterthur, Switzerland
- Faculty of Medicine, University of Zurich, Zurich, Switzerland
| | - Thomas Sartoretti
- Institute of Radiology and Nuclear Medicine, Kantonsspital Winterthur, Winterthur, Switzerland
- Faculty of Medicine, University of Zurich, Zurich, Switzerland
| | - Christoph Binkert
- Institute of Radiology and Nuclear Medicine, Kantonsspital Winterthur, Winterthur, Switzerland
- Faculty of Medicine, University of Zurich, Zurich, Switzerland
| | - Arash Najafi
- Institute of Radiology and Nuclear Medicine, Kantonsspital Winterthur, Winterthur, Switzerland
| | - Árpád Schwenk
- Institute of Radiology and Nuclear Medicine, Kantonsspital Winterthur, Winterthur, Switzerland
| | - Martin Hinnen
- Institute of Radiology and Nuclear Medicine, Kantonsspital Winterthur, Winterthur, Switzerland
| | - Luuk van Smoorenburg
- Institute of Radiology and Nuclear Medicine, Kantonsspital Winterthur, Winterthur, Switzerland
| | - Barbara Eichenberger
- Institute of Radiology and Nuclear Medicine, Kantonsspital Winterthur, Winterthur, Switzerland
| | - Sabine Sartoretti-Schefer
- Institute of Radiology and Nuclear Medicine, Kantonsspital Winterthur, Winterthur, Switzerland
- Faculty of Medicine, University of Zurich, Zurich, Switzerland
- * E-mail:
| |
Collapse
|