1
|
Prostatic urinary tract visualization with super-resolution deep learning models. PLoS One 2023; 18:e0280076. [PMID: 36607999 PMCID: PMC9821403 DOI: 10.1371/journal.pone.0280076] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2022] [Accepted: 12/20/2022] [Indexed: 01/07/2023] Open
Abstract
In urethra-sparing radiation therapy, prostatic urinary tract visualization is important in decreasing the urinary side effect. A methodology has been developed to visualize the prostatic urinary tract using post-urination magnetic resonance imaging (PU-MRI) without a urethral catheter. This study investigated whether the combination of PU-MRI and super-resolution (SR) deep learning models improves the visibility of the prostatic urinary tract. We enrolled 30 patients who had previously undergone real-time-image-gated spot scanning proton therapy by insertion of fiducial markers. PU-MRI was performed using a non-contrast high-resolution two-dimensional T2-weighted turbo spin-echo imaging sequence. Four different SR deep learning models were used: the enhanced deep SR network (EDSR), widely activated SR network (WDSR), SR generative adversarial network (SRGAN), and residual dense network (RDN). The complex wavelet structural similarity index measure (CW-SSIM) was used to quantitatively assess the performance of the proposed SR images compared to PU-MRI. Two radiation oncologists used a 1-to-5 scale to subjectively evaluate the visibility of the prostatic urinary tract. Cohen's weighted kappa (k) was used as a measure of agreement of inter-operator reliability. The mean CW-SSIM in EDSR, WDSR, SRGAN, and RDN was 99.86%, 99.89%, 99.30%, and 99.67%, respectively. The mean prostatic urinary tract visibility scores of the radiation oncologists were 3.70 and 3.53 for PU-MRI (k = 0.93), 3.67 and 2.70 for EDSR (k = 0.89), 3.70 and 2.73 for WDSR (k = 0.88), 3.67 and 2.73 for SRGAN (k = 0.88), and 4.37 and 3.73 for RDN (k = 0.93), respectively. The results suggest that SR images using RDN are similar to the original images, and the SR deep learning models subjectively improve the visibility of the prostatic urinary tract.
Collapse
|
2
|
Multiparametric Functional MRI of the Kidney: Current State and Future Trends with Deep Learning Approaches. ROFO-FORTSCHR RONTG 2022; 194:983-992. [PMID: 35272360 DOI: 10.1055/a-1775-8633] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Abstract
BACKGROUND Until today, assessment of renal function has remained a challenge for modern medicine. In many cases, kidney diseases accompanied by a decrease in renal function remain undetected and unsolved, since neither laboratory tests nor imaging diagnostics provide adequate information on kidney status. In recent years, developments in the field of functional magnetic resonance imaging with application to abdominal organs have opened new possibilities combining anatomic imaging with multiparametric functional information. The multiparametric approach enables the measurement of perfusion, diffusion, oxygenation, and tissue characterization in one examination, thus providing more comprehensive insight into pathophysiological processes of diseases as well as effects of therapeutic interventions. However, application of multiparametric fMRI in the kidneys is still restricted mainly to research areas and transfer to the clinical routine is still outstanding. One of the major challenges is the lack of a standardized protocol for acquisition and postprocessing including efficient strategies for data analysis. This article provides an overview of the most common fMRI techniques with application to the kidney together with new approaches regarding data analysis with deep learning. METHODS This article implies a selective literature review using the literature database PubMed in May 2021 supplemented by our own experiences in this field. RESULTS AND CONCLUSION Functional multiparametric MRI is a promising technique for assessing renal function in a more comprehensive approach by combining multiple parameters such as perfusion, diffusion, and BOLD imaging. New approaches with the application of deep learning techniques could substantially contribute to overcoming the challenge of handling the quantity of data and developing more efficient data postprocessing and analysis protocols. Thus, it can be hoped that multiparametric fMRI protocols can be sufficiently optimized to be used for routine renal examination and to assist clinicians in the diagnostics, monitoring, and treatment of kidney diseases in the future. KEY POINTS · Multiparametric fMRI is a technique performed without the use of radiation, contrast media, and invasive methods.. · Multiparametric fMRI provides more comprehensive insight into pathophysiological processes of kidney diseases by combining functional and structural parameters.. · For broader acceptance of fMRI biomarkers, there is a need for standardization of acquisition, postprocessing, and analysis protocols as well as more prospective studies.. · Deep learning techniques could significantly contribute to an optimization of data acquisition and the postprocessing and interpretation of larger quantities of data.. CITATION FORMAT · Zhang C, Schwartz M, Küstner T et al. Multiparametric Functional MRI of the Kidney: Current State and Future Trends with Deep Learning Approaches. Fortschr Röntgenstr 2022; DOI: 10.1055/a-1775-8633.
Collapse
|
3
|
Ismail TF, Strugnell W, Coletti C, Božić-Iven M, Weingärtner S, Hammernik K, Correia T, Küstner T. Cardiac MR: From Theory to Practice. Front Cardiovasc Med 2022; 9:826283. [PMID: 35310962 PMCID: PMC8927633 DOI: 10.3389/fcvm.2022.826283] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2021] [Accepted: 01/17/2022] [Indexed: 01/10/2023] Open
Abstract
Cardiovascular disease (CVD) is the leading single cause of morbidity and mortality, causing over 17. 9 million deaths worldwide per year with associated costs of over $800 billion. Improving prevention, diagnosis, and treatment of CVD is therefore a global priority. Cardiovascular magnetic resonance (CMR) has emerged as a clinically important technique for the assessment of cardiovascular anatomy, function, perfusion, and viability. However, diversity and complexity of imaging, reconstruction and analysis methods pose some limitations to the widespread use of CMR. Especially in view of recent developments in the field of machine learning that provide novel solutions to address existing problems, it is necessary to bridge the gap between the clinical and scientific communities. This review covers five essential aspects of CMR to provide a comprehensive overview ranging from CVDs to CMR pulse sequence design, acquisition protocols, motion handling, image reconstruction and quantitative analysis of the obtained data. (1) The basic MR physics of CMR is introduced. Basic pulse sequence building blocks that are commonly used in CMR imaging are presented. Sequences containing these building blocks are formed for parametric mapping and functional imaging techniques. Commonly perceived artifacts and potential countermeasures are discussed for these methods. (2) CMR methods for identifying CVDs are illustrated. Basic anatomy and functional processes are described to understand the cardiac pathologies and how they can be captured by CMR imaging. (3) The planning and conduct of a complete CMR exam which is targeted for the respective pathology is shown. Building blocks are illustrated to create an efficient and patient-centered workflow. Further strategies to cope with challenging patients are discussed. (4) Imaging acceleration and reconstruction techniques are presented that enable acquisition of spatial, temporal, and parametric dynamics of the cardiac cycle. The handling of respiratory and cardiac motion strategies as well as their integration into the reconstruction processes is showcased. (5) Recent advances on deep learning-based reconstructions for this purpose are summarized. Furthermore, an overview of novel deep learning image segmentation and analysis methods is provided with a focus on automatic, fast and reliable extraction of biomarkers and parameters of clinical relevance.
Collapse
Affiliation(s)
- Tevfik F. Ismail
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
- Cardiology Department, Guy's and St Thomas' Hospital, London, United Kingdom
| | - Wendy Strugnell
- Queensland X-Ray, Mater Hospital Brisbane, Brisbane, QLD, Australia
| | - Chiara Coletti
- Magnetic Resonance Systems Lab, Delft University of Technology, Delft, Netherlands
| | - Maša Božić-Iven
- Magnetic Resonance Systems Lab, Delft University of Technology, Delft, Netherlands
- Computer Assisted Clinical Medicine, Heidelberg University, Mannheim, Germany
| | | | - Kerstin Hammernik
- Lab for AI in Medicine, Technical University of Munich, Munich, Germany
- Department of Computing, Imperial College London, London, United Kingdom
| | - Teresa Correia
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
- Centre of Marine Sciences, Faro, Portugal
| | - Thomas Küstner
- Medical Image and Data Analysis (MIDAS.lab), Department of Diagnostic and Interventional Radiology, University Hospital of Tübingen, Tübingen, Germany
| |
Collapse
|
4
|
Küstner T, Munoz C, Psenicny A, Bustin A, Fuin N, Qi H, Neji R, Kunze K, Hajhosseiny R, Prieto C, Botnar R. Deep-learning based super-resolution for 3D isotropic coronary MR angiography in less than a minute. Magn Reson Med 2021; 86:2837-2852. [PMID: 34240753 DOI: 10.1002/mrm.28911] [Citation(s) in RCA: 33] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2021] [Revised: 06/08/2021] [Accepted: 06/11/2021] [Indexed: 01/21/2023]
Abstract
PURPOSE To develop and evaluate a novel and generalizable super-resolution (SR) deep-learning framework for motion-compensated isotropic 3D coronary MR angiography (CMRA), which allows free-breathing acquisitions in less than a minute. METHODS Undersampled motion-corrected reconstructions have enabled free-breathing isotropic 3D CMRA in ~5-10 min acquisition times. In this work, we propose a deep-learning-based SR framework, combined with non-rigid respiratory motion compensation, to shorten the acquisition time to less than 1 min. A generative adversarial network (GAN) is proposed consisting of two cascaded Enhanced Deep Residual Network generator, a trainable discriminator, and a perceptual loss network. A 16-fold increase in spatial resolution is achieved by reconstructing a high-resolution (HR) isotropic CMRA (0.9 mm3 or 1.2 mm3 ) from a low-resolution (LR) anisotropic CMRA (0.9 × 3.6 × 3.6 mm3 or 1.2 × 4.8 × 4.8 mm3 ). The impact and generalization of the proposed SRGAN approach to different input resolutions and operation on image and patch-level is investigated. SRGAN was evaluated on a retrospective downsampled cohort of 50 patients and on 16 prospective patients that were scanned with LR-CMRA in ~50 s under free-breathing. Vessel sharpness and length of the coronary arteries from the SR-CMRA is compared against the HR-CMRA. RESULTS SR-CMRA showed statistically significant (P < .001) improved vessel sharpness 34.1% ± 12.3% and length 41.5% ± 8.1% compared with LR-CMRA. Good generalization to input resolution and image/patch-level processing was found. SR-CMRA enabled recovery of coronary stenosis similar to HR-CMRA with comparable qualitative performance. CONCLUSION The proposed SR-CMRA provides a 16-fold increase in spatial resolution with comparable image quality to HR-CMRA while reducing the predictable scan time to <1 min.
Collapse
Affiliation(s)
- Thomas Küstner
- School of Biomedical Engineering and Imaging Sciences, King's College London, St. Thomas' Hospital, London, United Kingdom
- Medical Image and Data Analysis, Department of Interventional and Diagnostic Radiology, University Hospital of Tübingen, Tübingen, Germany
| | - Camila Munoz
- School of Biomedical Engineering and Imaging Sciences, King's College London, St. Thomas' Hospital, London, United Kingdom
| | - Alina Psenicny
- School of Biomedical Engineering and Imaging Sciences, King's College London, St. Thomas' Hospital, London, United Kingdom
| | - Aurelien Bustin
- School of Biomedical Engineering and Imaging Sciences, King's College London, St. Thomas' Hospital, London, United Kingdom
- Centre de recherche Cardio-Thoracique de Bordeaux, IHU LIRYC, Electrophysiology and Heart Modeling Institute, Université de Bordeaux, INSERM, Bordeaux, France
| | - Niccolo Fuin
- School of Biomedical Engineering and Imaging Sciences, King's College London, St. Thomas' Hospital, London, United Kingdom
| | - Haikun Qi
- School of Biomedical Engineering and Imaging Sciences, King's College London, St. Thomas' Hospital, London, United Kingdom
| | - Radhouene Neji
- School of Biomedical Engineering and Imaging Sciences, King's College London, St. Thomas' Hospital, London, United Kingdom
- MR Research Collaborations, Siemens Healthcare Limited, Frimley, United Kingdom
| | - Karl Kunze
- School of Biomedical Engineering and Imaging Sciences, King's College London, St. Thomas' Hospital, London, United Kingdom
- MR Research Collaborations, Siemens Healthcare Limited, Frimley, United Kingdom
| | - Reza Hajhosseiny
- School of Biomedical Engineering and Imaging Sciences, King's College London, St. Thomas' Hospital, London, United Kingdom
| | - Claudia Prieto
- School of Biomedical Engineering and Imaging Sciences, King's College London, St. Thomas' Hospital, London, United Kingdom
- Escuela de Ingeniería, Pontificia Universidad Católica de Chile, Santiago, Chile
| | - René Botnar
- School of Biomedical Engineering and Imaging Sciences, King's College London, St. Thomas' Hospital, London, United Kingdom
- Escuela de Ingeniería, Pontificia Universidad Católica de Chile, Santiago, Chile
| |
Collapse
|
5
|
Kato Y, Ambale-Venkatesh B, Kassai Y, Kasuboski L, Schuijf J, Kapoor K, Caruthers S, Lima JAC. Non-contrast coronary magnetic resonance angiography: current frontiers and future horizons. MAGMA (NEW YORK, N.Y.) 2020; 33:591-612. [PMID: 32242282 PMCID: PMC7502041 DOI: 10.1007/s10334-020-00834-8] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/04/2019] [Revised: 01/22/2020] [Accepted: 01/29/2020] [Indexed: 02/07/2023]
Abstract
Coronary magnetic resonance angiography (coronary MRA) is advantageous in its ability to assess coronary artery morphology and function without ionizing radiation or contrast media. However, technical limitations including reduced spatial resolution, long acquisition times, and low signal-to-noise ratios prevent it from clinical routine utilization. Nonetheless, each of these limitations can be specifically addressed by a combination of novel technologies including super-resolution imaging, compressed sensing, and deep-learning reconstruction. In this paper, we first review the current clinical use and motivations for non-contrast coronary MRA, discuss currently available coronary MRA techniques, and highlight current technical developments that hold unique potential to optimize coronary MRA image acquisition and post-processing. In the final section, we examine the various research-based coronary MRA methods and metrics that can be leveraged to assess coronary stenosis severity, physiological function, and atherosclerotic plaque characterization. We specifically discuss how such technologies may contribute to the clinical translation of coronary MRA into a robust modality for routine clinical use.
Collapse
Affiliation(s)
- Yoko Kato
- Division of Cardiology, Johns Hopkins University School of Medicine, 600 N Wolfe St, Blalock 524, Baltimore, MD, 21287-0409, USA
| | | | | | | | | | - Karan Kapoor
- Division of Cardiology, Johns Hopkins University School of Medicine, 600 N Wolfe St, Blalock 524, Baltimore, MD, 21287-0409, USA
| | | | - Joao A C Lima
- Division of Cardiology, Johns Hopkins University School of Medicine, 600 N Wolfe St, Blalock 524, Baltimore, MD, 21287-0409, USA.
| |
Collapse
|