1
|
Huang H, Huang Y, Kaggie JD, Cai Q, Yang P, Wei J, Wang L, Guo Y, Lu H, Wang H, Xu X. Multiparametric MRI-Based Deep Learning Radiomics Model for Assessing 5-Year Recurrence Risk in Non-Muscle Invasive Bladder Cancer. J Magn Reson Imaging 2024. [PMID: 39167019 DOI: 10.1002/jmri.29574] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2024] [Revised: 08/03/2024] [Accepted: 08/06/2024] [Indexed: 08/23/2024] Open
Abstract
BACKGROUND Accurately assessing 5-year recurrence rates is crucial for managing non-muscle-invasive bladder carcinoma (NMIBC). However, the European Organization for Research and Treatment of Cancer (EORTC) model exhibits poor performance. PURPOSE To investigate whether integrating multiparametric MRI (mp-MRI) with clinical factors improves NMIBC 5-year recurrence risk assessment. STUDY TYPE Retrospective. POPULATION One hundred ninety-one patients (median age, 65 years; age range, 54-73 years; 27 females) underwent mp-MRI between 2011 and 2017, and received ≥5-year follow-ups. They were divided into a training cohort (N = 115) and validation/testing cohorts (N = 38 in each). Recurrence rates were 23.5% (27/115) in the training cohort and 23.7% (9/38) in both validation and testing cohorts. FIELD STRENGTH/SEQUENCE 3-T, fast spin echo T2-weighted imaging (T2WI), single-shot echo planar diffusion-weighted imaging (DWI), and volumetric spoiled gradient echo dynamic contrast-enhanced (DCE) sequences. ASSESSMENT Radiomics and deep learning (DL) features were extracted from the combined region of interest (cROI) including intratumoral and peritumoral areas on mp-MRI. Four models were developed, including clinical, cROI-based radiomics, DL, and clinical-radiomics-DL (CRDL) models. STATISTICAL TESTS Student's t-tests, DeLong's tests with Bonferroni correction, receiver operating characteristics with the area under the curves (AUCs), Cox proportional hazard analyses, Kaplan-Meier plots, SHapley Additive ExPlanations (SHAP) values, and Akaike information criterion for clinical usefulness. A P-value <0.05 was considered statistically significant. RESULTS The cROI-based CRDL model showed superior performance (AUC 0.909; 95% CI: 0.792-0.985) compared to other models in the testing cohort for assessing 5-year recurrence in NMIBC. It achieved the highest Harrell's concordance index (0.804; 95% CI: 0.749-0.859) for estimating recurrence-free survival. SHAP analysis further highlighted the substantial role (22%) of the radiomics features in NMIBC recurrence assessment. DATA CONCLUSION Integrating cROI-based radiomics and DL features from preoperative mp-MRI with clinical factors could improve 5-year recurrence risk assessment in NMIBC. EVIDENCE LEVEL 3 TECHNICAL EFFICACY: Stage 3.
Collapse
Affiliation(s)
- Haolin Huang
- School of Biomedical Engineering, Fourth Military Medical University, Xi'an, Shaanxi, China
- School of Biomedical Engineering & State Key Laboratory of Advanced Medical Materials and Devices, ShanghaiTech University, Shanghai, China
| | - Yiping Huang
- Department of Radiology, The First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, Guangdong, China
| | - Joshua D Kaggie
- Department of Radiology, University of Cambridge, Cambridge, UK
| | - Qian Cai
- Department of Radiology, The First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, Guangdong, China
| | - Peng Yang
- Department of Health Statistics, Ministry of Education Key Lab of Hazard Assessment and Control in Special Operational Environment, School of Public Health, Fourth Military Medical University, Xi'an, Shaanxi, China
| | - Jie Wei
- School of Biomedical Engineering, Fourth Military Medical University, Xi'an, Shaanxi, China
| | - Lijuan Wang
- School of Biomedical Engineering, Fourth Military Medical University, Xi'an, Shaanxi, China
- School of Life Science and Technology, Xi'an Jiaotong University, Xi'an, Shaanxi, China
| | - Yan Guo
- Department of Radiology, The First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, Guangdong, China
| | - Hongbing Lu
- School of Biomedical Engineering, Fourth Military Medical University, Xi'an, Shaanxi, China
| | - Huanjun Wang
- Department of Radiology, The First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, Guangdong, China
- Department of Radiology, University of Cambridge, Cambridge, UK
| | - Xiaopan Xu
- School of Biomedical Engineering, Fourth Military Medical University, Xi'an, Shaanxi, China
| |
Collapse
|
2
|
Morales MA, Manning WJ, Nezafat R. Present and Future Innovations in AI and Cardiac MRI. Radiology 2024; 310:e231269. [PMID: 38193835 PMCID: PMC10831479 DOI: 10.1148/radiol.231269] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Revised: 10/21/2023] [Accepted: 10/26/2023] [Indexed: 01/10/2024]
Abstract
Cardiac MRI is used to diagnose and treat patients with a multitude of cardiovascular diseases. Despite the growth of clinical cardiac MRI, complicated image prescriptions and long acquisition protocols limit the specialty and restrain its impact on the practice of medicine. Artificial intelligence (AI)-the ability to mimic human intelligence in learning and performing tasks-will impact nearly all aspects of MRI. Deep learning (DL) primarily uses an artificial neural network to learn a specific task from example data sets. Self-driving scanners are increasingly available, where AI automatically controls cardiac image prescriptions. These scanners offer faster image collection with higher spatial and temporal resolution, eliminating the need for cardiac triggering or breath holding. In the future, fully automated inline image analysis will most likely provide all contour drawings and initial measurements to the reader. Advanced analysis using radiomic or DL features may provide new insights and information not typically extracted in the current analysis workflow. AI may further help integrate these features with clinical, genetic, wearable-device, and "omics" data to improve patient outcomes. This article presents an overview of AI and its application in cardiac MRI, including in image acquisition, reconstruction, and processing, and opportunities for more personalized cardiovascular care through extraction of novel imaging markers.
Collapse
Affiliation(s)
- Manuel A. Morales
- From the Department of Medicine, Cardiovascular Division (M.A.M.,
W.J.M., R.N.), and Department of Radiology (W.J.M.), Beth Israel Deaconess
Medical Center and Harvard Medical School, 330 Brookline Ave, Boston, MA
02215
| | - Warren J. Manning
- From the Department of Medicine, Cardiovascular Division (M.A.M.,
W.J.M., R.N.), and Department of Radiology (W.J.M.), Beth Israel Deaconess
Medical Center and Harvard Medical School, 330 Brookline Ave, Boston, MA
02215
| | - Reza Nezafat
- From the Department of Medicine, Cardiovascular Division (M.A.M.,
W.J.M., R.N.), and Department of Radiology (W.J.M.), Beth Israel Deaconess
Medical Center and Harvard Medical School, 330 Brookline Ave, Boston, MA
02215
| |
Collapse
|
3
|
Srinivas S, Masutani E, Norbash A, Hsiao A. Deep learning phase error correction for cerebrovascular 4D flow MRI. Sci Rep 2023; 13:9095. [PMID: 37277401 DOI: 10.1038/s41598-023-36061-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Accepted: 05/29/2023] [Indexed: 06/07/2023] Open
Abstract
Background phase errors in 4D Flow MRI may negatively impact blood flow quantification. In this study, we assessed their impact on cerebrovascular flow volume measurements, evaluated the benefit of manual image-based correction, and assessed the potential of a convolutional neural network (CNN), a form of deep learning, to directly infer the correction vector field. With IRB waiver of informed consent, we retrospectively identified 96 MRI exams from 48 patients who underwent cerebrovascular 4D Flow MRI from October 2015 to 2020. Flow measurements of the anterior, posterior, and venous circulation were performed to assess inflow-outflow error and the benefit of manual image-based phase error correction. A CNN was then trained to directly infer the phase-error correction field, without segmentation, from 4D Flow volumes to automate correction, reserving from 23 exams for testing. Statistical analyses included Spearman correlation, Bland-Altman, Wilcoxon-signed rank (WSR) and F-tests. Prior to correction, there was strong correlation between inflow and outflow (ρ = 0.833-0.947) measurements with the largest discrepancy in the venous circulation. Manual phase error correction improved inflow-outflow correlation (ρ = 0.945-0.981) and decreased variance (p < 0.001, F-test). Fully automated CNN correction was non-inferior to manual correction with no significant differences in correlation (ρ = 0.971 vs ρ = 0.982) or bias (p = 0.82, Wilcoxon-Signed Rank test) of inflow and outflow measurements. Residual background phase error can impair inflow-outflow consistency of cerebrovascular flow volume measurements. A CNN can be used to directly infer the phase-error vector field to fully automate phase error correction.
Collapse
Affiliation(s)
- Shanmukha Srinivas
- Department of Radiology, University of California San Diego, 200 West Arbor Drive, San Diego, CA, 92103, USA
- Department of Radiology, University of California Los Angeles, 757 Westwood Plaza, Los Angeles, CA, 90095, USA
| | - Evan Masutani
- Department of Radiology, University of California San Diego, 200 West Arbor Drive, San Diego, CA, 92103, USA
| | - Alexander Norbash
- Department of Radiology, University of California San Diego, 200 West Arbor Drive, San Diego, CA, 92103, USA
| | - Albert Hsiao
- Department of Radiology, University of California San Diego, 200 West Arbor Drive, San Diego, CA, 92103, USA.
| |
Collapse
|
4
|
Masutani EM, Chandrupatla RS, Wang S, Zocchi C, Hahn LD, Horowitz M, Jacobs K, Kligerman S, Raimondi F, Patel A, Hsiao A. Deep Learning Synthetic Strain: Quantitative Assessment of Regional Myocardial Wall Motion at MRI. Radiol Cardiothorac Imaging 2023; 5:e220202. [PMID: 37404797 PMCID: PMC10316298 DOI: 10.1148/ryct.220202] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Revised: 03/07/2023] [Accepted: 03/20/2023] [Indexed: 07/06/2023]
Abstract
Purpose To assess the feasibility of a newly developed algorithm, called deep learning synthetic strain (DLSS), to infer myocardial velocity from cine steady-state free precession (SSFP) images and detect wall motion abnormalities in patients with ischemic heart disease. Materials and Methods In this retrospective study, DLSS was developed by using a data set of 223 cardiac MRI examinations including cine SSFP images and four-dimensional flow velocity data (November 2017 to May 2021). To establish normal ranges, segmental strain was measured in 40 individuals (mean age, 41 years ± 17 [SD]; 30 men) without cardiac disease. Then, DLSS performance in the detection of wall motion abnormalities was assessed in a separate group of patients with coronary artery disease, and these findings were compared with consensus results of four independent cardiothoracic radiologists (ground truth). Algorithm performance was evaluated by using receiver operating characteristic curve analysis. Results Median peak segmental radial strain in individuals with normal cardiac MRI findings was 38% (IQR: 30%-48%). Among patients with ischemic heart disease (846 segments in 53 patients; mean age, 61 years ± 12; 41 men), the Cohen κ among four cardiothoracic readers for detecting wall motion abnormalities was 0.60-0.78. DLSS achieved an area under the receiver operating characteristic curve of 0.90. Using a fixed 30% threshold for abnormal peak radial strain, the algorithm achieved a sensitivity, specificity, and accuracy of 86%, 85%, and 86%, respectively. Conclusion The deep learning algorithm had comparable performance with subspecialty radiologists in inferring myocardial velocity from cine SSFP images and identifying myocardial wall motion abnormalities at rest in patients with ischemic heart disease.Keywords: Neural Networks, Cardiac, MR Imaging, Ischemia/Infarction Supplemental material is available for this article. © RSNA, 2023.
Collapse
|
5
|
Kim D, Jen ML, Eisenmenger LB, Johnson KM. Accelerated 4D-flow MRI with 3-point encoding enabled by machine learning. Magn Reson Med 2023; 89:800-811. [PMID: 36198027 PMCID: PMC9712238 DOI: 10.1002/mrm.29469] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2022] [Revised: 08/22/2022] [Accepted: 09/06/2022] [Indexed: 01/25/2023]
Abstract
PURPOSE To investigate the acceleration of 4D-flow MRI using a convolutional neural network (CNN) that produces three directional velocities from three flow encodings, without requiring a fourth reference scan measuring background phase. METHODS A fully 3D CNN using a U-net architecture was trained in a block-wise fashion to take complex images from three flow encodings and to produce three real-valued images for each velocity component. Using neurovascular 4D-flow scans (n = 144), the CNN was trained to predict velocities computed from four flow encodings by standard reconstruction including correction for residual background phase offsets. Methods to optimize loss functions were investigated, including magnitude, complex difference, and uniform velocity weightings. Subsequently, 3-point encoding was evaluated using cross validation of pixelwise correlation, flow measurements in major arteries, and in experiments with data at differing acceleration rates than the training data. RESULTS The CNN-produced 3-point velocities showed excellent agreements with the 4-point velocities, both qualitatively in velocity images, in flow rate measures, and quantitatively in regression analysis (slope = 0.96, R2 = 0.992). Optimizing the training to focus on vessel velocities rather than the global velocity error and improved the correlation of velocity within vessels themselves. The lowest error was observed when the loss function used uniform velocity weighting, in which the magnitude-weighted inverse of the velocity frequency uniformly distributed weighting across all velocity ranges. When applied to highly accelerated data, the 3-point network maintained a high correlation with ground truth data and demonstrated a denoising effect. CONCLUSION The 4D-flow MRI can be accelerated using machine learning requiring only three flow encodings to produce three-directional velocity maps with small errors.
Collapse
Affiliation(s)
- Dahan Kim
- Department of Physics, University of Wisconsin, Madison, Wisconsin, USA,Department of Medical Physics, University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin, USA
| | - Mu-Lan Jen
- Department of Medical Physics, University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin, USA
| | - Laura B. Eisenmenger
- Department of Radiology, University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin, USA
| | - Kevin M. Johnson
- Department of Medical Physics, University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin, USA,Department of Radiology, University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin, USA
| |
Collapse
|
6
|
Peper ES, van Ooij P, Jung B, Huber A, Gräni C, Bastiaansen JAM. Advances in machine learning applications for cardiovascular 4D flow MRI. Front Cardiovasc Med 2022; 9:1052068. [PMID: 36568555 PMCID: PMC9780299 DOI: 10.3389/fcvm.2022.1052068] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2022] [Accepted: 11/22/2022] [Indexed: 12/13/2022] Open
Abstract
Four-dimensional flow magnetic resonance imaging (MRI) has evolved as a non-invasive imaging technique to visualize and quantify blood flow in the heart and vessels. Hemodynamic parameters derived from 4D flow MRI, such as net flow and peak velocities, but also kinetic energy, turbulent kinetic energy, viscous energy loss, and wall shear stress have shown to be of diagnostic relevance for cardiovascular diseases. 4D flow MRI, however, has several limitations. Its long acquisition times and its limited spatio-temporal resolutions lead to inaccuracies in velocity measurements in small and low-flow vessels and near the vessel wall. Additionally, 4D flow MRI requires long post-processing times, since inaccuracies due to the measurement process need to be corrected for and parameter quantification requires 2D and 3D contour drawing. Several machine learning (ML) techniques have been proposed to overcome these limitations. Existing scan acceleration methods have been extended using ML for image reconstruction and ML based super-resolution methods have been used to assimilate high-resolution computational fluid dynamic simulations and 4D flow MRI, which leads to more realistic velocity results. ML efforts have also focused on the automation of other post-processing steps, by learning phase corrections and anti-aliasing. To automate contour drawing and 3D segmentation, networks such as the U-Net have been widely applied. This review summarizes the latest ML advances in 4D flow MRI with a focus on technical aspects and applications. It is divided into the current status of fast and accurate 4D flow MRI data generation, ML based post-processing tools for phase correction and vessel delineation and the statistical evaluation of blood flow.
Collapse
Affiliation(s)
- Eva S. Peper
- Department of Diagnostic, Interventional and Pediatric Radiology (DIPR), Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland,Translational Imaging Center (TIC), Swiss Institute for Translational and Entrepreneurial Medicine, Bern, Switzerland,*Correspondence: Eva S. Peper,
| | - Pim van Ooij
- Department of Radiology and Nuclear Medicine, Amsterdam University Medical Centers, Amsterdam, Netherlands,Department of Pediatric Cardiology, Wilhelmina Children’s Hospital, University Medical Center Utrecht, Utrecht, Netherlands
| | - Bernd Jung
- Department of Diagnostic, Interventional and Pediatric Radiology (DIPR), Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland,Translational Imaging Center (TIC), Swiss Institute for Translational and Entrepreneurial Medicine, Bern, Switzerland
| | - Adrian Huber
- Department of Diagnostic, Interventional and Pediatric Radiology (DIPR), Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Christoph Gräni
- Department of Cardiology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Jessica A. M. Bastiaansen
- Department of Diagnostic, Interventional and Pediatric Radiology (DIPR), Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland,Translational Imaging Center (TIC), Swiss Institute for Translational and Entrepreneurial Medicine, Bern, Switzerland
| |
Collapse
|
7
|
Lv L, Li H, Wu Z, Zeng W, Hua P, Yang S. An artificial intelligence-based platform for automatically estimating time-averaged wall shear stress in the ascending aorta. EUROPEAN HEART JOURNAL. DIGITAL HEALTH 2022; 3:525-534. [PMID: 36710907 PMCID: PMC9779925 DOI: 10.1093/ehjdh/ztac058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Revised: 09/01/2022] [Accepted: 09/06/2022] [Indexed: 11/07/2022]
Abstract
Aims Aortopathies are a series of disorders requiring multiple indicators to assess risk. Time-averaged wall shear stress (TAWSS) is currently considered as the primary indicator of aortopathies progression, which can only be calculated by Computational Fluid Dynamics (CFD). However, CFD's complexity and high computational cost, greatly limit its application. The study aimed to construct a deep learning platform which could accurately estimate TAWSS in ascending aorta. Methods and results A total of 154 patients who had thoracic computed tomography angiography were included and randomly divided into two parts: training set (90%, n = 139) and testing set (10%, n = 15). TAWSS were calculated via CFD. The artificial intelligence (AI)-based model was trained and assessed using the dice coefficient (DC), normalized mean absolute error (NMAE), and root mean square error (RMSE). Our AI platform brought into correspondence with the manual segmentation (DC = 0.86) and the CFD findings (NMAE, 7.8773% ± 4.7144%; RMSE, 0.0098 ± 0.0097), while saving 12000-fold computational cost. Conclusion The high-efficiency and robust AI platform can automatically estimate value and distribution of TAWSS in ascending aorta, which may be suitable for clinical applications and provide potential ideas for CFD-based problem solving.
Collapse
Affiliation(s)
| | | | - Zonglv Wu
- Department of Cardio-Vascular Surgery, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, No. 107 Yan Jiang West Road, 510120 Guangzhou, China,Department of Cardiac Surgery, Guangzhou Women and Children's Medical Center, No. 9 Jinsui Road, 510623 Guangzhou, China
| | - Weike Zeng
- Department of Radiology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, No. 107 Yanjiang West Road, 510120 Guangzhou, China
| | - Ping Hua
- Corresponding author. Tel: +86 13 609716875, Fax: +86 20 81332199, (P.H.); Tel: +86 13926168990, Fax: +86 20 81332199, (S.R.)
| | - Songran Yang
- Corresponding author. Tel: +86 13 609716875, Fax: +86 20 81332199, (P.H.); Tel: +86 13926168990, Fax: +86 20 81332199, (S.R.)
| |
Collapse
|
8
|
Hyodo R, Takehara Y, Naganawa S. 4D Flow MRI in the portal venous system: imaging and analysis methods, and clinical applications. Radiol Med 2022; 127:1181-1198. [PMID: 36123520 PMCID: PMC9587937 DOI: 10.1007/s11547-022-01553-x] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2022] [Accepted: 08/29/2022] [Indexed: 02/07/2023]
Abstract
Thus far, ultrasound, CT, and 2D cine phase-contrast MRI has been adopted to evaluate blood flow and vascular morphology in the portal venous system; however, all these techniques have some shortcomings, such as limited field of view and difficulty in accurately evaluating blood flow. A new imaging technique, namely 3D cine phase-contrast (4D Flow) MRI, can acquire blood flow data of the entire abdomen at once and in a time-resolved manner, allowing visual, quantitative, and comprehensive assessment of blood flow in the portal venous system. In addition, a retrospective blood flow analysis, i.e., "retrospective flowmetry," is possible. Although the development of 4D Flow MRI for the portal system has been delayed compared to that for the arterial system owing to the lower flow velocity of the portal venous system and the presence of respiratory artifacts, several useful reports have recently been published as the technology has advanced. In the first part of this narrative review article, technical considerations of image acquisition and analysis methods of 4D Flow MRI for the portal venous system and the validations of their results are described. In the second part, the current clinical application of 4D Flow MRI for the portal venous system is reviewed.
Collapse
Affiliation(s)
- Ryota Hyodo
- Department of Radiology, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, 466-8550, Japan.
| | - Yasuo Takehara
- Department of Radiology, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, 466-8550, Japan
- Department of Fundamental Development for Advanced Low Invasive Diagnostic Imaging, Nagoya University Graduate School of Medicine, Nagoya, Japan
| | - Shinji Naganawa
- Department of Radiology, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, 466-8550, Japan
| |
Collapse
|