1
|
Howell HJ, McGale JP, Choucair A, Shirini D, Aide N, Postow MA, Wang L, Tordjman M, Lopci E, Lecler A, Champiat S, Chen DL, Deandreis D, Dercle L. Artificial Intelligence for Drug Discovery: An Update and Future Prospects. Semin Nucl Med 2025:S0001-2998(25)00004-2. [PMID: 39966029 DOI: 10.1053/j.semnuclmed.2025.01.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2025] [Revised: 01/23/2025] [Accepted: 01/24/2025] [Indexed: 02/20/2025]
Abstract
Artificial intelligence (AI) has become a pivotal tool for medical image analysis, significantly enhancing drug discovery through improved diagnostics, staging, prognostication, and response assessment. At a high level, AI-driven image analysis enables the quantification and synthesis of previously qualitative imaging characteristics, facilitating the identification of novel disease-specific biomarkers, patient risk stratification, prognostication, and adverse event prediction. In addition, AI can assist in response assessment by capturing changes in imaging "phenotype" over time, allowing for optimized treatment plans based on real-time analysis. Integrating this emerging technology into drug discovery pipelines has the potential to accelerate the identification and development of new pharmaceuticals by assisting in target identification and patient selection, as well as reducing the incidence, and therefore cost, of failed trials through high-throughput, reproducible, and data-driven insights. Continued progress in AI applications will shape the future of medical imaging, ultimately fostering more efficient, accurate, and tailored drug discovery processes. Herein, we offer a comprehensive overview of how AI enhances medical imaging to inform drug development and therapeutic strategies.
Collapse
Affiliation(s)
- Harrison J Howell
- Department of Radiology, New York-Presbyterian Hospital, Columbia University Vagelos College of Physicians and Surgeons, New York, NY
| | - Jeremy P McGale
- Department of Radiology, New York-Presbyterian Hospital, Columbia University Vagelos College of Physicians and Surgeons, New York, NY
| | | | - Dorsa Shirini
- School of Medicine, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Nicolas Aide
- Centre Havrais d'Imagerie Nucléaire, Octeville, France
| | - Michael A Postow
- Department of Medicine, Memorial Sloan Kettering and Department of Medicine, Weill Cornell Medical College, New York, NY
| | - Lucy Wang
- School of Medicine, New York Medical College, Valhalla, NY
| | - Mickael Tordjman
- Department of Radiology, Biomedical Engineering & Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, NY
| | - Egesta Lopci
- Nuclear Medicine Unit, IRCCS-Humanitas Research Hospital, Rozzano, Italy
| | - Augustin Lecler
- Department of Neuroradiology, Foundation Adolphe de Rothschild Hospital, Université Paris Cité, Paris, France
| | - Stéphane Champiat
- Department of Investigational Cancer Therapeutics, Division of Cancer Medicine, The University of Texas MD Anderson Cancer Center, Houston, TX
| | - Delphine L Chen
- Department of Radiology, University of Washington, Seattle, WA
| | | | - Laurent Dercle
- Department of Radiology, New York-Presbyterian Hospital, Columbia University Vagelos College of Physicians and Surgeons, New York, NY..
| |
Collapse
|
2
|
Klemenz AC, Reichardt L, Gorodezky M, Manzke M, Zhu X, Dalmer A, Lorbeer R, Lang CI, Weber MA, Meinel FG. Accelerated Cardiac MRI with Deep Learning-based Image Reconstruction for Cine Imaging. Radiol Cardiothorac Imaging 2024; 6:e230419. [PMID: 39540821 DOI: 10.1148/ryct.230419] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2024]
Abstract
Purpose To assess the influence of deep learning (DL)-based image reconstruction on acquisition time, volumetric results, and image quality of cine sequences in cardiac MRI. Materials and Methods This prospective study (performed from January 2023 to March 2023) included 55 healthy volunteers who underwent a noncontrast cardiac MRI examination at 1.5 T. Short-axis stack DL cine sequences of the left ventricle (LV) were performed over one (1RR), three (3RR), and six cardiac (6RR) cycles and compared with a standard cine sequence (without DL, performed over 10-12 cardiac cycles) in regard to acquisition time, subjective image quality, edge sharpness, and volumetric results. Results Total acquisition time (median) for a short-axis stack was 47 seconds for the 1RR cine, 108 seconds for 3RR cine, 184 seconds for 6RR cine, and 227 seconds for the standard sequence. Volumetric results showed no difference for the conventional cine (median LV ejection fraction [EF] 63%), 6RR cine (median LVEF, 62%), and 3RR cine (median LVEF, 61%). The 1RR cine sequence significantly underestimated EF (57%) because of a different segmentation of the papillary muscles. Subjective image quality (P = .37) and edge sharpness (P = .06) of the three-heartbeat DL cine did not differ from the reference standard, while both metrics were lower for single-heartbeat DL cine and higher for six-heartbeat DL cine. Conclusion For DL-based cine sequences, acquisition over three cardiac cycles appears to be the optimal compromise, with no evidence of differences in image quality, edge sharpness, and volumetric results, but with a greater than 50% reduced acquisition time compared with the reference sequence. Keywords: MR Imaging, Cardiac, Heart, Technical Aspects, Cardiac MRI, Deep Learning, Clinical Imaging, Accelerated Imaging Supplemental material is available for this article. © RSNA, 2024.
Collapse
Affiliation(s)
- Ann-Christin Klemenz
- From the Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology (A.C.K., L.R., M.M., A.D., M.A.W., F.G.M.), and Department of Cardiology (C.I.L.), Rostock University Medical Center, Schillingallee 36, 18057 Rostock, Germany; GE HealthCare, Munich, Germany (M.G.); GE HealthCare, Menlo Park, Calif (X.Z.); and Department of Radiology, Ludwig-Maximilian University, Munich, Germany (R.L.)
| | - Linda Reichardt
- From the Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology (A.C.K., L.R., M.M., A.D., M.A.W., F.G.M.), and Department of Cardiology (C.I.L.), Rostock University Medical Center, Schillingallee 36, 18057 Rostock, Germany; GE HealthCare, Munich, Germany (M.G.); GE HealthCare, Menlo Park, Calif (X.Z.); and Department of Radiology, Ludwig-Maximilian University, Munich, Germany (R.L.)
| | - Margarita Gorodezky
- From the Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology (A.C.K., L.R., M.M., A.D., M.A.W., F.G.M.), and Department of Cardiology (C.I.L.), Rostock University Medical Center, Schillingallee 36, 18057 Rostock, Germany; GE HealthCare, Munich, Germany (M.G.); GE HealthCare, Menlo Park, Calif (X.Z.); and Department of Radiology, Ludwig-Maximilian University, Munich, Germany (R.L.)
| | - Mathias Manzke
- From the Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology (A.C.K., L.R., M.M., A.D., M.A.W., F.G.M.), and Department of Cardiology (C.I.L.), Rostock University Medical Center, Schillingallee 36, 18057 Rostock, Germany; GE HealthCare, Munich, Germany (M.G.); GE HealthCare, Menlo Park, Calif (X.Z.); and Department of Radiology, Ludwig-Maximilian University, Munich, Germany (R.L.)
| | - Xucheng Zhu
- From the Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology (A.C.K., L.R., M.M., A.D., M.A.W., F.G.M.), and Department of Cardiology (C.I.L.), Rostock University Medical Center, Schillingallee 36, 18057 Rostock, Germany; GE HealthCare, Munich, Germany (M.G.); GE HealthCare, Menlo Park, Calif (X.Z.); and Department of Radiology, Ludwig-Maximilian University, Munich, Germany (R.L.)
| | - Antonia Dalmer
- From the Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology (A.C.K., L.R., M.M., A.D., M.A.W., F.G.M.), and Department of Cardiology (C.I.L.), Rostock University Medical Center, Schillingallee 36, 18057 Rostock, Germany; GE HealthCare, Munich, Germany (M.G.); GE HealthCare, Menlo Park, Calif (X.Z.); and Department of Radiology, Ludwig-Maximilian University, Munich, Germany (R.L.)
| | - Roberto Lorbeer
- From the Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology (A.C.K., L.R., M.M., A.D., M.A.W., F.G.M.), and Department of Cardiology (C.I.L.), Rostock University Medical Center, Schillingallee 36, 18057 Rostock, Germany; GE HealthCare, Munich, Germany (M.G.); GE HealthCare, Menlo Park, Calif (X.Z.); and Department of Radiology, Ludwig-Maximilian University, Munich, Germany (R.L.)
| | - Cajetan I Lang
- From the Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology (A.C.K., L.R., M.M., A.D., M.A.W., F.G.M.), and Department of Cardiology (C.I.L.), Rostock University Medical Center, Schillingallee 36, 18057 Rostock, Germany; GE HealthCare, Munich, Germany (M.G.); GE HealthCare, Menlo Park, Calif (X.Z.); and Department of Radiology, Ludwig-Maximilian University, Munich, Germany (R.L.)
| | - Marc-André Weber
- From the Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology (A.C.K., L.R., M.M., A.D., M.A.W., F.G.M.), and Department of Cardiology (C.I.L.), Rostock University Medical Center, Schillingallee 36, 18057 Rostock, Germany; GE HealthCare, Munich, Germany (M.G.); GE HealthCare, Menlo Park, Calif (X.Z.); and Department of Radiology, Ludwig-Maximilian University, Munich, Germany (R.L.)
| | - Felix G Meinel
- From the Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology (A.C.K., L.R., M.M., A.D., M.A.W., F.G.M.), and Department of Cardiology (C.I.L.), Rostock University Medical Center, Schillingallee 36, 18057 Rostock, Germany; GE HealthCare, Munich, Germany (M.G.); GE HealthCare, Menlo Park, Calif (X.Z.); and Department of Radiology, Ludwig-Maximilian University, Munich, Germany (R.L.)
| |
Collapse
|
3
|
Echefu G, Shah R, Sanchez Z, Rickards J, Brown SA. Artificial intelligence: Applications in cardio-oncology and potential impact on racial disparities. AMERICAN HEART JOURNAL PLUS : CARDIOLOGY RESEARCH AND PRACTICE 2024; 48:100479. [PMID: 39582990 PMCID: PMC11583718 DOI: 10.1016/j.ahjo.2024.100479] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/05/2024] [Revised: 10/25/2024] [Accepted: 10/25/2024] [Indexed: 11/26/2024]
Abstract
Numerous cancer therapies have detrimental cardiovascular effects on cancer survivors. Cardiovascular toxicity can span the course of cancer treatment and is influenced by several factors. To mitigate these risks, cardio-oncology has evolved, with an emphasis on prevention and treatment of cardiovascular complications resulting from the presence of cancer and cancer therapy. Artificial intelligence (AI) holds multifaceted potential to enhance cardio-oncologic outcomes. AI algorithms are currently utilizing clinical data input to identify patients at risk for cardiac complications. Additional application opportunities for AI in cardio-oncology involve multimodal cardiovascular imaging, where algorithms can also utilize imaging input to generate predictive risk profiles for cancer patients. The impact of AI extends to digital health tools, playing a pivotal role in the development of digital platforms and wearable technologies. Multidisciplinary teams have been formed to implement and evaluate the efficacy of these technologies, assessing AI-driven clinical decision support tools. Other avenues similarly support practical application of AI in clinical practice, such as incorporation into electronic health records (EHRs) to detect patients at risk for cardiovascular diseases. While these AI applications may help improve preventive measures and facilitate tailored treatment to patients, they are also capable of perpetuating and exacerbating healthcare disparities, if trained on limited, homogenous datasets. However, if trained and operated appropriately, AI holds substantial promise in positively influencing clinical practice in cardio-oncology. In this review, we explore the impact of AI on cardio-oncology care, particularly regarding predicting cardiotoxicity from cancer treatments, while addressing racial and ethnic biases in algorithmic implementation.
Collapse
Affiliation(s)
- Gift Echefu
- Division of Cardiovascular Medicine, University of Tennessee, Memphis, TN, USA
| | - Rushabh Shah
- Medical College of Wisconsin, Milwaukee, WI, USA
| | - Zanele Sanchez
- School for Advanced Studies, Miami, FL, USA
- Miami Dade College, Miami, FL, USA
| | - John Rickards
- Mercer University School of Medicine, Macon, GA, USA
| | - Sherry-Ann Brown
- Department of Medicine, Medical College of Wisconsin, Milwaukee, WI, USA
- Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN, USA
- Heart Innovation and Equity Research (HIER) Group, Miami, FL, USA
| |
Collapse
|
4
|
Łajczak PM, Jóźwik K. Artificial intelligence and myocarditis-a systematic review of current applications. Heart Fail Rev 2024; 29:1217-1234. [PMID: 39138803 PMCID: PMC11455665 DOI: 10.1007/s10741-024-10431-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 07/30/2024] [Indexed: 08/15/2024]
Abstract
Myocarditis, marked by heart muscle inflammation, poses significant clinical challenges. This study, guided by PRISMA guidelines, explores the expanding role of artificial intelligence (AI) in myocarditis, aiming to consolidate current knowledge and guide future research. Following PRISMA guidelines, a systematic review was conducted across PubMed, Cochrane Reviews, Scopus, Embase, and Web of Science databases. MeSH terms including artificial intelligence, deep learning, machine learning, myocarditis, and inflammatory cardiomyopathy were used. Inclusion criteria involved original articles utilizing AI for myocarditis, while exclusion criteria eliminated reviews, editorials, and non-AI-focused studies. The search yielded 616 articles, with 42 meeting inclusion criteria after screening. The identified articles, spanning diagnostic, survival prediction, and molecular analysis aspects, were analyzed in each subsection. Diagnostic studies showcased the versatility of AI algorithms, achieving high accuracies in myocarditis detection. Survival prediction models exhibited robust discriminatory power, particularly in emergency settings and pediatric populations. Molecular analyses demonstrated AI's potential in deciphering complex immune interactions. This systematic review provides a comprehensive overview of AI applications in myocarditis, highlighting transformative potential in diagnostics, survival prediction, and molecular understanding. Collaborative efforts are crucial for overcoming limitations and realizing AI's full potential in improving myocarditis care.
Collapse
Affiliation(s)
- Paweł Marek Łajczak
- Zbigniew Religa Scientific Club at Biophysics Department, Faculty of Medical Sciences in Zabrze, Medical University of Silesia, Zabrze, Poland.
| | - Kamil Jóźwik
- Zbigniew Religa Scientific Club at Biophysics Department, Faculty of Medical Sciences in Zabrze, Medical University of Silesia, Zabrze, Poland
| |
Collapse
|
5
|
Klemenz AC, Manzke M, Meinel FG. [Artificial intelligence in cardiovascular radiology : Image acquisition, image reconstruction and workflow optimization]. RADIOLOGIE (HEIDELBERG, GERMANY) 2024; 64:766-772. [PMID: 38913176 DOI: 10.1007/s00117-024-01335-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 06/05/2024] [Indexed: 06/25/2024]
Abstract
BACKGROUND Artificial intelligence (AI) has the potential to fundamentally change radiology workflow. OBJECTIVES This review article provides an overview of AI applications in cardiovascular radiology with a focus on image acquisition, image reconstruction, and workflow optimization. MATERIALS AND METHODS First, established applications of AI are presented for cardiovascular computed tomography (CT) and magnetic resonance imaging (MRI). Building on this, we describe the range of applications that are currently being developed and evaluated. The practical benefits, opportunities, and potential risks of artificial intelligence in cardiovascular imaging are critically discussed. The presentation is based on the relevant specialist literature and our own clinical and scientific experience. RESULTS AI-based techniques for image reconstruction are already commercially available and enable dose reduction in cardiovascular CT and accelerated image acquisition in cardiac MRI. Postprocessing of cardiovascular CT and MRI examinations can already be considerably simplified using established AI-based segmentation algorithms. In contrast, the practical benefits of many AI applications aimed at the diagnosis of cardiovascular diseases are less evident. Potential risks such as automation bias and considerations regarding cost efficiency should also be taken into account. CONCLUSIONS In a market characterized by great expectations and rapid technical development, it is important to realistically assess the practical benefits of AI applications for your own hospital or practice.
Collapse
Affiliation(s)
- Ann-Christin Klemenz
- Universitätsmedizin Rostock, Institut für Diagnostische und Interventionelle Radiologie, Kinder- und Neuroradiologie, Schillingallee 36, 18057, Rostock, Deutschland
| | - Mathias Manzke
- Universitätsmedizin Rostock, Institut für Diagnostische und Interventionelle Radiologie, Kinder- und Neuroradiologie, Schillingallee 36, 18057, Rostock, Deutschland
| | - Felix G Meinel
- Universitätsmedizin Rostock, Institut für Diagnostische und Interventionelle Radiologie, Kinder- und Neuroradiologie, Schillingallee 36, 18057, Rostock, Deutschland.
| |
Collapse
|
6
|
Muffoletto M, Xu H, Burns R, Suinesiaputra A, Nasopoulou A, Kunze KP, Neji R, Petersen SE, Niederer SA, Rueckert D, Young AA. Evaluation of deep learning estimation of whole heart anatomy from automated cardiovascular magnetic resonance short- and long-axis analyses in UK Biobank. Eur Heart J Cardiovasc Imaging 2024; 25:1374-1383. [PMID: 38723059 PMCID: PMC11441036 DOI: 10.1093/ehjci/jeae123] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/21/2024] [Revised: 04/10/2024] [Accepted: 04/25/2024] [Indexed: 10/01/2024] Open
Abstract
AIMS Standard methods of heart chamber volume estimation in cardiovascular magnetic resonance (CMR) typically utilize simple geometric formulae based on a limited number of slices. We aimed to evaluate whether an automated deep learning neural network prediction of 3D anatomy of all four chambers would show stronger associations with cardiovascular risk factors and disease than standard volume estimation methods in the UK Biobank. METHODS AND RESULTS A deep learning network was adapted to predict 3D segmentations of left and right ventricles (LV, RV) and atria (LA, RA) at ∼1 mm isotropic resolution from CMR short- and long-axis 2D segmentations obtained from a fully automated machine learning pipeline in 4723 individuals with cardiovascular disease (CVD) and 5733 without in the UK Biobank. Relationships between volumes at end-diastole (ED) and end-systole (ES) and risk/disease factors were quantified using univariate, multivariate, and logistic regression analyses. Strength of association between deep learning volumes and standard volumes was compared using the area under the receiving operator characteristic curve (AUC). Univariate and multivariate associations between deep learning volumes and most risk and disease factors were stronger than for standard volumes (higher R2 and more significant P-values), particularly for sex, age, and body mass index. AUCs for all logistic regressions were higher for deep learning volumes than standard volumes (P < 0.001 for all four chambers at ED and ES). CONCLUSION Neural network reconstructions of whole heart volumes had significantly stronger associations with CVD and risk factors than standard volume estimation methods in an automatic processing pipeline.
Collapse
Affiliation(s)
- Marica Muffoletto
- School of Biomedical Engineering and Imaging Sciences, King's College London, 1 Lambeth Palace Rd, London SE1 7EU, UK
| | - Hao Xu
- School of Biomedical Engineering and Imaging Sciences, King's College London, 1 Lambeth Palace Rd, London SE1 7EU, UK
- College of Mathematical Medicine, Zhejiang Normal University, Zhejiang, China
- Cardiovascular Research Group, Puyang Institute of Big Data and Artificial Intelligence, Henan, China
| | - Richard Burns
- School of Biomedical Engineering and Imaging Sciences, King's College London, 1 Lambeth Palace Rd, London SE1 7EU, UK
| | - Avan Suinesiaputra
- School of Biomedical Engineering and Imaging Sciences, King's College London, 1 Lambeth Palace Rd, London SE1 7EU, UK
| | - Anastasia Nasopoulou
- School of Biomedical Engineering and Imaging Sciences, King's College London, 1 Lambeth Palace Rd, London SE1 7EU, UK
| | - Karl P Kunze
- School of Biomedical Engineering and Imaging Sciences, King's College London, 1 Lambeth Palace Rd, London SE1 7EU, UK
- MR Research Collaborations, Siemens Healthcare Limited, Camberley, UK
| | - Radhouene Neji
- School of Biomedical Engineering and Imaging Sciences, King's College London, 1 Lambeth Palace Rd, London SE1 7EU, UK
| | - Steffen E Petersen
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University London, Charterhouse Square, London EC1M 6BQ, UK
- Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, West Smithfield, London EC1A 7BE, UK
| | - Steven A Niederer
- Cardiac Electro Mechanics Research Group, National Heart & Lung Institute, Imperial College London, London W12 0NN, UK
- Digital Twin Turing Research and Innovation Cluster, The Alan Turing Institute, London NW1 2DB, UK
| | - Daniel Rueckert
- Department of Computing, Biomedical Image Analysis Group, Imperial College London, London, UK
- Institute for Artificial Intelligence and Informatics in Medicine, Klinikum Rechts der Isar, Technical University of Munich, Munich, Germany
| | - Alistair A Young
- School of Biomedical Engineering and Imaging Sciences, King's College London, 1 Lambeth Palace Rd, London SE1 7EU, UK
| |
Collapse
|
7
|
Manzke M, Iseke S, Böttcher B, Klemenz AC, Weber MA, Meinel FG. Development and performance evaluation of fully automated deep learning-based models for myocardial segmentation on T1 mapping MRI data. Sci Rep 2024; 14:18895. [PMID: 39143126 PMCID: PMC11324648 DOI: 10.1038/s41598-024-69529-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2024] [Accepted: 08/06/2024] [Indexed: 08/16/2024] Open
Abstract
To develop a deep learning-based model capable of segmenting the left ventricular (LV) myocardium on native T1 maps from cardiac MRI in both long-axis and short-axis orientations. Models were trained on native myocardial T1 maps from 50 healthy volunteers and 75 patients using manual segmentation as the reference standard. Based on a U-Net architecture, we systematically optimized the model design using two different training metrics (Sørensen-Dice coefficient = DSC and Intersection-over-Union = IOU), two different activation functions (ReLU and LeakyReLU) and various numbers of training epochs. Training with DSC metric and a ReLU activation function over 35 epochs achieved the highest overall performance (mean error in T1 10.6 ± 17.9 ms, mean DSC 0.88 ± 0.07). Limits of agreement between model results and ground truth were from -35.5 to + 36.1 ms. This was superior to the agreement between two human raters (-34.7 to + 59.1 ms). Segmentation was as accurate for long-axis views (mean error T1: 6.77 ± 8.3 ms, mean DSC: 0.89 ± 0.03) as for short-axis images (mean error ΔT1: 11.6 ± 19.7 ms, mean DSC: 0.88 ± 0.08). Fully automated segmentation and quantitative analysis of native myocardial T1 maps is possible in both long-axis and short-axis orientations with very high accuracy.
Collapse
Affiliation(s)
- Mathias Manzke
- Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology, University Medical Centre Rostock, Ernst-Heydemann-Str. 6, 18057, Rostock, Germany
| | - Simon Iseke
- Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology, University Medical Centre Rostock, Ernst-Heydemann-Str. 6, 18057, Rostock, Germany
| | - Benjamin Böttcher
- Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology, University Medical Centre Rostock, Ernst-Heydemann-Str. 6, 18057, Rostock, Germany
| | - Ann-Christin Klemenz
- Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology, University Medical Centre Rostock, Ernst-Heydemann-Str. 6, 18057, Rostock, Germany
| | - Marc-André Weber
- Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology, University Medical Centre Rostock, Ernst-Heydemann-Str. 6, 18057, Rostock, Germany
| | - Felix G Meinel
- Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology, University Medical Centre Rostock, Ernst-Heydemann-Str. 6, 18057, Rostock, Germany.
| |
Collapse
|
8
|
Baccouch W, Oueslati S, Solaiman B, Lahidheb D, Labidi S. Automatic left ventricle volume and mass quantification from 2D cine-MRI: Investigating papillary muscle influence. Med Eng Phys 2024; 127:104162. [PMID: 38692762 DOI: 10.1016/j.medengphy.2024.104162] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2023] [Revised: 03/01/2024] [Accepted: 03/27/2024] [Indexed: 05/03/2024]
Abstract
OBJECTIVE Early detection of cardiovascular diseases is based on accurate quantification of the left ventricle (LV) function parameters. In this paper, we propose a fully automatic framework for LV volume and mass quantification from 2D-cine MR images already segmented using U-Net. METHODS The general framework consists of three main steps: Data preparation including automatic LV localization using a convolution neural network (CNN) and application of morphological operations to exclude papillary muscles from the LV cavity. The second step consists in automatically extracting the LV contours using U-Net architecture. Finally, by integrating temporal information which is manifested by a spatial motion of myocytes as a third dimension, we calculated LV volume, LV ejection fraction (LVEF) and left ventricle mass (LVM). Based on these parameters, we detected and quantified cardiac contraction abnormalities using Python software. RESULTS CNN was trained with 35 patients and tested on 15 patients from the ACDC database with an accuracy of 99,15 %. U-Net architecture was trained using ACDC database and evaluated using local dataset with a Dice similarity coefficient (DSC) of 99,78 % and a Hausdorff Distance (HD) of 4.468 mm (p < 0,001). Quantification results showed a strong correlation with physiological measures with a Pearson correlation coefficient (PCC) of 0,991 for LV volume, 0.962 for LVEF, 0.98 for stroke volume (SV) and 0.923 for LVM after pillars' elimination. Clinically, our method allows regional and accurate identification of pathological myocardial segments and can serve as a diagnostic aid tool of cardiac contraction abnormalities. CONCLUSION Experimental results prove the usefulness of the proposed method for LV volume and function quantification and verify its potential clinical applicability.
Collapse
Affiliation(s)
- Wafa Baccouch
- University of Tunis El Manar, Higher institute of Medical Technologies of Tunis, Research laboratory of Biophysics and Medical Technologies LR13ES07, Tunis, 1006, Tunisia.
| | - Sameh Oueslati
- University of Tunis El Manar, Higher institute of Medical Technologies of Tunis, Research laboratory of Biophysics and Medical Technologies LR13ES07, Tunis, 1006, Tunisia
| | - Basel Solaiman
- Image & Information Processing Department (iTi), IMT-Atlantique, Technopôle Brest Iroise CS 83818, 29238, Brest Cedex, France
| | - Dhaker Lahidheb
- University of Tunis El Manar, Faculty of Medicine of Tunis, Tunis, Tunisia; Department of Cardiology, Military Hospital of Tunis, Tunis, Tunisia
| | - Salam Labidi
- University of Tunis El Manar, Higher institute of Medical Technologies of Tunis, Research laboratory of Biophysics and Medical Technologies LR13ES07, Tunis, 1006, Tunisia
| |
Collapse
|
9
|
Salehi M, Maiter A, Strickland S, Aldabbagh Z, Karunasaagarar K, Thomas R, Lopez-Dee T, Capener D, Dwivedi K, Sharkey M, Metherall P, van der Geest R, Alabed S, Swift AJ. Clinical assessment of an AI tool for measuring biventricular parameters on cardiac MR. Front Cardiovasc Med 2024; 11:1279298. [PMID: 38374997 PMCID: PMC10875016 DOI: 10.3389/fcvm.2024.1279298] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Accepted: 01/22/2024] [Indexed: 02/21/2024] Open
Abstract
Introduction Cardiac magnetic resonance (CMR) is of diagnostic and prognostic value in a range of cardiopulmonary conditions. Current methods for evaluating CMR studies are laborious and time-consuming, contributing to delays for patients. As the demand for CMR increases, there is a growing need to automate this process. The application of artificial intelligence (AI) to CMR is promising, but the evaluation of these tools in clinical practice has been limited. This study assessed the clinical viability of an automatic tool for measuring cardiac volumes on CMR. Methods Consecutive patients who underwent CMR for any indication between January 2022 and October 2022 at a single tertiary centre were included prospectively. For each case, short-axis CMR images were segmented by the AI tool and manually to yield volume, mass and ejection fraction measurements for both ventricles. Automated and manual measurements were compared for agreement and the quality of the automated contours was assessed visually by cardiac radiologists. Results 462 CMR studies were included. No statistically significant difference was demonstrated between any automated and manual measurements (p > 0.05; independent T-test). Intraclass correlation coefficient and Bland-Altman analysis showed excellent agreement across all metrics (ICC > 0.85). The automated contours were evaluated visually in 251 cases, with agreement or minor disagreement in 229 cases (91.2%) and failed segmentation in only a single case (0.4%). The AI tool was able to provide automated contours in under 90 s. Conclusions Automated segmentation of both ventricles on CMR by an automatic tool shows excellent agreement with manual segmentation performed by CMR experts in a retrospective real-world clinical cohort. Implementation of the tool could improve the efficiency of CMR reporting and reduce delays between imaging and diagnosis.
Collapse
Affiliation(s)
- Mahan Salehi
- Department of Radiology, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, United Kingdom
- Department of Infection, Immunity and Cardiovascular Disease, University of Sheffield, Sheffield, United Kingdom
| | - Ahmed Maiter
- Department of Radiology, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, United Kingdom
- Department of Infection, Immunity and Cardiovascular Disease, University of Sheffield, Sheffield, United Kingdom
- Department of Cardiovascular Disease, NIHR Sheffield Biomedical Research Centre, Sheffield, United Kingdom
| | - Scarlett Strickland
- Department of Radiology, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, United Kingdom
| | - Ziad Aldabbagh
- Department of Radiology, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, United Kingdom
| | - Kavita Karunasaagarar
- Department of Radiology, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, United Kingdom
| | - Richard Thomas
- Department of Radiology, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, United Kingdom
| | - Tristan Lopez-Dee
- Department of Radiology, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, United Kingdom
| | - Dave Capener
- Department of Radiology, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, United Kingdom
| | - Krit Dwivedi
- Department of Radiology, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, United Kingdom
- Department of Infection, Immunity and Cardiovascular Disease, University of Sheffield, Sheffield, United Kingdom
| | - Michael Sharkey
- Department of Infection, Immunity and Cardiovascular Disease, University of Sheffield, Sheffield, United Kingdom
| | - Pete Metherall
- Department of Radiology, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, United Kingdom
| | - Rob van der Geest
- Division of Image Processing, Department of Radiology, Leiden University Medical Center, Leiden, Netherlands
| | - Samer Alabed
- Department of Radiology, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, United Kingdom
- Department of Infection, Immunity and Cardiovascular Disease, University of Sheffield, Sheffield, United Kingdom
- Department of Cardiovascular Disease, NIHR Sheffield Biomedical Research Centre, Sheffield, United Kingdom
| | - Andrew J. Swift
- Department of Radiology, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, United Kingdom
- Department of Infection, Immunity and Cardiovascular Disease, University of Sheffield, Sheffield, United Kingdom
- Department of Cardiovascular Disease, NIHR Sheffield Biomedical Research Centre, Sheffield, United Kingdom
| |
Collapse
|
10
|
Farah L, Davaze-Schneider J, Martin T, Nguyen P, Borget I, Martelli N. Are current clinical studies on artificial intelligence-based medical devices comprehensive enough to support a full health technology assessment? A systematic review. Artif Intell Med 2023; 140:102547. [PMID: 37210155 DOI: 10.1016/j.artmed.2023.102547] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Revised: 03/28/2023] [Accepted: 04/04/2023] [Indexed: 05/22/2023]
Abstract
INTRODUCTION Artificial Intelligence-based Medical Devices (AI-based MDs) are experiencing exponential growth in healthcare. This study aimed to investigate whether current studies assessing AI contain the information required for health technology assessment (HTA) by HTA bodies. METHODS We conducted a systematic literature review based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses methodology to extract articles published between 2016 and 2021 related to the assessment of AI-based MDs. Data extraction focused on study characteristics, technology, algorithms, comparators, and results. AI quality assessment and HTA scores were calculated to evaluate whether the items present in the included studies were concordant with the HTA requirements. We performed a linear regression for the HTA and AI scores with the explanatory variables of the impact factor, publication date, and medical specialty. We conducted a univariate analysis of the HTA score and a multivariate analysis of the AI score with an alpha risk of 5 %. RESULTS Of 5578 retrieved records, 56 were included. The mean AI quality assessment score was 67 %; 32 % of articles had an AI quality score ≥ 70 %, 50 % had a score between 50 % and 70 %, and 18 % had a score under 50 %. The highest quality scores were observed for the study design (82 %) and optimisation (69 %) categories, whereas the scores were lowest in the clinical practice category (23 %). The mean HTA score was 52 % for all seven domains. 100 % of the studies assessed clinical effectiveness, whereas only 9 % evaluated safety, and 20 % evaluated economic issues. There was a statistically significant relationship between the impact factor and the HTA and AI scores (both p = 0.046). DISCUSSION Clinical studies on AI-based MDs have limitations and often lack adapted, robust, and complete evidence. High-quality datasets are also required because the output data can only be trusted if the inputs are reliable. The existing assessment frameworks are not specifically designed to assess AI-based MDs. From the perspective of regulatory authorities, we suggest that these frameworks should be adapted to assess the interpretability, explainability, cybersecurity, and safety of ongoing updates. From the perspective of HTA agencies, we highlight that transparency, professional and patient acceptance, ethical issues, and organizational changes are required for the implementation of these devices. Economic assessments of AI should rely on a robust methodology (business impact or health economic models) to provide decision-makers with more reliable evidence. CONCLUSION Currently, AI studies are insufficient to cover HTA prerequisites. HTA processes also need to be adapted because they do not consider the important specificities of AI-based MDs. Specific HTA workflows and accurate assessment tools should be designed to standardise evaluations, generate reliable evidence, and create confidence.
Collapse
Affiliation(s)
- Line Farah
- Groupe de Recherche et d'accueil en Droit et Economie de la Santé (GRADES) Department, University Paris-Saclay, Orsay, France; Innovation Center for Medical Devices, Foch Hospital, 40 Rue Worth, 92150 Suresnes, France.
| | - Julie Davaze-Schneider
- Pharmacy Department, Georges Pompidou European Hospital, AP-HP, 20 Rue Leblanc, 75015 Paris, France
| | - Tess Martin
- Groupe de Recherche et d'accueil en Droit et Economie de la Santé (GRADES) Department, University Paris-Saclay, Orsay, France; Pharmacy Department, Georges Pompidou European Hospital, AP-HP, 20 Rue Leblanc, 75015 Paris, France
| | - Pierre Nguyen
- Pharmacy Department, Georges Pompidou European Hospital, AP-HP, 20 Rue Leblanc, 75015 Paris, France
| | - Isabelle Borget
- Groupe de Recherche et d'accueil en Droit et Economie de la Santé (GRADES) Department, University Paris-Saclay, Orsay, France; Department of Biostatistics and Epidemiology, Gustave Roussy, University Paris-Saclay, 94805 Villejuif, France; Oncostat U1018, Inserm, University Paris-Saclay, Équipe Labellisée Ligue Contre le Cancer, Villejuif, France
| | - Nicolas Martelli
- Groupe de Recherche et d'accueil en Droit et Economie de la Santé (GRADES) Department, University Paris-Saclay, Orsay, France; Pharmacy Department, Georges Pompidou European Hospital, AP-HP, 20 Rue Leblanc, 75015 Paris, France
| |
Collapse
|
11
|
Jafari M, Shoeibi A, Khodatars M, Ghassemi N, Moridian P, Alizadehsani R, Khosravi A, Ling SH, Delfan N, Zhang YD, Wang SH, Gorriz JM, Alinejad-Rokny H, Acharya UR. Automated diagnosis of cardiovascular diseases from cardiac magnetic resonance imaging using deep learning models: A review. Comput Biol Med 2023; 160:106998. [PMID: 37182422 DOI: 10.1016/j.compbiomed.2023.106998] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2022] [Revised: 03/01/2023] [Accepted: 04/28/2023] [Indexed: 05/16/2023]
Abstract
In recent years, cardiovascular diseases (CVDs) have become one of the leading causes of mortality globally. At early stages, CVDs appear with minor symptoms and progressively get worse. The majority of people experience symptoms such as exhaustion, shortness of breath, ankle swelling, fluid retention, and other symptoms when starting CVD. Coronary artery disease (CAD), arrhythmia, cardiomyopathy, congenital heart defect (CHD), mitral regurgitation, and angina are the most common CVDs. Clinical methods such as blood tests, electrocardiography (ECG) signals, and medical imaging are the most effective methods used for the detection of CVDs. Among the diagnostic methods, cardiac magnetic resonance imaging (CMRI) is increasingly used to diagnose, monitor the disease, plan treatment and predict CVDs. Coupled with all the advantages of CMR data, CVDs diagnosis is challenging for physicians as each scan has many slices of data, and the contrast of it might be low. To address these issues, deep learning (DL) techniques have been employed in the diagnosis of CVDs using CMR data, and much research is currently being conducted in this field. This review provides an overview of the studies performed in CVDs detection using CMR images and DL techniques. The introduction section examined CVDs types, diagnostic methods, and the most important medical imaging techniques. The following presents research to detect CVDs using CMR images and the most significant DL methods. Another section discussed the challenges in diagnosing CVDs from CMRI data. Next, the discussion section discusses the results of this review, and future work in CVDs diagnosis from CMR images and DL techniques are outlined. Finally, the most important findings of this study are presented in the conclusion section.
Collapse
Affiliation(s)
- Mahboobeh Jafari
- Internship in BioMedical Machine Learning Lab, The Graduate School of Biomedical Engineering, UNSW Sydney, Sydney, NSW, 2052, Australia
| | - Afshin Shoeibi
- Internship in BioMedical Machine Learning Lab, The Graduate School of Biomedical Engineering, UNSW Sydney, Sydney, NSW, 2052, Australia; Data Science and Computational Intelligence Institute, University of Granada, Spain.
| | - Marjane Khodatars
- Data Science and Computational Intelligence Institute, University of Granada, Spain
| | - Navid Ghassemi
- Internship in BioMedical Machine Learning Lab, The Graduate School of Biomedical Engineering, UNSW Sydney, Sydney, NSW, 2052, Australia
| | - Parisa Moridian
- Data Science and Computational Intelligence Institute, University of Granada, Spain
| | - Roohallah Alizadehsani
- Institute for Intelligent Systems Research and Innovation, Deakin University, Geelong, Australia
| | - Abbas Khosravi
- Institute for Intelligent Systems Research and Innovation, Deakin University, Geelong, Australia
| | - Sai Ho Ling
- Faculty of Engineering and IT, University of Technology Sydney (UTS), Australia
| | - Niloufar Delfan
- Faculty of Computer Engineering, Dept. of Artificial Intelligence Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Yu-Dong Zhang
- School of Computing and Mathematical Sciences, University of Leicester, Leicester, UK
| | - Shui-Hua Wang
- School of Computing and Mathematical Sciences, University of Leicester, Leicester, UK
| | - Juan M Gorriz
- Data Science and Computational Intelligence Institute, University of Granada, Spain; Department of Psychiatry, University of Cambridge, UK
| | - Hamid Alinejad-Rokny
- BioMedical Machine Learning Lab, The Graduate School of Biomedical Engineering, UNSW Sydney, Sydney, NSW, 2052, Australia; UNSW Data Science Hub, The University of New South Wales, Sydney, NSW, 2052, Australia; Health Data Analytics Program, Centre for Applied Artificial Intelligence, Macquarie University, Sydney, 2109, Australia
| | - U Rajendra Acharya
- School of Mathematics, Physics and Computing, University of Southern Queensland, Springfield, Australia; Dept. of Biomedical Informatics and Medical Engineering, Asia University, Taichung, Taiwan
| |
Collapse
|
12
|
Montalt-Tordera J, Pajaziti E, Jones R, Sauvage E, Puranik R, Singh AAV, Capelli C, Steeden J, Schievano S, Muthurangu V. Automatic segmentation of the great arteries for computational hemodynamic assessment. J Cardiovasc Magn Reson 2022; 24:57. [PMID: 36336682 PMCID: PMC9639271 DOI: 10.1186/s12968-022-00891-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2021] [Accepted: 10/03/2022] [Indexed: 11/09/2022] Open
Abstract
BACKGROUND Computational fluid dynamics (CFD) is increasingly used for the assessment of blood flow conditions in patients with congenital heart disease (CHD). This requires patient-specific anatomy, typically obtained from segmented 3D cardiovascular magnetic resonance (CMR) images. However, segmentation is time-consuming and requires expert input. This study aims to develop and validate a machine learning (ML) method for segmentation of the aorta and pulmonary arteries for CFD studies. METHODS 90 CHD patients were retrospectively selected for this study. 3D CMR images were manually segmented to obtain ground-truth (GT) background, aorta and pulmonary artery labels. These were used to train and optimize a U-Net model, using a 70-10-10 train-validation-test split. Segmentation performance was primarily evaluated using Dice score. CFD simulations were set up from GT and ML segmentations using a semi-automatic meshing and simulation pipeline. Mean pressure and velocity fields across 99 planes along the vessel centrelines were extracted, and a mean average percentage error (MAPE) was calculated for each vessel pair (ML vs GT). A second observer (SO) segmented the test dataset for assessment of inter-observer variability. Friedman tests were used to compare ML vs GT, SO vs GT and ML vs SO metrics, and pressure/velocity field errors. RESULTS The network's Dice score (ML vs GT) was 0.945 (interquartile range: 0.929-0.955) for the aorta and 0.885 (0.851-0.899) for the pulmonary arteries. Differences with the inter-observer Dice score (SO vs GT) and ML vs SO Dice scores were not statistically significant for either aorta or pulmonary arteries (p = 0.741, p = 0.061). The ML vs GT MAPEs for pressure and velocity in the aorta were 10.1% (8.5-15.7%) and 4.1% (3.1-6.9%), respectively, and for the pulmonary arteries 14.6% (11.5-23.2%) and 6.3% (4.3-7.9%), respectively. Inter-observer (SO vs GT) and ML vs SO pressure and velocity MAPEs were of a similar magnitude to ML vs GT (p > 0.2). CONCLUSIONS ML can successfully segment the great vessels for CFD, with errors similar to inter-observer variability. This fast, automatic method reduces the time and effort needed for CFD analysis, making it more attractive for routine clinical use.
Collapse
Affiliation(s)
| | | | - Rod Jones
- Great Ormond Street Hospital, London, UK
| | - Emilie Sauvage
- UCL Institute of Cardiovascular Science, UCL, London, UK
| | - Rajesh Puranik
- Children’s Hospital at Westmead, Sydney, Australia
- Faculty of Medicine and Health, University of Sydney, Sydney, Australia
| | - Aakansha Ajay Vir Singh
- Children’s Hospital at Westmead, Sydney, Australia
- Faculty of Medicine and Health, University of Sydney, Sydney, Australia
| | | | | | | | | |
Collapse
|
13
|
Lim RP, Kachel S, Villa ADM, Kearney L, Bettencourt N, Young AA, Chiribiri A, Scannell CM. CardiSort: a convolutional neural network for cross vendor automated sorting of cardiac MR images. Eur Radiol 2022; 32:5907-5920. [PMID: 35368227 PMCID: PMC9381634 DOI: 10.1007/s00330-022-08724-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2022] [Revised: 01/22/2022] [Accepted: 03/05/2022] [Indexed: 01/19/2023]
Abstract
OBJECTIVES To develop an image-based automatic deep learning method to classify cardiac MR images by sequence type and imaging plane for improved clinical post-processing efficiency. METHODS Multivendor cardiac MRI studies were retrospectively collected from 4 centres and 3 vendors. A two-head convolutional neural network ('CardiSort') was trained to classify 35 sequences by imaging sequence (n = 17) and plane (n = 10). Single vendor training (SVT) on single-centre images (n = 234 patients) and multivendor training (MVT) with multicentre images (n = 434 patients, 3 centres) were performed. Model accuracy and F1 scores on a hold-out test set were calculated, with ground truth labels by an expert radiologist. External validation of MVT (MVTexternal) was performed on data from 3 previously unseen magnet systems from 2 vendors (n = 80 patients). RESULTS Model sequence/plane/overall accuracy and F1-scores were 85.2%/93.2%/81.8% and 0.82 for SVT and 96.1%/97.9%/94.3% and 0.94 MVT on the hold-out test set. MVTexternal yielded sequence/plane/combined accuracy and F1-scores of 92.7%/93.0%/86.6% and 0.86. There was high accuracy for common sequences and conventional cardiac planes. Poor accuracy was observed for underrepresented classes and sequences where there was greater variability in acquisition parameters across centres, such as perfusion imaging. CONCLUSIONS A deep learning network was developed on multivendor data to classify MRI studies into component sequences and planes, with external validation. With refinement, it has potential to improve workflow by enabling automated sequence selection, an important first step in completely automated post-processing pipelines. KEY POINTS • Deep learning can be applied for consistent and efficient classification of cardiac MR image types. • A multicentre, multivendor study using a deep learning algorithm (CardiSort) showed high classification accuracy on a hold-out test set with good generalisation to images from previously unseen magnet systems. • CardiSort has potential to improve clinical workflows, as a vital first step in developing fully automated post-processing pipelines.
Collapse
Affiliation(s)
- Ruth P Lim
- Austin Health, Melbourne, Australia.
- Departments of Radiology, The University of Melbourne, Melbourne, Australia.
- Department of Surgery (Austin), The University of Melbourne, Melbourne, Australia.
| | - Stefan Kachel
- Austin Health, Melbourne, Australia
- Departments of Radiology, The University of Melbourne, Melbourne, Australia
- Department of Radiology, Columbia University, New York, USA
| | - Adriana D M Villa
- School of Biomedical Engineering and Imaging Sciences, Kings College London, London, UK
| | - Leighton Kearney
- Austin Health, Melbourne, Australia
- I-MED Radiology, Melbourne, Australia
| | | | - Alistair A Young
- School of Biomedical Engineering and Imaging Sciences, Kings College London, London, UK
| | - Amedeo Chiribiri
- School of Biomedical Engineering and Imaging Sciences, Kings College London, London, UK
| | - Cian M Scannell
- School of Biomedical Engineering and Imaging Sciences, Kings College London, London, UK
| |
Collapse
|
14
|
Guo J, Lu H, Chen Y, Zeng M, Jin H. Artificial intelligence study on left ventricular function among normal individuals, hypertrophic cardiomyopathy and dilated cardiomyopathy patients using 1.5T cardiac cine MR images obtained by SSFP sequence. Br J Radiol 2022; 95:20201060. [PMID: 35084208 PMCID: PMC10993976 DOI: 10.1259/bjr.20201060] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2020] [Revised: 01/06/2022] [Accepted: 01/13/2022] [Indexed: 11/05/2022] Open
Abstract
OBJECTIVES To evaluate the performance of a deep learning-based method to automatically quantify left ventricular (LV) function from MR images in different cardiomyopathy. METHODS This retrospective study included MRI data sets from 2013 to 2020. Data on left ventricular function from patients with hypertrophic cardiomyopathy (HCM), patients with dilated cardiomyopathy (DCM), and healthy participants were analyzed. MRI data from a total of 388 patients were measured manually and automatically.The performance of Convolutional Neural Networks (CNNs) was evaluated based on the manual notes of two experienced observers: (a) LV segmentation accuracy, and (b) LV functional parameter accuracy. Bland-Altman analysis, Receiver operating Characteristic (ROC) curve analysis and Pearson correlation analysis were used to evaluate the consistency between fully automatic and manual diagnosis of HCM and DCM. RESULTS The deep-learning CNN performed best in HCM in evaluating LV function and worst in DCM. Compared with manual analysis, four parameters of LV function in the HCM group showed high correlation (r at least >0.901), and the correlation of DCM in all parameters was weaker than that of HCM, especially EF (r2 = 0.776) and SV (r2 = 0.645). ROC curve analysis indicated that at the optimal cut-off value, EF from automatic segmentation identified DCM and HCM patients with sensitivity of 92.31 and 78.05%, specificity of 82.96 and 54.07%, respectively. CONCLUSION Among different heart diseases, the analysis of cardiac function based on deep-learning CNN may have different performances, with DCM performing the worst and HCM the best and thus, special attention should be paid to DCM patients when assessing LV function through artificial intelligence method. LV function parameter obtained by artificial intelligence method may play an important role in the future AI diagnosis of HCM and DCM. ADVANCES IN KNOWLEDGE These data for the first time objectively evaluate the performance of a commercially available deep learning-based method in cardiac function evaluation of different cardiomyopathy and point out its advantages and disadvantages in different cardiomyopathy. This work did not attempt to design the algorithm itself, but rather applied an already existing method to a test dataset of clinical data and evaluated the results for a limited number of cardiomyopathy.
Collapse
Affiliation(s)
- Jiajun Guo
- Department of Radiology, Zhongshan Hospital, Fudan University,
and Shanghai Institute of Medical Imaging,
Shanghai, China
- Department of Medical Imaging, Shanghai Medical school Fudan
University, Shanghai,
China
| | - HongFei Lu
- Department of Radiology, Zhongshan Hospital, Fudan University,
and Shanghai Institute of Medical Imaging,
Shanghai, China
- Department of Medical Imaging, Shanghai Medical school Fudan
University, Shanghai,
China
| | - Yinyin Chen
- Department of Radiology, Zhongshan Hospital, Fudan University,
and Shanghai Institute of Medical Imaging,
Shanghai, China
- Department of Medical Imaging, Shanghai Medical school Fudan
University, Shanghai,
China
| | - Mengsu Zeng
- Department of Radiology, Zhongshan Hospital, Fudan University,
and Shanghai Institute of Medical Imaging,
Shanghai, China
- Department of Medical Imaging, Shanghai Medical school Fudan
University, Shanghai,
China
| | - Hang Jin
- Department of Radiology, Zhongshan Hospital, Fudan University,
and Shanghai Institute of Medical Imaging,
Shanghai, China
- Department of Medical Imaging, Shanghai Medical school Fudan
University, Shanghai,
China
| |
Collapse
|
15
|
Evertz R, Lange T, Backhaus SJ, Schulz A, Beuthner BE, Topci R, Toischer K, Puls M, Kowallick JT, Hasenfuß G, Schuster A. Artificial Intelligence Enabled Fully Automated CMR Function Quantification for Optimized Risk Stratification in Patients Undergoing Transcatheter Aortic Valve Replacement. J Interv Cardiol 2022; 2022:1368878. [PMID: 35539443 PMCID: PMC9046000 DOI: 10.1155/2022/1368878] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2021] [Revised: 12/20/2021] [Accepted: 03/21/2022] [Indexed: 12/04/2022] Open
Abstract
Background Cardiovascular magnetic resonance imaging is considered the reference standard for assessing cardiac morphology and function and has demonstrated prognostic utility in patients undergoing transcatheter aortic valve replacement (TAVR). Novel fully automated analyses may facilitate data analyses but have not yet been compared against conventional manual data acquisition in patients with severe aortic stenosis (AS). Methods Fully automated and manual biventricular assessments were performed in 139 AS patients scheduled for TAVR using commercially available software (suiteHEART®, Neosoft; QMass®, Medis Medical Imaging Systems). Volumetric assessment included left ventricular (LV) mass, LV/right ventricular (RV) end-diastolic/end-systolic volume, LV/RV stroke volume, and LV/RV ejection fraction (EF). Results of fully automated and manual analyses were compared. Regression analyses and receiver operator characteristics including area under the curve (AUC) calculation for prediction of the primary study endpoint cardiovascular (CV) death were performed. Results Fully automated and manual assessment of LVEF revealed similar prediction of CV mortality in univariable (manual: hazard ratio (HR) 0.970 (95% CI 0.943-0.997) p=0.032; automated: HR 0.967 (95% CI 0.939-0.995) p=0.022) and multivariable analyses (model 1: (including significant univariable parameters) manual: HR 0.968 (95% CI 0.938-0.999) p=0.043; automated: HR 0.963 [95% CI 0.933-0.995] p=0.024; model 2: (including CV risk factors) manual: HR 0.962 (95% CI 0.920-0.996) p=0.027; automated: HR 0.954 (95% CI 0.920-0.989) p=0.011). There were no differences in AUC (LVEF fully automated: 0.686; manual: 0.661; p=0.21). Absolute values of LV volumes differed significantly between automated and manual approaches (p < 0.001 for all). Fully automated quantification resulted in a time saving of 10 minutes per patient. Conclusion Fully automated biventricular volumetric assessments enable efficient and equal risk prediction compared to conventional manual approaches. In addition to significant time saving, this may provide the tools for optimized clinical management and stratification of patients with severe AS undergoing TAVR.
Collapse
Affiliation(s)
- Ruben Evertz
- University Medical Center Göttingen (UMG), Department of Cardiology and Pneumology, Göttingen, Germany
- German Center for Cardiovascular Research (DZHK), Partner Site Göttingen, Göttingen, Germany
| | - Torben Lange
- University Medical Center Göttingen (UMG), Department of Cardiology and Pneumology, Göttingen, Germany
- German Center for Cardiovascular Research (DZHK), Partner Site Göttingen, Göttingen, Germany
| | - Sören J. Backhaus
- University Medical Center Göttingen (UMG), Department of Cardiology and Pneumology, Göttingen, Germany
- German Center for Cardiovascular Research (DZHK), Partner Site Göttingen, Göttingen, Germany
| | - Alexander Schulz
- University Medical Center Göttingen (UMG), Department of Cardiology and Pneumology, Göttingen, Germany
- German Center for Cardiovascular Research (DZHK), Partner Site Göttingen, Göttingen, Germany
| | - Bo Eric Beuthner
- University Medical Center Göttingen (UMG), Department of Cardiology and Pneumology, Göttingen, Germany
- German Center for Cardiovascular Research (DZHK), Partner Site Göttingen, Göttingen, Germany
| | - Rodi Topci
- University Medical Center Göttingen (UMG), Department of Cardiology and Pneumology, Göttingen, Germany
- German Center for Cardiovascular Research (DZHK), Partner Site Göttingen, Göttingen, Germany
| | - Karl Toischer
- University Medical Center Göttingen (UMG), Department of Cardiology and Pneumology, Göttingen, Germany
- German Center for Cardiovascular Research (DZHK), Partner Site Göttingen, Göttingen, Germany
| | - Miriam Puls
- University Medical Center Göttingen (UMG), Department of Cardiology and Pneumology, Göttingen, Germany
- German Center for Cardiovascular Research (DZHK), Partner Site Göttingen, Göttingen, Germany
| | - Johannes T. Kowallick
- German Center for Cardiovascular Research (DZHK), Partner Site Göttingen, Göttingen, Germany
- University Medical Center Göttingen (UMG), Department of Diagnostic & Interventional Radiology, Göttingen, Germany
| | - Gerd Hasenfuß
- University Medical Center Göttingen (UMG), Department of Cardiology and Pneumology, Göttingen, Germany
- German Center for Cardiovascular Research (DZHK), Partner Site Göttingen, Göttingen, Germany
| | - Andreas Schuster
- University Medical Center Göttingen (UMG), Department of Cardiology and Pneumology, Göttingen, Germany
- German Center for Cardiovascular Research (DZHK), Partner Site Göttingen, Göttingen, Germany
| |
Collapse
|
16
|
Madan N, Lucas J, Akhter N, Collier P, Cheng F, Guha A, Zhang L, Sharma A, Hamid A, Ndiokho I, Wen E, Garster NC, Scherrer-Crosbie M, Brown SA. Artificial intelligence and imaging: Opportunities in cardio-oncology. AMERICAN HEART JOURNAL PLUS : CARDIOLOGY RESEARCH AND PRACTICE 2022; 15:100126. [PMID: 35693323 PMCID: PMC9187287 DOI: 10.1016/j.ahjo.2022.100126] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/31/2021] [Revised: 03/20/2022] [Accepted: 03/21/2022] [Indexed: 12/29/2022]
Abstract
Cardiovascular disease is a leading cause of death in cancer survivors. It is critical to apply new predictive and early diagnostic methods in this population, as this can potentially inform cardiovascular treatment and surveillance decision-making. We discuss the application of artificial intelligence (AI) technologies to cardiovascular imaging in cardio-oncology, with a particular emphasis on prevention and targeted treatment of a variety of cardiovascular conditions in cancer patients. Recently, the use of AI-augmented cardiac imaging in cardio-oncology is gaining traction. A large proportion of cardio-oncology patients are screened and followed using left ventricular ejection fraction (LVEF) and global longitudinal strain (GLS), currently obtained using echocardiography. This use will continue to increase with new cardiotoxic cancer treatments. AI is being tested to increase precision, throughput, and accuracy of LVEF and GLS, guide point-of-care image acquisition, and integrate imaging and clinical data to optimize the prediction and detection of cardiac dysfunction. The application of AI to cardiovascular magnetic resonance imaging (CMR), computed tomography (CT; especially coronary artery calcium or CAC scans), single proton emission computed tomography (SPECT) and positron emission tomography (PET) imaging acquisition is also in early stages of analysis for prediction and assessment of cardiac tumors and cardiovascular adverse events in patients treated for childhood or adult cancer. The opportunities for application of AI in cardio-oncology imaging are promising, and if availed, will improve clinical practice and benefit patient care.
Collapse
Affiliation(s)
- Nidhi Madan
- Division of Cardiology, Rush University Medical Center, Chicago, IL, USA
| | | | - Nausheen Akhter
- Division of Cardiology, Northwestern University, Chicago, IL, USA
| | - Patrick Collier
- Robert and Suzanne Tomsich Department of Cardiovascular Medicine, Sydell and Arnold Miller Family Heart and Vascular Institute, Cleveland Clinic, Cleveland, OH, USA
| | - Feixiong Cheng
- Genomic Medicine Institute, Lerner Research Institute, Cleveland Clinic, Cleveland, OH, USA
| | - Avirup Guha
- Harrington Heart and Vascular Institute, Cleveland, OH, USA
| | - Lili Zhang
- Cardio-Oncology Program, Division of Cardiology, Department of Medicine, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY, USA
| | - Abhinav Sharma
- Division of Cardiovascular Medicine, Medical College of Wisconsin, Milwaukee, WI, USA
| | | | - Imeh Ndiokho
- Medical College of Wisconsin, Milwaukee, WI, USA
| | - Ethan Wen
- Medical College of Wisconsin, Milwaukee, WI, USA
| | - Noelle C. Garster
- Division of Cardiovascular Medicine, Medical College of Wisconsin, Milwaukee, WI, USA
| | | | - Sherry-Ann Brown
- Cardio-Oncology Program, Division of Cardiovascular Medicine, Medical College of Wisconsin, Milwaukee, WI, USA
| |
Collapse
|
17
|
Taylor AM. The role of artificial intelligence in paediatric cardiovascular magnetic resonance imaging. Pediatr Radiol 2022; 52:2131-2138. [PMID: 34936019 PMCID: PMC9537201 DOI: 10.1007/s00247-021-05218-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/05/2021] [Revised: 08/13/2021] [Accepted: 10/05/2021] [Indexed: 11/24/2022]
Abstract
Artificial intelligence (AI) offers the potential to change many aspects of paediatric cardiac imaging. At present, there are only a few clinically validated examples of AI applications in this field. This review focuses on the use of AI in paediatric cardiovascular MRI, using examples from paediatric cardiovascular MRI, adult cardiovascular MRI and other radiologic experience.
Collapse
Affiliation(s)
- Andrew M. Taylor
- Great Ormond Street Hospital for Children, Zayed Centre for Research, 20 Guildford St., Room 3.7, London, WC1N 1DZ UK ,Cardiovascular Imaging, UCL Institute of Cardiovascular Science, London, UK
| |
Collapse
|
18
|
Balancing Speed and Accuracy in Cardiac Magnetic Resonance Function Post-Processing: Comparing 2 Levels of Automation in 3 Vendors to Manual Assessment. Diagnostics (Basel) 2021; 11:diagnostics11101758. [PMID: 34679457 PMCID: PMC8534796 DOI: 10.3390/diagnostics11101758] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2021] [Revised: 09/13/2021] [Accepted: 09/22/2021] [Indexed: 11/24/2022] Open
Abstract
Automating cardiac function assessment on cardiac magnetic resonance short-axis cines is faster and more reproducible than manual contour-tracing; however, accurately tracing basal contours remains challenging. Three automated post-processing software packages (Level 1) were compared to manual assessment. Subsequently, automated basal tracings were manually adjusted using a standardized protocol combined with software package-specific relative-to-manual standard error correction (Level 2). All post-processing was performed in 65 healthy subjects. Manual contour-tracing was performed separately from Level 1 and 2 automated analysis. Automated measurements were considered accurate when the difference was equal or less than the maximum manual inter-observer disagreement percentage. Level 1 (2.1 ± 1.0 min) and Level 2 automated (5.2 ± 1.3 min) were faster and more reproducible than manual (21.1 ± 2.9 min) post-processing, the maximum inter-observer disagreement was 6%. Compared to manual, Level 1 automation had wide limits of agreement. The most reliable software package obtained more accurate measurements in Level 2 compared to Level 1 automation: left ventricular end-diastolic volume, 98% and 53%; ejection fraction, 98% and 60%; mass, 70% and 3%; right ventricular end-diastolic volume, 98% and 28%; ejection fraction, 80% and 40%, respectively. Level 1 automated cardiac function post-processing is fast and highly reproducible with varying accuracy. Level 2 automation balances speed and accuracy.
Collapse
|
19
|
Baessato F, Guglielmo M, Muscogiuri G, Baggiano A, Fusini L, Scafuri S, Babbaro M, Mollace R, Collevecchio A, Guaricci AI, Pontone G. Stress CMR in Known or Suspected CAD: Diagnostic and Prognostic Role. BIOMED RESEARCH INTERNATIONAL 2021; 2021:6678029. [PMID: 33511208 PMCID: PMC7822671 DOI: 10.1155/2021/6678029] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/30/2020] [Revised: 12/23/2020] [Accepted: 01/04/2021] [Indexed: 12/12/2022]
Abstract
The recently published 2019 guidelines on chronic coronary syndromes (CCS) focus on the need for noninvasive imaging modalities to accurately establish the diagnosis of coronary artery disease (CAD) and assess the risk of clinical scenario occurrence. Appropriate patient management should rely on controlling symptoms, improving prognosis, and guiding each therapeutic strategy as well as monitoring disease progress. Among the noninvasive imaging modalities, cardiovascular magnetic resonance (CMR) has gained broad acceptance in past years due to its unique features in providing a complete assessment of CAD through data on cardiac anatomy and function and myocardial viability, with high spatial and temporal resolution and without ionizing radiation. In detail, evaluation of the presence and extent of myocardial ischemia through stress CMR (S-CMR) has shown a high rule-in power in detecting functionally significant coronary artery stenosis in patients suspected of CCS. Moreover, S-CMR technique may add significant prognostic value, as demonstrated by different studies which have progressively evidenced the valuable power of this multiparametric imaging modality in predicting adverse cardiac events. The latest scientific progress supports a greater expansion of S-CMR with improvement of quantitative myocardial perfusion analysis, myocardial strain, and native mapping within the same examination. Although further study is warranted, these techniques, which are currently mostly restricted to the research field, are likely to become increasingly prevalent in the clinical setting with the scope of increasing accuracy in the selection of patients to be sent to invasive revascularization. This review investigates the diagnostic and prognostic role of S-CMR in the context of CAD, by analysing a strong, long-standing, scientific evidence together with an appraisal of new advanced techniques which may potentially enrich CAD management in the next future.
Collapse
Affiliation(s)
- Francesca Baessato
- Department of Cardiology, San Maurizio Regional Hospital, Bolzano, Italy
| | - Marco Guglielmo
- Cardiovascular Imaging Department, Centro Cardiologico Monzino IRCCS, Milan, Italy
| | - Giuseppe Muscogiuri
- Cardiovascular Imaging Department, Centro Cardiologico Monzino IRCCS, Milan, Italy
| | - Andrea Baggiano
- Cardiovascular Imaging Department, Centro Cardiologico Monzino IRCCS, Milan, Italy
| | - Laura Fusini
- Cardiovascular Imaging Department, Centro Cardiologico Monzino IRCCS, Milan, Italy
| | - Stefano Scafuri
- Cardiovascular Imaging Department, Centro Cardiologico Monzino IRCCS, Milan, Italy
| | - Mario Babbaro
- Cardiovascular Imaging Department, Centro Cardiologico Monzino IRCCS, Milan, Italy
| | - Rocco Mollace
- Cardiovascular Imaging Department, Centro Cardiologico Monzino IRCCS, Milan, Italy
| | - Ada Collevecchio
- Department of Cardiac, Thoracic, Vascular Sciences and Public Health, University of Padua, Padua, Italy
| | - Andrea I. Guaricci
- Institute of Cardiovascular Disease, Department of Emergency and Organ Transplantation, University Hospital Policlinico of Bari, Bari, Italy
| | - Gianluca Pontone
- Cardiovascular Imaging Department, Centro Cardiologico Monzino IRCCS, Milan, Italy
| |
Collapse
|