1
|
Keles A, Ozisik PA, Algin O, Celebi FV, Bendechache M. Decoding pulsatile patterns of cerebrospinal fluid dynamics through enhancing interpretability in machine learning. Sci Rep 2024; 14:17854. [PMID: 39090141 PMCID: PMC11294568 DOI: 10.1038/s41598-024-67928-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2024] [Accepted: 07/17/2024] [Indexed: 08/04/2024] Open
Abstract
Analyses of complex behaviors of Cerebrospinal Fluid (CSF) have become increasingly important in diseases diagnosis. The changes of the phase-contrast magnetic resonance imaging (PC-MRI) signal formed by the velocity of flowing CSF are represented as a set of velocity-encoded images or maps, which can be thought of as signal data in the context of medical imaging, enabling the evaluation of pulsatile patterns throughout a cardiac cycle. However, automatic segmentation of the CSF region in a PC-MRI image is challenging, and implementing an explained ML method using pulsatile data as a feature remains unexplored. This paper presents lightweight machine learning (ML) algorithms to perform CSF lumen segmentation in spinal, utilizing sets of velocity-encoded images or maps as a feature. The Dataset contains 57 PC-MRI slabs by 3T MRI scanner from control and idiopathic scoliosis participants are involved to collect data. The ML models are trained with 2176 time series images. Different cardiac periods image (frame) numbers of PC-MRIs are interpolated in the preprocessing step to align to features of equal size. The fivefold cross-validation procedure is used to estimate the success of the ML models. Additionally, the study focusses on enhancing the interpretability of the highest-accuracy eXtreme gradient boosting (XGB) model by applying the shapley additive explanations (SHAP) technique. The XGB algorithm presented its highest accuracy, with an average fivefold accuracy of 0.99% precision, 0.95% recall, and 0.97% F1 score. We evaluated the significance of each pulsatile feature's contribution to predictions, offering a more profound understanding of the model's behavior in distinguishing CSF lumen pixels with SHAP. Introducing a novel approach in the field, develop ML models offer comprehension into feature extraction and selection from PC-MRI pulsatile data. Moreover, the explained ML model offers novel and valuable insights to domain experts, contributing to an enhanced scholarly understanding of CSF dynamics.
Collapse
Affiliation(s)
- Ayse Keles
- Department of Computer Engineering, Faculty of Engineering and Natural Sciences, Ankara Medipol University, Ankara, Turkey.
| | - Pinar Akdemir Ozisik
- Department of Neurosurgery, School of Medicine, Ankara Yildirim Beyazit University, Ankara, Turkey
- Ankara City Hospital, Orthopedics and Neurology Tower, Bilkent, 06800, Ankara, Turkey
| | - Oktay Algin
- Interventional MR Clinical R&D Institute, Ankara University, Ankara, Turkey
- National MR Research Center (UMRAM), Bilkent University, Ankara, Turkey
- Radiology Department, Medical Faculty, Ankara University, Ankara, Turkey
| | - Fatih Vehbi Celebi
- Department of Computer Engineering, Faculty of Engineering and Natural Sciences, Ankara Yildirim Beyazit University, 06010, Ayvalı, Keçiören, Ankara, Turkey
| | - Malika Bendechache
- Lero and ADAPT Research Centres, School of Computer Science, University of Galway, Galway, Ireland
| |
Collapse
|
2
|
Lohr D, Kollmann A, Bille M, Terekhov M, Elabyad I, Hock M, Baltes S, Reiter T, Schnitter F, Bauer WR, Hofmann U, Schreiber LM. Precision imaging of cardiac function and scar size in acute and chronic porcine myocardial infarction using ultrahigh-field MRI. COMMUNICATIONS MEDICINE 2024; 4:146. [PMID: 39026075 PMCID: PMC11258271 DOI: 10.1038/s43856-024-00559-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2022] [Accepted: 06/24/2024] [Indexed: 07/20/2024] Open
Abstract
BACKGROUND 7 T cardiac magnetic resonance imaging (MRI) studies may enable higher precision in clinical metrics like cardiac function, ventricular mass, and more. Higher precision may allow early detection of functional impairment and early evaluation of treatment responses in clinical practice and pre-clinical studies. METHODS Seven female German Landrace pigs were scanned prior to and at three time points (3-4 days, 7-10 days, and ~60 days) post myocardial infarction using a whole body 7 T system and three radiofrequency (RF) coils developed and built in-house to accompany animal growth. RESULTS The combination of dedicated RF hardware and 7 T MRI enables a longitudinal study in a pig model of acute and chronic infarction, providing consistent blood tissue contrast and high signal-to-noise ratio (SNR) in measurements of cardiac function, as well as low coefficients of variation (CoV) for ejection fraction (CoVintra-observer: 2%, CoVinter-observer: 3.8%) and infarct size (CoVintra-observer: 8.4%, CoVinter-observer: 3.8%), despite drastic animal growth. CONCLUSIONS Best results are achieved via manual segmentation. We define state-of-the-art procedures for large animal studies at 7 T.
Collapse
Affiliation(s)
- David Lohr
- Comprehensive Heart Failure Center (CHFC), Chair of Molecular and Cellular Imaging, University Hospital Wuerzburg, Wuerzburg, Germany.
| | - Alena Kollmann
- Comprehensive Heart Failure Center (CHFC), Chair of Molecular and Cellular Imaging, University Hospital Wuerzburg, Wuerzburg, Germany
| | - Maya Bille
- Comprehensive Heart Failure Center (CHFC), Chair of Molecular and Cellular Imaging, University Hospital Wuerzburg, Wuerzburg, Germany
| | - Maxim Terekhov
- Comprehensive Heart Failure Center (CHFC), Chair of Molecular and Cellular Imaging, University Hospital Wuerzburg, Wuerzburg, Germany
| | - Ibrahim Elabyad
- Comprehensive Heart Failure Center (CHFC), Chair of Molecular and Cellular Imaging, University Hospital Wuerzburg, Wuerzburg, Germany
| | - Michael Hock
- Comprehensive Heart Failure Center (CHFC), Chair of Molecular and Cellular Imaging, University Hospital Wuerzburg, Wuerzburg, Germany
| | - Steffen Baltes
- Comprehensive Heart Failure Center (CHFC), Chair of Molecular and Cellular Imaging, University Hospital Wuerzburg, Wuerzburg, Germany
| | - Theresa Reiter
- Comprehensive Heart Failure Center (CHFC), Chair of Molecular and Cellular Imaging, University Hospital Wuerzburg, Wuerzburg, Germany
- Department of Internal Medicine I, University Hospital Wuerzburg, Wuerzburg, Germany
| | - Florian Schnitter
- Department of Internal Medicine I, University Hospital Wuerzburg, Wuerzburg, Germany
| | - Wolfgang Rudolf Bauer
- Department of Internal Medicine I, University Hospital Wuerzburg, Wuerzburg, Germany
| | - Ulrich Hofmann
- Department of Internal Medicine I, University Hospital Wuerzburg, Wuerzburg, Germany
| | - Laura Maria Schreiber
- Comprehensive Heart Failure Center (CHFC), Chair of Molecular and Cellular Imaging, University Hospital Wuerzburg, Wuerzburg, Germany.
| |
Collapse
|
3
|
Elias P, Jain SS, Poterucha T, Randazzo M, Lopez Jimenez F, Khera R, Perez M, Ouyang D, Pirruccello J, Salerno M, Einstein AJ, Avram R, Tison GH, Nadkarni G, Natarajan V, Pierson E, Beecy A, Kumaraiah D, Haggerty C, Avari Silva JN, Maddox TM. Artificial Intelligence for Cardiovascular Care-Part 1: Advances: JACC Review Topic of the Week. J Am Coll Cardiol 2024; 83:2472-2486. [PMID: 38593946 DOI: 10.1016/j.jacc.2024.03.400] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/01/2024] [Accepted: 03/14/2024] [Indexed: 04/11/2024]
Abstract
Recent artificial intelligence (AI) advancements in cardiovascular care offer potential enhancements in diagnosis, treatment, and outcomes. Innovations to date focus on automating measurements, enhancing image quality, and detecting diseases using novel methods. Applications span wearables, electrocardiograms, echocardiography, angiography, genetics, and more. AI models detect diseases from electrocardiograms at accuracy not previously achieved by technology or human experts, including reduced ejection fraction, valvular heart disease, and other cardiomyopathies. However, AI's unique characteristics necessitate rigorous validation by addressing training methods, real-world efficacy, equity concerns, and long-term reliability. Despite an exponentially growing number of studies in cardiovascular AI, trials showing improvement in outcomes remain lacking. A number are currently underway. Embracing this rapidly evolving technology while setting a high evaluation benchmark will be crucial for cardiology to leverage AI to enhance patient care and the provider experience.
Collapse
Affiliation(s)
- Pierre Elias
- Seymour, Paul and Gloria Milstein Division of Cardiology, Columbia University Irving Medical Center, New York, New York, USA; Department of Biomedical Informatics Columbia University Irving Medical Center, New York, New York, USA
| | - Sneha S Jain
- Division of Cardiology, Stanford University School of Medicine, Palo Alto, California, USA
| | - Timothy Poterucha
- Seymour, Paul and Gloria Milstein Division of Cardiology, Columbia University Irving Medical Center, New York, New York, USA
| | - Michael Randazzo
- Division of Cardiology, University of Chicago Medical Center, Chicago, Illinois, USA
| | | | - Rohan Khera
- Division of Cardiology, Yale School of Medicine, New Haven, Connecticut, USA
| | - Marco Perez
- Division of Cardiology, Stanford University School of Medicine, Palo Alto, California, USA
| | - David Ouyang
- Division of Cardiology, Cedars-Sinai Medical Center, Los Angeles, California, USA
| | - James Pirruccello
- Division of Cardiology, University of California-San Francisco, San Francisco, California, USA
| | - Michael Salerno
- Division of Cardiology, Stanford University School of Medicine, Palo Alto, California, USA
| | - Andrew J Einstein
- Seymour, Paul and Gloria Milstein Division of Cardiology, Columbia University Irving Medical Center, New York, New York, USA
| | - Robert Avram
- Division of Cardiology, Montreal Heart Institute, Montreal, Quebec, Canada
| | - Geoffrey H Tison
- Division of Cardiology, University of California-San Francisco, San Francisco, California, USA
| | - Girish Nadkarni
- Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | | | - Emma Pierson
- Department of Computer Science, Cornell Tech, New York, New York, USA
| | - Ashley Beecy
- NewYork-Presbyterian Health System, New York, New York, USA; Division of Cardiology, Weill Cornell Medical College, New York, New York, USA
| | - Deepa Kumaraiah
- Seymour, Paul and Gloria Milstein Division of Cardiology, Columbia University Irving Medical Center, New York, New York, USA; NewYork-Presbyterian Health System, New York, New York, USA
| | - Chris Haggerty
- Department of Biomedical Informatics Columbia University Irving Medical Center, New York, New York, USA; NewYork-Presbyterian Health System, New York, New York, USA
| | - Jennifer N Avari Silva
- Division of Cardiology, Washington University School of Medicine, St Louis, Missouri, USA
| | - Thomas M Maddox
- Division of Cardiology, Washington University School of Medicine, St Louis, Missouri, USA.
| |
Collapse
|
4
|
Plasa G, Hillier E, Luu J, Boutet D, Benovoy M, Friedrich MG. Automated Data Transformation and Feature Extraction for Oxygenation-Sensitive Cardiovascular Magnetic Resonance Images. J Cardiovasc Transl Res 2024; 17:705-715. [PMID: 38229001 DOI: 10.1007/s12265-023-10474-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Accepted: 12/08/2023] [Indexed: 01/18/2024]
Abstract
Oxygenation-sensitive cardiovascular magnetic resonance (OS-CMR) is a novel, powerful tool for assessing coronary function in vivo. The data extraction and analysis however are labor-intensive. The objective of this study was to provide an automated approach for the extraction, visualization, and biomarker selection of OS-CMR images. We created a Python-based tool to automate extraction and export of raw patient data, featuring 3336 attributes per participant, into a template compatible with common data analytics frameworks, including the functionality to select predictive features for the given disease state. Each analysis was completed in about 2 min. The features selected by both ANOVA and MIC significantly outperformed (p < 0.001) the null set and complete set of features in two datasets, with mean AUROC scores of 0.89eatures f 0.94lete set of features in two datasets, with mean AUROC scores that our tool is suitable for automated data extraction and analysis of OS-CMR images.
Collapse
Affiliation(s)
- Glisant Plasa
- Research Institute of the McGill University Health Centre, Montreal, Canada
- Faculty of Science, Neuroscience, McGill University, Montreal, Canada
- Area 19 Medical, Montreal, Canada
| | - Elizabeth Hillier
- Research Institute of the McGill University Health Centre, Montreal, Canada
- Department of Medicine and Health Sciences, Faculty of Medicine and Dentistry, McGill University, Montreal, Canada
| | - Judy Luu
- Research Institute of the McGill University Health Centre, Montreal, Canada
| | - Dominic Boutet
- Faculty of Science, Neuroscience, McGill University, Montreal, Canada
| | - Mitchel Benovoy
- Research Institute of the McGill University Health Centre, Montreal, Canada
- Area 19 Medical, Montreal, Canada
| | - Matthias G Friedrich
- Research Institute of the McGill University Health Centre, Montreal, Canada.
- Department of Medicine and Diagnostic Radiology, McGill University Health Centre, 1001 Decarie Blvd, Montreal, QC, H4A 3J1, Canada.
| |
Collapse
|
5
|
Zhang J, Chen B, Liu J, Chai P, Liu H, Chen Y, Liu H, Yin G, Zhang S, Wang C, Xie Q. Predictive modeling of co-infection in lupus nephritis using multiple machine learning algorithms. Sci Rep 2024; 14:9242. [PMID: 38649391 PMCID: PMC11035552 DOI: 10.1038/s41598-024-59717-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2024] [Accepted: 04/15/2024] [Indexed: 04/25/2024] Open
Abstract
This study aimed to analyze peripheral blood lymphocyte subsets in lupus nephritis (LN) patients and use machine learning (ML) methods to establish an effective algorithm for predicting co-infection in LN. This study included 111 non-infected LN patients, 72 infected LN patients, and 206 healthy controls (HCs). Patient information, infection characteristics, medication, and laboratory indexes were recorded. Eight ML methods were compared to establish a model through a training group and verify the results in a test group. We trained the ML models, including Logistic Regression, Decision Tree, K-Nearest Neighbors, Support Vector Machine, Multi-Layer Perceptron, Random Forest, Ada boost, Extreme Gradient Boosting (XGB), and further evaluated potential predictors of infection. Infected LN patients had significantly decreased levels of T, B, helper T, suppressor T, and natural killer cells compared to non-infected LN patients and HCs. The number of regulatory T cells (Tregs) in LN patients was significantly lower than in HCs, with infected patients having the lowest Tregs count. Among the ML algorithms, XGB demonstrated the highest accuracy and precision for predicting LN infections. The innate and adaptive immune systems are disrupted in LN patients, and monitoring lymphocyte subsets can help prevent and treat infections. The XGB algorithm was recommended for predicting co-infection in LN.
Collapse
Affiliation(s)
- Jiaqian Zhang
- Department of Rheumatology and Immunology, West China Hospital, Sichuan University, No. 37 Guo Xue Lane, Wuhou District, Chengdu, 610041, Sichuan, China
| | - Bo Chen
- Department of Rheumatology and Immunology, West China Hospital, Sichuan University, No. 37 Guo Xue Lane, Wuhou District, Chengdu, 610041, Sichuan, China
| | - Jiu Liu
- Department of Internal Medicine, Linfen People's Hospital, Linfen, 041500, China
| | - Pengfei Chai
- School of Internet of Things, Jiangnan University, Wuxi, 214122, China
| | - Hongjiang Liu
- Department of Rheumatology and Immunology, West China Hospital, Sichuan University, No. 37 Guo Xue Lane, Wuhou District, Chengdu, 610041, Sichuan, China
| | - Yuehong Chen
- Department of Rheumatology and Immunology, West China Hospital, Sichuan University, No. 37 Guo Xue Lane, Wuhou District, Chengdu, 610041, Sichuan, China
| | - Huan Liu
- Department of Rheumatology and Immunology, West China Hospital, Sichuan University, No. 37 Guo Xue Lane, Wuhou District, Chengdu, 610041, Sichuan, China
| | - Geng Yin
- Department of General Practice, General Practice Medical Center, West China Hospital, Sichuan University, Chengdu, China
| | - Shengxiao Zhang
- Department of Rheumatology, The Second Hospital of Shanxi Medical University, No. 382 Wu Yi Road, Taiyuan, 030001, Shanxi, China.
| | - Caihong Wang
- Department of Rheumatology, The Second Hospital of Shanxi Medical University, No. 382 Wu Yi Road, Taiyuan, 030001, Shanxi, China.
| | - Qibing Xie
- Department of Rheumatology and Immunology, West China Hospital, Sichuan University, No. 37 Guo Xue Lane, Wuhou District, Chengdu, 610041, Sichuan, China.
| |
Collapse
|
6
|
Emrich T, Wintersperger BJ, Greco FD, Suchá D, Natale L, Paar MH, Francone M. ESR Essentials: ten steps to cardiac MR-practice recommendations by ESCR. Eur Radiol 2024; 34:2140-2151. [PMID: 38379017 DOI: 10.1007/s00330-024-10605-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2023] [Revised: 12/06/2023] [Accepted: 12/11/2023] [Indexed: 02/22/2024]
Abstract
Cardiovascular MR imaging has become an indispensable noninvasive tool in diagnosing and monitoring a broad range of cardiovascular diseases. Key to its clinical success and efficiency are appropriate clinical indication triage, technical expertise, patient safety, standardized preparation and execution, quality assurance, efficient post-processing, structured reporting, and communication and clinical integration of findings. Technological advancements are driving faster, more accessible, and cost-effective approaches. This ESR Essentials article presents a ten-step guide for implementing a cardiovascular MR program, covering indication assessments, optimized imaging, post-processing, and detailed reporting. Future goals include streamlined protocols, improved tissue characterization, and automation for greater standardization and efficiency. CLINICAL RELEVANCE STATEMENT The growing clinical role of cardiovascular MR in risk assessment, diagnosis, and treatment planning highlights the necessity for radiologists to achieve expertise in this modality, advancing precision medicine and healthcare efficiency. KEY POINTS • Cardiovascular MR is essential in diagnosing and monitoring many acute and chronic cardiovascular pathologies. • Features such as technical expertise, quality assurance, patient safety, and optimized tailored imaging protocols, among others, are essential for a successful cardiovascular MR program. • Ongoing technological advances will push rapid multi-parametric cardiovascular MR, thus improving accessibility, patient comfort, and cost-effectiveness. KEY POINTS • Cardiovascular MR is essential in diagnosing and monitoring a wide array of cardiovascular pathologies (Level of Evidence: High). • A successful cardiovascular MR program depends on standardization (Level of Evidence: Low). • Future developments will increase the efficiency and accessibility of cardiovascular MR (Level of Evidence: Low).
Collapse
Affiliation(s)
- Tilman Emrich
- Department of Diagnostic and Interventional Radiology, University Medical Center of the Johannes Gutenberg-University, Mainz, Germany
- Division of Cardiovascular Imaging, Department of Radiology and Radiological Science, Medical University of South Carolina, Charleston, SC, USA
- German Centre for Cardiovascular Research, Partner Site Rhine-Main, Mainz, Germany
| | - Bernd J Wintersperger
- Department of Medical Imaging, University of Toronto, Toronto, ON, Canada
- University Medical Imaging Toronto, Peter Munk Cardiac Centre, Toronto General Hospital, Toronto, ON, Canada
- Department of Radiology, LMU University Hospital, LMU Munich, Munich, Germany
| | - Fabio Domenico Greco
- Department of Clinical Radiology, University Hospitals Bristol and Weston NHS Foundation Trust, Bristol, UK
- Cardiovascular Magnetic Resonance Unit, Bristol Heart Institute, Bristol, UK
| | - Dominika Suchá
- Department of Radiology and Nuclear Medicine, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Luigi Natale
- Department of Radiological Sciences - Institute of Radiology, Catholic University of Rome, "A. Gemelli" University Hospital, Rome, Italy
| | - Maja Hrabak Paar
- Department of Diagnostic and Interventional Radiology, University Hospital Center Zagreb, Zagreb, Croatia
- University of Zagreb School of Medicine, Zagreb, Croatia
| | - Marco Francone
- Department of Biomedical Sciences, Humanitas University, Milan, Italy.
- IRCCS Humanitas Research Hospital, Milan, Italy.
| |
Collapse
|
7
|
DiLorenzo MP, Lee S, Rathod RH, Raimondi F, Farooqi KM, Jain SS, Samyn MM, Johnson TR, Olivieri LJ, Fogel MA, Lai WW, Renella P, Powell AJ, Buddhe S, Stafford C, Johnson JN, Helbing WA, Pushparajah K, Voges I, Muthurangu V, Miles KG, Greil G, McMahon CJ, Slesnick TC, Fonseca BM, Morris SA, Soslow JH, Grosse-Wortmann L, Beroukhim RS, Grotenhuis HB. Design and implementation of multicenter pediatric and congenital studies with cardiovascular magnetic resonance: Big data in smaller bodies. J Cardiovasc Magn Reson 2024; 26:101041. [PMID: 38527706 PMCID: PMC10990896 DOI: 10.1016/j.jocmr.2024.101041] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Revised: 03/12/2024] [Accepted: 03/20/2024] [Indexed: 03/27/2024] Open
Abstract
Cardiovascular magnetic resonance (CMR) has become the reference standard for quantitative and qualitative assessment of ventricular function, blood flow, and myocardial tissue characterization. There is a preponderance of large CMR studies and registries in adults; However, similarly powered studies are lacking for the pediatric and congenital heart disease (PCHD) population. To date, most CMR studies in children are limited to small single or multicenter studies, thereby limiting the conclusions that can be drawn. Within the PCHD CMR community, a collaborative effort has been successfully employed to recognize knowledge gaps with the aim to embolden the development and initiation of high-quality, large-scale multicenter research. In this publication, we highlight the underlying challenges and provide a practical guide toward the development of larger, multicenter initiatives focusing on PCHD populations, which can serve as a model for future multicenter efforts.
Collapse
Affiliation(s)
- Michael P DiLorenzo
- Division of Cardiology, Department of Pediatrics, Columbia University Vagelos College of Physicians and Surgeons and NewYork-Presbyterian Morgan Stanley Children's Hospital, 3959 Broadway, New York, NY 10032, USA.
| | - Simon Lee
- Ann & Robert H Lurie Children's Hospital of Chicago, Chicago, IL 60611, USA.
| | | | - Francesca Raimondi
- Congenital Cardiology Unit, Ospedale Papa Giovanni XXIII, Bergamo, Italy.
| | - Kanwal M Farooqi
- Division of Cardiology, Department of Pediatrics, Columbia University Vagelos College of Physicians and Surgeons and NewYork-Presbyterian Morgan Stanley Children's Hospital, 3959 Broadway, New York, NY 10032, USA.
| | - Supriya S Jain
- New York Medical College/Maria Fareri Children's Hospital at Westchester Medical Center, 100 Woods Rd, Valhalla, NY 10595, USA.
| | - Margaret M Samyn
- Medical College of Wisconsin/The Herma Heart Institute at Children's Wisconsin, 8915 W Connell Ct, Milwaukee, WI 53226, USA.
| | - Tiffanie R Johnson
- Indiana University School of Medicine, Riley Children's Health, 705 Riley Hospital Drive, Indianapolis, IN 46202, USA.
| | - Laura J Olivieri
- Department of Pediatric Cardiology, Children's Hospital of Pittsburgh, Children's Hospital Drive, 4401 Penn Ave, Pittsburgh, PA 15224, USA.
| | - Mark A Fogel
- Division of Pediatric Cardiology, Department of Pediatrics, The Children's Hospital of Philadelphia, 3401 Civic Center Blvd, Philadelphia, PA 19104, USA.
| | - Wyman W Lai
- CHOC Children's Hospital, 1201 W La Veta Ave, Orange, CA 92868, USA.
| | | | | | - Sujatha Buddhe
- Department of Pediatrics, Division of Pediatric Cardiology, Betty Irene Moore Heart Center, Lucile Packard Children's Hospital, 725 Welch Rd Ste 325, Palo Alto, CA 94304, USA.
| | | | - Jason N Johnson
- Department of Pediatrics, University of Tennessee Health Sciences Center, 848 Adams Ave, Memphis, TN 38103, USA; Division of Pediatric Cardiology, Le Bonheur Children's Hospital, University of Tennessee Health Sciences Center, 848 Adams Ave, Memphis, TN 38103, USA.
| | - Willem A Helbing
- Department of Pediatrics, Division of Pediatric Cardiology, Sophia's Children's Hospital, Erasmus University Medical Center Rotterdam, Dr. Molewaterplein 40, 3015 GD Rotterdam, Rotterdam, the Netherlands.
| | - Kuberan Pushparajah
- Department of Paediatric Cardiology, Evelina London Children's Hospital, Guy's and St Thomas' NHS Foundation Trust, Westminster Bridge Road, London SE1 7EH, United Kingdom.
| | - Inga Voges
- German Centre for Cardiovascular Research, Ootsdamer Str. 58, 10785 Berlin, Germany; Department of Congenital Heart Disease and Pediatric Cardiology, University Hospital Schleswig-Holstein, Arnold-Heller-Straße 3, 24105 Kiel, Germany.
| | - Vivek Muthurangu
- UCL Center for Translational Cardiovascular Imaging, University College London, Gower Street, London WC1E 6BT, UK.
| | - Kimberley G Miles
- Heart Institute, Cincinnati Children's Hospital Medical Center, 333 Burnet Ave, Kimberley, Cincinnati, OH 45229, USA.
| | - Gerald Greil
- Department of Pediatrics, Division of Pediatric Cardiology, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd, Dallas, TX 75390, USA.
| | - Colin J McMahon
- University College of Dublin, School of Medicine and Department of Paediatric Cardiology, Children's Health Ireland, Gate 5, Crumlin, Dublin 12, Ireland.
| | - Timothy C Slesnick
- Department of Pediatrics, Division of Pediatric Cardiology, Emory University School of Medicine, 738 Old Norcross Road, Lawrenceville, GA 30046, USA; Department of Pediatrics, Division of Pediatric Cardiology, Children's Healthcare of Atlanta, Atlanta, Georgia, Division of Pediatric Cardiology, Emory University School of Medicine, 738 Old Norcross Road, Lawrenceville, GA 30046, USA.
| | - Brian M Fonseca
- Pediatric Cardiology, Children's Hospital Colorado, University of Colorado School of Medicine, 13123 East 16th Ave, Aurora, CO 80045, USA.
| | - Shaine A Morris
- Division of Cardiology, Department of Pediatrics, Baylor College of Medicine Texas Children's Hospital, 6651 Main Street, Houston, TX 77030, USA.
| | - Jonathan H Soslow
- Department of Pediatrics, Division of Pediatric Cardiology, Vanderbilt University Medical Center, 1211 Medical Center Drive, Nashville, TN 37232, USA.
| | - Lars Grosse-Wortmann
- Division of Cardiology, Department of Pediatrics, Doernbecher Children's Hospital, Oregon Health and Science University, 700 SW Campus Dr, Portland, OR, USA 97239.
| | | | - Heynric B Grotenhuis
- Pediatric Cardiology, Wilhelmina Children's Hospital, UMCU, Lundlaan 6, 3584 EA Utrecht, the Netherlands.
| |
Collapse
|
8
|
Hanneman K, Playford D, Dey D, van Assen M, Mastrodicasa D, Cook TS, Gichoya JW, Williamson EE, Rubin GD. Value Creation Through Artificial Intelligence and Cardiovascular Imaging: A Scientific Statement From the American Heart Association. Circulation 2024; 149:e296-e311. [PMID: 38193315 DOI: 10.1161/cir.0000000000001202] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/10/2024]
Abstract
Multiple applications for machine learning and artificial intelligence (AI) in cardiovascular imaging are being proposed and developed. However, the processes involved in implementing AI in cardiovascular imaging are highly diverse, varying by imaging modality, patient subtype, features to be extracted and analyzed, and clinical application. This article establishes a framework that defines value from an organizational perspective, followed by value chain analysis to identify the activities in which AI might produce the greatest incremental value creation. The various perspectives that should be considered are highlighted, including clinicians, imagers, hospitals, patients, and payers. Integrating the perspectives of all health care stakeholders is critical for creating value and ensuring the successful deployment of AI tools in a real-world setting. Different AI tools are summarized, along with the unique aspects of AI applications to various cardiac imaging modalities, including cardiac computed tomography, magnetic resonance imaging, and positron emission tomography. AI is applicable and has the potential to add value to cardiovascular imaging at every step along the patient journey, from selecting the more appropriate test to optimizing image acquisition and analysis, interpreting the results for classification and diagnosis, and predicting the risk for major adverse cardiac events.
Collapse
|
9
|
Vrudhula A, Kwan AC, Ouyang D, Cheng S. Machine Learning and Bias in Medical Imaging: Opportunities and Challenges. Circ Cardiovasc Imaging 2024; 17:e015495. [PMID: 38377237 PMCID: PMC10883605 DOI: 10.1161/circimaging.123.015495] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/22/2024]
Abstract
Bias in health care has been well documented and results in disparate and worsened outcomes for at-risk groups. Medical imaging plays a critical role in facilitating patient diagnoses but involves multiple sources of bias including factors related to access to imaging modalities, acquisition of images, and assessment (ie, interpretation) of imaging data. Machine learning (ML) applied to diagnostic imaging has demonstrated the potential to improve the quality of imaging-based diagnosis and the precision of measuring imaging-based traits. Algorithms can leverage subtle information not visible to the human eye to detect underdiagnosed conditions or derive new disease phenotypes by linking imaging features with clinical outcomes, all while mitigating cognitive bias in interpretation. Importantly, however, the application of ML to diagnostic imaging has the potential to either reduce or propagate bias. Understanding the potential gain as well as the potential risks requires an understanding of how and what ML models learn. Common risks of propagating bias can arise from unbalanced training, suboptimal architecture design or selection, and uneven application of models. Notwithstanding these risks, ML may yet be applied to improve gain from imaging across all 3A's (access, acquisition, and assessment) for all patients. In this review, we present a framework for understanding the balance of opportunities and challenges for minimizing bias in medical imaging, how ML may improve current approaches to imaging, and what specific design considerations should be made as part of efforts to maximize the quality of health care for all.
Collapse
Affiliation(s)
- Amey Vrudhula
- Icahn School of Medicine at Mount Sinai, New York
- Department of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center
| | - Alan C Kwan
- Department of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center
| | - David Ouyang
- Department of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center
- Division of Artificial Intelligence in Medicine, Department of Medicine, Cedars-Sinai Medical Center
| | - Susan Cheng
- Department of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center
| |
Collapse
|
10
|
Christodoulou AG, Cruz G, Arami A, Weingärtner S, Artico J, Peters D, Seiberlich N. The future of cardiovascular magnetic resonance: All-in-one vs. real-time (Part 1). J Cardiovasc Magn Reson 2024; 26:100997. [PMID: 38237900 PMCID: PMC11211239 DOI: 10.1016/j.jocmr.2024.100997] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2023] [Accepted: 01/10/2024] [Indexed: 02/26/2024] Open
Abstract
Cardiovascular magnetic resonance (CMR) protocols can be lengthy and complex, which has driven the research community to develop new technologies to make these protocols more efficient and patient-friendly. Two different approaches to improving CMR have been proposed, specifically "all-in-one" CMR, where several contrasts and/or motion states are acquired simultaneously, and "real-time" CMR, in which the examination is accelerated to avoid the need for breathholding and/or cardiac gating. The goal of this two-part manuscript is to describe these two different types of emerging rapid CMR. To this end, the vision of each is described, along with techniques which have been devised and tested along the pathway of clinical implementation. The pros and cons of the different methods are presented, and the remaining open needs of each are detailed. Part 1 will tackle the "all-in-one" approaches, and Part 2 the "real-time" approaches along with an overall summary of these emerging methods.
Collapse
Affiliation(s)
- Anthony G Christodoulou
- Department of Radiological Sciences, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA; Biomedical Imaging Research Institute, Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Gastao Cruz
- Michigan Institute for Imaging Technology and Translation, Department of Radiology, University of Michigan, Ann Arbor, MI, USA
| | - Ayda Arami
- Department of Imaging Physics, Delft University of Technology, Delft, the Netherlands; Department of Radiology, Leiden University Medical Center, Leiden, the Netherlands
| | - Sebastian Weingärtner
- Department of Imaging Physics, Delft University of Technology, Delft, the Netherlands
| | | | - Dana Peters
- Radiology & Biomedical Imaging, Yale University, New Haven, CT, USA
| | - Nicole Seiberlich
- Michigan Institute for Imaging Technology and Translation, Department of Radiology, University of Michigan, Ann Arbor, MI, USA.
| |
Collapse
|
11
|
Cau R, Pisu F, Suri JS, Montisci R, Gatti M, Mannelli L, Gong X, Saba L. Artificial Intelligence in the Differential Diagnosis of Cardiomyopathy Phenotypes. Diagnostics (Basel) 2024; 14:156. [PMID: 38248033 PMCID: PMC11154548 DOI: 10.3390/diagnostics14020156] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Revised: 01/03/2024] [Accepted: 01/08/2024] [Indexed: 01/23/2024] Open
Abstract
Artificial intelligence (AI) is rapidly being applied to the medical field, especially in the cardiovascular domain. AI approaches have demonstrated their applicability in the detection, diagnosis, and management of several cardiovascular diseases, enhancing disease stratification and typing. Cardiomyopathies are a leading cause of heart failure and life-threatening ventricular arrhythmias. Identifying the etiologies is fundamental for the management and diagnostic pathway of these heart muscle diseases, requiring the integration of various data, including personal and family history, clinical examination, electrocardiography, and laboratory investigations, as well as multimodality imaging, making the clinical diagnosis challenging. In this scenario, AI has demonstrated its capability to capture subtle connections from a multitude of multiparametric datasets, enabling the discovery of hidden relationships in data and handling more complex tasks than traditional methods. This review aims to present a comprehensive overview of the main concepts related to AI and its subset. Additionally, we review the existing literature on AI-based models in the differential diagnosis of cardiomyopathy phenotypes, and we finally examine the advantages and limitations of these AI approaches.
Collapse
Affiliation(s)
- Riccardo Cau
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), di Cagliari-Polo di Monserrato s.s. 554 Monserrato, 09045 Cagliari, Italy; (R.C.); (F.P.)
| | - Francesco Pisu
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), di Cagliari-Polo di Monserrato s.s. 554 Monserrato, 09045 Cagliari, Italy; (R.C.); (F.P.)
| | - Jasjit S. Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoin™, Roseville, CA 95661, USA;
| | - Roberta Montisci
- Department of Cardiology, Azienda Ospedaliero Universitaria (A.O.U.), di Cagliari-Polo di Monserrato s.s. 554 Monserrato, 09045 Cagliari, Italy;
| | - Marco Gatti
- Department of Radiology, Università degli Studi di Torino, 10129 Turin, Italy;
| | | | - Xiangyang Gong
- Radiology Department, Zhejiang Provincial People’s Hospital, Affiliated People’s Hospital, Hangzhou Medical College, Hangzhou 310014, China;
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), di Cagliari-Polo di Monserrato s.s. 554 Monserrato, 09045 Cagliari, Italy; (R.C.); (F.P.)
| |
Collapse
|
12
|
Kim YC, Chung Y, Choe YH. Deep learning for classification of late gadolinium enhancement lesions based on the 16-segment left ventricular model. Phys Med 2024; 117:103193. [PMID: 38056081 DOI: 10.1016/j.ejmp.2023.103193] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/25/2023] [Revised: 10/22/2023] [Accepted: 11/28/2023] [Indexed: 12/08/2023] Open
Abstract
PURPOSE This study aimed to develop and validate a deep learning-based method that allows for segmental analysis of myocardial late gadolinium enhancement (LGE) lesions. METHODS Cardiac LGE data from 170 patients with coronary artery disease and non-ischemic heart disease were used for training, validation, and testing. Short-axis images were transformed to polar space after identification of the left ventricular (LV) center point and anterior right ventricular (RV) insertion point. Images were obtained after dividing the polar transformed images into segments based on the 16-segment LV model. Five different deep convolutional neural network (CNN) models were developed and validated using the labeled data, where the image after the division corresponded to a segment, and the lesion labeling was based on the 16-segment LV model. Unseen testing data were used to evaluate the performance of the lesion classification. RESULTS Without manual lesion segmentation and annotation, the proposed method showed an area under the curve (AUC) of 0.875, and a precision, recall, and F1-score of 0.723, 0.783, and 0.752, respectively for the lesion class when the pretrained ResNet50 model was tested for all slice images. The two pretrained models of ResNet50 and EfficientNet-B0 outperformed the three non-pretrained CNN models in terms of AUCs (0.873-0.875 vs. 0.834-0.841). CONCLUSION The proposed method is based on learning a deep CNN model from polar transformed images to predict LGE lesions with good accuracy and does not require time-consuming annotation procedures such as lesion segmentation.
Collapse
Affiliation(s)
- Yoon-Chul Kim
- Division of Digital Healthcare, College of Software and Digital Healthcare Convergence, Yonsei University, Wonju, South Korea.
| | - Younjoon Chung
- School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Yeon Hyeon Choe
- Department of Radiology, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, South Korea.
| |
Collapse
|
13
|
Morales MA, Manning WJ, Nezafat R. Present and Future Innovations in AI and Cardiac MRI. Radiology 2024; 310:e231269. [PMID: 38193835 PMCID: PMC10831479 DOI: 10.1148/radiol.231269] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Revised: 10/21/2023] [Accepted: 10/26/2023] [Indexed: 01/10/2024]
Abstract
Cardiac MRI is used to diagnose and treat patients with a multitude of cardiovascular diseases. Despite the growth of clinical cardiac MRI, complicated image prescriptions and long acquisition protocols limit the specialty and restrain its impact on the practice of medicine. Artificial intelligence (AI)-the ability to mimic human intelligence in learning and performing tasks-will impact nearly all aspects of MRI. Deep learning (DL) primarily uses an artificial neural network to learn a specific task from example data sets. Self-driving scanners are increasingly available, where AI automatically controls cardiac image prescriptions. These scanners offer faster image collection with higher spatial and temporal resolution, eliminating the need for cardiac triggering or breath holding. In the future, fully automated inline image analysis will most likely provide all contour drawings and initial measurements to the reader. Advanced analysis using radiomic or DL features may provide new insights and information not typically extracted in the current analysis workflow. AI may further help integrate these features with clinical, genetic, wearable-device, and "omics" data to improve patient outcomes. This article presents an overview of AI and its application in cardiac MRI, including in image acquisition, reconstruction, and processing, and opportunities for more personalized cardiovascular care through extraction of novel imaging markers.
Collapse
Affiliation(s)
- Manuel A. Morales
- From the Department of Medicine, Cardiovascular Division (M.A.M.,
W.J.M., R.N.), and Department of Radiology (W.J.M.), Beth Israel Deaconess
Medical Center and Harvard Medical School, 330 Brookline Ave, Boston, MA
02215
| | - Warren J. Manning
- From the Department of Medicine, Cardiovascular Division (M.A.M.,
W.J.M., R.N.), and Department of Radiology (W.J.M.), Beth Israel Deaconess
Medical Center and Harvard Medical School, 330 Brookline Ave, Boston, MA
02215
| | - Reza Nezafat
- From the Department of Medicine, Cardiovascular Division (M.A.M.,
W.J.M., R.N.), and Department of Radiology (W.J.M.), Beth Israel Deaconess
Medical Center and Harvard Medical School, 330 Brookline Ave, Boston, MA
02215
| |
Collapse
|
14
|
Chato L, Regentova E. Survey of Transfer Learning Approaches in the Machine Learning of Digital Health Sensing Data. J Pers Med 2023; 13:1703. [PMID: 38138930 PMCID: PMC10744730 DOI: 10.3390/jpm13121703] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2023] [Revised: 12/01/2023] [Accepted: 12/08/2023] [Indexed: 12/24/2023] Open
Abstract
Machine learning and digital health sensing data have led to numerous research achievements aimed at improving digital health technology. However, using machine learning in digital health poses challenges related to data availability, such as incomplete, unstructured, and fragmented data, as well as issues related to data privacy, security, and data format standardization. Furthermore, there is a risk of bias and discrimination in machine learning models. Thus, developing an accurate prediction model from scratch can be an expensive and complicated task that often requires extensive experiments and complex computations. Transfer learning methods have emerged as a feasible solution to address these issues by transferring knowledge from a previously trained task to develop high-performance prediction models for a new task. This survey paper provides a comprehensive study of the effectiveness of transfer learning for digital health applications to enhance the accuracy and efficiency of diagnoses and prognoses, as well as to improve healthcare services. The first part of this survey paper presents and discusses the most common digital health sensing technologies as valuable data resources for machine learning applications, including transfer learning. The second part discusses the meaning of transfer learning, clarifying the categories and types of knowledge transfer. It also explains transfer learning methods and strategies, and their role in addressing the challenges in developing accurate machine learning models, specifically on digital health sensing data. These methods include feature extraction, fine-tuning, domain adaptation, multitask learning, federated learning, and few-/single-/zero-shot learning. This survey paper highlights the key features of each transfer learning method and strategy, and discusses the limitations and challenges of using transfer learning for digital health applications. Overall, this paper is a comprehensive survey of transfer learning methods on digital health sensing data which aims to inspire researchers to gain knowledge of transfer learning approaches and their applications in digital health, enhance the current transfer learning approaches in digital health, develop new transfer learning strategies to overcome the current limitations, and apply them to a variety of digital health technologies.
Collapse
Affiliation(s)
- Lina Chato
- Department of Electrical and Computer Engineering, University of Nevada, Las Vegas, NV 89154, USA;
| | | |
Collapse
|
15
|
Benz DC, Gräni C, Antiochos P, Heydari B, Gissler MC, Ge Y, Cuddy SAM, Dorbala S, Kwong RY. Cardiac magnetic resonance biomarkers as surrogate endpoints in cardiovascular trials for myocardial diseases. Eur Heart J 2023; 44:4738-4747. [PMID: 37700499 PMCID: PMC11032206 DOI: 10.1093/eurheartj/ehad510] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/27/2022] [Revised: 07/05/2023] [Accepted: 07/25/2023] [Indexed: 09/14/2023] Open
Abstract
Cardiac magnetic resonance offers multiple facets in the diagnosis, risk stratification, and management of patients with myocardial diseases. Particularly, its feature to precisely monitor disease activity lends itself to quantify response to novel therapeutics. This review critically appraises the value of cardiac magnetic resonance imaging biomarkers as surrogate endpoints for prospective clinical trials. The primary focus is to comprehensively outline the value of established cardiac magnetic resonance parameters in myocardial diseases. These include heart failure, cardiac amyloidosis, iron overload cardiomyopathy, hypertrophic cardiomyopathy, cardio-oncology, and inflammatory cardiomyopathies like myocarditis and sarcoidosis.
Collapse
Affiliation(s)
- Dominik C Benz
- Noninvasive Cardiovascular Imaging Section, Cardiovascular Division, Department of Medicine and Department of Radiology, Brigham and Women’s Hospital, 75 Francis Street, Boston, MA 02115, USA
| | - Christoph Gräni
- Department of Cardiology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Panagiotis Antiochos
- Cardiology and Cardiac MR Centre, University Hospital Lausanne, Lausanne, Switzerland
| | - Bobak Heydari
- Cardiovascular Division, Department of Medicine, University of Calgary, Calgary, Alberta, Canada
| | - Mark Colin Gissler
- Department of Cardiology and Angiology, University Heart Center Freiburg-Bad Krozingen, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Yin Ge
- Terrence Donnelly Heart Center, St Michael’s Hospital, Toronto, Canada
| | - Sarah A M Cuddy
- Noninvasive Cardiovascular Imaging Section, Cardiovascular Division, Department of Medicine and Department of Radiology, Brigham and Women’s Hospital, 75 Francis Street, Boston, MA 02115, USA
| | - Sharmila Dorbala
- Noninvasive Cardiovascular Imaging Section, Cardiovascular Division, Department of Medicine and Department of Radiology, Brigham and Women’s Hospital, 75 Francis Street, Boston, MA 02115, USA
| | - Raymond Y Kwong
- Noninvasive Cardiovascular Imaging Section, Cardiovascular Division, Department of Medicine and Department of Radiology, Brigham and Women’s Hospital, 75 Francis Street, Boston, MA 02115, USA
| |
Collapse
|
16
|
Jathanna N, Strachan K, Erhayiem B, Kamaruddin H, Swoboda P, Auer D, Chen X, Jamil-Copley S. The Nottingham Ischaemic Cardiovascular Magnetic Resonance resource (NotIs CMR): a prospective paired clinical and imaging scar database-protocol. J Cardiovasc Magn Reson 2023; 25:69. [PMID: 38008732 PMCID: PMC10680206 DOI: 10.1186/s12968-023-00978-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Accepted: 11/12/2023] [Indexed: 11/28/2023] Open
Abstract
INTRODUCTION Research utilising artificial intelligence (AI) and cardiovascular magnetic resonance (CMR) is rapidly evolving with various objectives, however AI model development, generalisation and performance may be hindered by availability of robust training datasets including contrast enhanced images. METHODS NotIs CMR is a large UK, prospective, multicentre, observational cohort study to guide the development of a biventricular AI scar model. Patients with ischaemic heart disease undergoing clinically indicated contrast-enhanced cardiac magnetic resonance imaging will be recruited at Nottingham University Hospitals NHS Trust and Mid-Yorkshire Hospital NHS Trust. Baseline assessment will include cardiac magnetic resonance imaging, demographic data, medical history, electrocardiographic and serum biomarkers. Participants will undergo monitoring for a minimum of 5 years to document any major cardiovascular adverse events. The main objectives include (1) AI training, validation and testing to improve the performance, applicability and adaptability of an AI biventricular scar segmentation model being developed by the authors and (2) develop a curated, disease-specific imaging database to support future research and collaborations and, (3) to explore associations in clinical outcome for future risk prediction modelling studies. CONCLUSION NotIs CMR will collect and curate disease-specific, paired imaging and clinical datasets to develop an AI biventricular scar model whilst providing a database to support future research and collaboration in Artificial Intelligence and ischaemic heart disease.
Collapse
Affiliation(s)
- Nikesh Jathanna
- Department of Cardiology, Nottingham University Hospitals NHS Trust, Nottingham, UK
- Queen's Medical Centre, NIHR Nottingham Biomedical Research Centre, University of Nottingham, Nottingham, UK
| | - Kevin Strachan
- Department of Cardiology, Nottingham University Hospitals NHS Trust, Nottingham, UK
| | - Bara Erhayiem
- Department of Cardiology, Nottingham University Hospitals NHS Trust, Nottingham, UK
| | - Hazlyna Kamaruddin
- Department of Cardiology, Nottingham University Hospitals NHS Trust, Nottingham, UK
| | - Peter Swoboda
- Leeds Institute of Cardiovascular and Metabolic Medicine, University of Leeds, Leeds, UK
| | - Dorothee Auer
- Queen's Medical Centre, NIHR Nottingham Biomedical Research Centre, University of Nottingham, Nottingham, UK
| | - Xin Chen
- Department of Computer Science, University of Nottingham, Nottingham, UK
| | - Shahnaz Jamil-Copley
- Department of Cardiology, Nottingham University Hospitals NHS Trust, Nottingham, UK.
- Queen's Medical Centre, NIHR Nottingham Biomedical Research Centre, University of Nottingham, Nottingham, UK.
| |
Collapse
|
17
|
Caobelli F, Cabrero JB, Galea N, Haaf P, Loewe C, Luetkens JA, Muscogiuri G, Francone M. Cardiovascular magnetic resonance (CMR) and positron emission tomography (PET) imaging in the diagnosis and follow-up of patients with acute myocarditis and chronic inflammatory cardiomyopathy : A review paper with practical recommendations on behalf of the European Society of Cardiovascular Radiology (ESCR). Int J Cardiovasc Imaging 2023; 39:2221-2235. [PMID: 37682416 PMCID: PMC10674005 DOI: 10.1007/s10554-023-02927-6] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/29/2023] [Accepted: 08/02/2023] [Indexed: 09/09/2023]
Abstract
Advanced cardiac imaging techniques such as cardiovascular magnetic resonance (CMR) and positron emission tomography (PET) are widely used in clinical practice in patients with acute myocarditis and chronic inflammatory cardiomyopathies (I-CMP). We aimed to provide a review article with practical recommendations from the European Society of Cardiovascular Radiology (ESCR), in order to guide physicians in the use and interpretation of CMR and PET in clinical practice both for acute myocarditis and follow-up in chronic forms of I-CMP.
Collapse
Affiliation(s)
- Federico Caobelli
- Department of Nuclear Medicine, Inselspital, Bern University Hospital and University of Bern, Freiburgstrasse 18, Bern, 3000, Switzerland.
| | | | - Nicola Galea
- Department of Radiological, Oncological and Pathological Sciences, Sapienza University of Rome, Viale Regina Elena 324, Rome, 00161, Italy
| | - Philip Haaf
- Department of Cardiology, Cardiovascular Research Institute Basel (CRIB), University Hospital Basel, and University of Basel, Petersgraben 4, Basel, CH-4031, Switzerland
| | - Christian Loewe
- Division of Cardiovascular and Interventional Radiology, Department of Bioimaging and Image-Guided Therapy, Medical University Vienna, Spitalgasse 9, Vienna, A-1090, Austria
| | - Julian A Luetkens
- Department of Diagnostic and Interventional Radiology, University Hospital Bonn, Venusberg-Campus 1, 53127, Bonn, Germany
| | | | - Marco Francone
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, Pieve Emanuele, Milan, 20072, Italy
- IRCCS Humanitas Research Hospital, Via Manzoni 56, Rozzano, Milan, 20089, Italy
| |
Collapse
|
18
|
Gao Y, Zhou Z, Zhang B, Guo S, Bo K, Li S, Zhang N, Wang H, Yang G, Zhang H, Liu T, Xu L. Deep learning-based prognostic model using non-enhanced cardiac cine MRI for outcome prediction in patients with heart failure. Eur Radiol 2023; 33:8203-8213. [PMID: 37286789 DOI: 10.1007/s00330-023-09785-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2022] [Revised: 04/14/2023] [Accepted: 04/21/2023] [Indexed: 06/09/2023]
Abstract
OBJECTIVES To evaluate the performance of a deep learning-based multi-source model for survival prediction and risk stratification in patients with heart failure. METHODS Patients with heart failure with reduced ejection fraction (HFrEF) who underwent cardiac magnetic resonance between January 2015 and April 2020 were retrospectively included in this study. Baseline electronic health record data, including clinical demographic information, laboratory data, and electrocardiographic information, were collected. Short-axis non-contrast cine images of the whole heart were acquired to estimate the cardiac function parameters and the motion features of the left ventricle. Model accuracy was evaluated using the Harrell's concordance index. All patients were followed up for major adverse cardiac events (MACEs), and survival prediction was assessed using Kaplan-Meier curves. RESULTS A total of 329 patients were evaluated (age 54 ± 14 years; men, 254) in this study. During a median follow-up period of 1041 days, 62 patients experienced MACEs and their median survival time was 495 days. When compared with conventional Cox hazard prediction models, deep learning models showed better survival prediction performance. Multi-data denoising autoencoder (DAE) model reached the concordance index of 0.8546 (95% CI: 0.7902-0.8883). Furthermore, when divided into phenogroups, the multi-data DAE model could significantly discriminate between the survival outcomes of the high-risk and low-risk groups compared with other models (p < 0.001). CONCLUSIONS The proposed deep learning (DL) model based on non-contrast cardiac cine magnetic resonance imaging could independently predict the outcome of patients with HFrEF and showed better prediction efficiency than conventional methods. CLINICAL RELEVANCE STATEMENT The proposed multi-source deep learning model based on cardiac magnetic resonance enables survival prediction in patients with heart failure. KEY POINTS • A multi-source deep learning model based on non-contrast cardiovascular magnetic resonance (CMR) cine images was built to make robust survival prediction in patients with heart failure. • The ground truth definition contains electronic health record data as well as DL-based motion data, and cardiac motion information is extracted by optical flow method from non-contrast CMR cine images. • The DL-based model exhibits better prognostic value and stratification performance when compared with conventional prediction models and could aid in the risk stratification in patients with HF.
Collapse
Affiliation(s)
- Yifeng Gao
- Department of Radiology, Beijing Anzhen Hospital, Capital Medical University, No.2, Anzhen Road, Chaoyang District, Beijing, 100029, China
| | - Zhen Zhou
- Department of Radiology, Beijing Anzhen Hospital, Capital Medical University, No.2, Anzhen Road, Chaoyang District, Beijing, 100029, China
| | - Bing Zhang
- School of Biomedical Engineering, Sun Yat-Sen University, Guangzhou, China
| | - Saidi Guo
- School of Biomedical Engineering, Sun Yat-Sen University, Guangzhou, China
| | - Kairui Bo
- Department of Radiology, Beijing Anzhen Hospital, Capital Medical University, No.2, Anzhen Road, Chaoyang District, Beijing, 100029, China
| | - Shuang Li
- Department of Radiology, Beijing Anzhen Hospital, Capital Medical University, No.2, Anzhen Road, Chaoyang District, Beijing, 100029, China
| | - Nan Zhang
- Department of Radiology, Beijing Anzhen Hospital, Capital Medical University, No.2, Anzhen Road, Chaoyang District, Beijing, 100029, China
| | - Hui Wang
- Department of Radiology, Beijing Anzhen Hospital, Capital Medical University, No.2, Anzhen Road, Chaoyang District, Beijing, 100029, China
| | - Guang Yang
- Cardiovascular Research Centre, Royal Brompton Hospital, London, SW3 6NP, UK
- National Heart and Lung Institute, Imperial College London, London, SW7 2AZ, UK
| | - Heye Zhang
- School of Biomedical Engineering, Sun Yat-Sen University, Guangzhou, China
| | - Tong Liu
- Department of Cardiology, Beijing Anzhen Hospital, Capital Medical University, No.2, Anzhen Road, Chaoyang District, Beijing, 100029, China.
| | - Lei Xu
- Department of Radiology, Beijing Anzhen Hospital, Capital Medical University, No.2, Anzhen Road, Chaoyang District, Beijing, 100029, China.
| |
Collapse
|
19
|
Mariscal-Harana J, Asher C, Vergani V, Rizvi M, Keehn L, Kim RJ, Judd RM, Petersen SE, Razavi R, King AP, Ruijsink B, Puyol-Antón E. An artificial intelligence tool for automated analysis of large-scale unstructured clinical cine cardiac magnetic resonance databases. EUROPEAN HEART JOURNAL. DIGITAL HEALTH 2023; 4:370-383. [PMID: 37794871 PMCID: PMC10545512 DOI: 10.1093/ehjdh/ztad044] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/13/2023] [Revised: 06/05/2023] [Accepted: 07/12/2023] [Indexed: 10/06/2023]
Abstract
Aims Artificial intelligence (AI) techniques have been proposed for automating analysis of short-axis (SAX) cine cardiac magnetic resonance (CMR), but no CMR analysis tool exists to automatically analyse large (unstructured) clinical CMR datasets. We develop and validate a robust AI tool for start-to-end automatic quantification of cardiac function from SAX cine CMR in large clinical databases. Methods and results Our pipeline for processing and analysing CMR databases includes automated steps to identify the correct data, robust image pre-processing, an AI algorithm for biventricular segmentation of SAX CMR and estimation of functional biomarkers, and automated post-analysis quality control to detect and correct errors. The segmentation algorithm was trained on 2793 CMR scans from two NHS hospitals and validated on additional cases from this dataset (n = 414) and five external datasets (n = 6888), including scans of patients with a range of diseases acquired at 12 different centres using CMR scanners from all major vendors. Median absolute errors in cardiac biomarkers were within the range of inter-observer variability: <8.4 mL (left ventricle volume), <9.2 mL (right ventricle volume), <13.3 g (left ventricular mass), and <5.9% (ejection fraction) across all datasets. Stratification of cases according to phenotypes of cardiac disease and scanner vendors showed good performance across all groups. Conclusion We show that our proposed tool, which combines image pre-processing steps, a domain-generalizable AI algorithm trained on a large-scale multi-domain CMR dataset and quality control steps, allows robust analysis of (clinical or research) databases from multiple centres, vendors, and cardiac diseases. This enables translation of our tool for use in fully automated processing of large multi-centre databases.
Collapse
Affiliation(s)
- Jorge Mariscal-Harana
- School of Biomedical Engineering & Imaging Sciences Rayne Institute, 4th Floor, Lambeth Wing St. Thomas' Hospital Westminster Bridge Road London SE1 7EH
| | - Clint Asher
- School of Biomedical Engineering & Imaging Sciences Rayne Institute, 4th Floor, Lambeth Wing St. Thomas' Hospital Westminster Bridge Road London SE1 7EH
- Department of Adult and Paediatric Cardiology, Guy’s and St Thomas’ NHS Foundation Trust, Westminster Bridge Road, London SE1 7EH, London, UK
| | - Vittoria Vergani
- School of Biomedical Engineering & Imaging Sciences Rayne Institute, 4th Floor, Lambeth Wing St. Thomas' Hospital Westminster Bridge Road London SE1 7EH
| | - Maleeha Rizvi
- School of Biomedical Engineering & Imaging Sciences Rayne Institute, 4th Floor, Lambeth Wing St. Thomas' Hospital Westminster Bridge Road London SE1 7EH
- Department of Adult and Paediatric Cardiology, Guy’s and St Thomas’ NHS Foundation Trust, Westminster Bridge Road, London SE1 7EH, London, UK
| | - Louise Keehn
- Department of Clinical Pharmacology, King’s College London British Heart Foundation Centre, St Thomas’ Hospital, London, Westminster Bridge Road, London SE1 7EH, UK
| | - Raymond J Kim
- Division of Cardiology, Department of Medicine, Duke University, 40 Duke Medicine Circle, Durham, NC 27710, USA
| | - Robert M Judd
- Division of Cardiology, Department of Medicine, Duke University, 40 Duke Medicine Circle, Durham, NC 27710, USA
| | - Steffen E Petersen
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, Charterhouse Square, London EC1M 6BQ, UK
- Barts Heart Centre, St Bartholomew’s Hospital, Barts Health NHS Trust, W Smithfield, London EC1A 7BE, UK
- Health Data Research UK, Gibbs Building, 215 Euston Rd., London NW1 2BE, UK
- Alan Turing Institute, 96 Euston Rd., London NW1 2DB, UK
| | - Reza Razavi
- School of Biomedical Engineering & Imaging Sciences Rayne Institute, 4th Floor, Lambeth Wing St. Thomas' Hospital Westminster Bridge Road London SE1 7EH
- Department of Adult and Paediatric Cardiology, Guy’s and St Thomas’ NHS Foundation Trust, Westminster Bridge Road, London SE1 7EH, London, UK
| | - Andrew P King
- School of Biomedical Engineering & Imaging Sciences Rayne Institute, 4th Floor, Lambeth Wing St. Thomas' Hospital Westminster Bridge Road London SE1 7EH
| | - Bram Ruijsink
- School of Biomedical Engineering & Imaging Sciences Rayne Institute, 4th Floor, Lambeth Wing St. Thomas' Hospital Westminster Bridge Road London SE1 7EH
- Department of Adult and Paediatric Cardiology, Guy’s and St Thomas’ NHS Foundation Trust, Westminster Bridge Road, London SE1 7EH, London, UK
- Department of Cardiology, Division Heart and Lungs, University Medical Center Utrecht, Utrecht University, 3584 CX Utrecht, the Netherlands
| | - Esther Puyol-Antón
- School of Biomedical Engineering & Imaging Sciences Rayne Institute, 4th Floor, Lambeth Wing St. Thomas' Hospital Westminster Bridge Road London SE1 7EH
| |
Collapse
|
20
|
Sheikhjafari A, Krishnaswamy D, Noga M, Ray N, Punithakumar K. Deep Learning Based Parameterization of Diffeomorphic Image Registration for Cardiac Image Segmentation. IEEE Trans Nanobioscience 2023; 22:800-807. [PMID: 37220045 DOI: 10.1109/tnb.2023.3276867] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/25/2023]
Abstract
Cardiac segmentation from magnetic resonance imaging (MRI) is one of the essential tasks in analyzing the anatomy and function of the heart for the assessment and diagnosis of cardiac diseases. However, cardiac MRI generates hundreds of images per scan, and manual annotation of them is challenging and time-consuming, and therefore processing these images automatically is of interest. This study proposes a novel end-to-end supervised cardiac MRI segmentation framework based on a diffeomorphic deformable registration that can segment cardiac chambers from 2D and 3D images or volumes. To represent actual cardiac deformation, the method parameterizes the transformation using radial and rotational components computed via deep learning, with a set of paired images and segmentation masks used for training. The formulation guarantees transformations that are invertible and prevents mesh folding, which is essential for preserving the topology of the segmentation results. A physically plausible transformation is achieved by employing diffeomorphism in computing the transformations and activation functions that constrain the range of the radial and rotational components. The method was evaluated over three different data sets and showed significant improvements compared to exacting learning and non-learning based methods in terms of the Dice score and Hausdorff distance metrics.
Collapse
|
21
|
Antonopoulos AS, Vrettos A, Androulakis E, Kamperou C, Vlachopoulos C, Tsioufis K, Mohiaddin R, Lazaros G. Cardiac magnetic resonance imaging of pericardial diseases: a comprehensive guide. Eur Heart J Cardiovasc Imaging 2023; 24:983-998. [PMID: 37207354 DOI: 10.1093/ehjci/jead092] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/03/2023] [Indexed: 05/21/2023] Open
Abstract
Cardiac magnetic resonance (CMR) imaging has been established as a valuable diagnostic tool in the assessment of pericardial diseases by providing information on cardiac anatomy and function, surrounding extra-cardiac structures, pericardial thickening and effusion, characterization of pericardial effusion, and the presence of active pericardial inflammation from the same scan. In addition, CMR imaging has excellent diagnostic accuracy for the non-invasive detection of constrictive physiology evading the need for invasive catheterization in most instances. Growing evidence in the field suggests that pericardial enhancement on CMR is not only diagnostic of pericarditis but also has prognostic value for pericarditis recurrence, although such evidence is derived from small patient cohorts. CMR findings could also be used to guide treatment de-escalation or up-titration in recurrent pericarditis and selecting patients most likely to benefit from novel treatments such as anakinra and rilonacept. This article is an overview of the CMR applications in pericardial syndromes as a primer for reporting physicians. We sought to provide a summary of the clinical protocols used and an interpretation of the major CMR findings in the setting of pericardial diseases. We also discuss points that are less well clear and delineate the strengths and weak points of CMR in pericardial diseases.
Collapse
Affiliation(s)
- Alexios S Antonopoulos
- 1st Cardiology Department, Hipporkration Hospital, National and Kapodistrian University of Athens, 114 Vas Sofias Avenue 11527 Athens Greece
- Clinical, Experimental Surgery & Translational Research Center, Biomedical Research Foundation of the Academy of Athens, 4 Soranou Efesiou Street, 11527, AthensGreece
| | - Apostolos Vrettos
- Department of Cardiology, St Bartholomew's Hospital, Barts Health NHS Trust, London, UK
| | - Emmanouil Androulakis
- CMR Unit, Royal Brompton Hospital, Royal Brompton and Harefield NHS Foundation Trust, Chelsea, London
| | - Christina Kamperou
- 1st Cardiology Department, Hipporkration Hospital, National and Kapodistrian University of Athens, 114 Vas Sofias Avenue 11527 Athens Greece
| | - Charalambos Vlachopoulos
- 1st Cardiology Department, Hipporkration Hospital, National and Kapodistrian University of Athens, 114 Vas Sofias Avenue 11527 Athens Greece
| | - Konstantinos Tsioufis
- 1st Cardiology Department, Hipporkration Hospital, National and Kapodistrian University of Athens, 114 Vas Sofias Avenue 11527 Athens Greece
| | - Raad Mohiaddin
- CMR Unit, Royal Brompton Hospital, Royal Brompton and Harefield NHS Foundation Trust, Chelsea, London
| | - George Lazaros
- 1st Cardiology Department, Hipporkration Hospital, National and Kapodistrian University of Athens, 114 Vas Sofias Avenue 11527 Athens Greece
| |
Collapse
|
22
|
Cau R, Pisu F, Suri JS, Mannelli L, Scaglione M, Masala S, Saba L. Artificial Intelligence Applications in Cardiovascular Magnetic Resonance Imaging: Are We on the Path to Avoiding the Administration of Contrast Media? Diagnostics (Basel) 2023; 13:2061. [PMID: 37370956 PMCID: PMC10297403 DOI: 10.3390/diagnostics13122061] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Revised: 06/10/2023] [Accepted: 06/12/2023] [Indexed: 06/29/2023] Open
Abstract
In recent years, cardiovascular imaging examinations have experienced exponential growth due to technological innovation, and this trend is consistent with the most recent chest pain guidelines. Contrast media have a crucial role in cardiovascular magnetic resonance (CMR) imaging, allowing for more precise characterization of different cardiovascular diseases. However, contrast media have contraindications and side effects that limit their clinical application in determinant patients. The application of artificial intelligence (AI)-based techniques to CMR imaging has led to the development of non-contrast models. These AI models utilize non-contrast imaging data, either independently or in combination with clinical and demographic data, as input to generate diagnostic or prognostic algorithms. In this review, we provide an overview of the main concepts pertaining to AI, review the existing literature on non-contrast AI models in CMR, and finally, discuss the strengths and limitations of these AI models and their possible future development.
Collapse
Affiliation(s)
- Riccardo Cau
- Department of Radiology, University Hospital of Cagliari, 09042 Monserrato, Italy; (R.C.); (F.P.)
| | - Francesco Pisu
- Department of Radiology, University Hospital of Cagliari, 09042 Monserrato, Italy; (R.C.); (F.P.)
| | - Jasjit S. Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA;
| | | | - Mariano Scaglione
- Department of Radiology, University Hospital of Sassari, 07100 Sassari, Italy; (M.S.); (S.M.)
| | - Salvatore Masala
- Department of Radiology, University Hospital of Sassari, 07100 Sassari, Italy; (M.S.); (S.M.)
| | - Luca Saba
- Department of Radiology, University Hospital of Cagliari, 09042 Monserrato, Italy; (R.C.); (F.P.)
| |
Collapse
|
23
|
Varadarajan V, Gidding S, Wu C, Carr J, Lima JA. Imaging Early Life Cardiovascular Phenotype. Circ Res 2023; 132:1607-1627. [PMID: 37289903 PMCID: PMC10501740 DOI: 10.1161/circresaha.123.322054] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Accepted: 04/30/2023] [Indexed: 06/10/2023]
Abstract
The growing epidemics of obesity, hypertension, and diabetes, in addition to worsening environmental factors such as air pollution, water scarcity, and climate change, have fueled the continuously increasing prevalence of cardiovascular diseases (CVDs). This has caused a markedly increasing burden of CVDs that includes mortality and morbidity worldwide. Identification of subclinical CVD before overt symptoms can lead to earlier deployment of preventative pharmacological and nonpharmacologic strategies. In this regard, noninvasive imaging techniques play a significant role in identifying early CVD phenotypes. An armamentarium of imaging techniques including vascular ultrasound, echocardiography, magnetic resonance imaging, computed tomography, noninvasive computed tomography angiography, positron emission tomography, and nuclear imaging, with intrinsic strengths and limitations can be utilized to delineate incipient CVD for both clinical and research purposes. In this article, we review the various imaging modalities used for the evaluation, characterization, and quantification of early subclinical cardiovascular diseases.
Collapse
Affiliation(s)
- Vinithra Varadarajan
- Division of Cardiology, Department of Medicine Johns Hopkins University, Baltimore, MD
| | | | - Colin Wu
- Department of Medicine, National Heart, Lung and Blood Institute, Bethesda, MD
| | - Jeffrey Carr
- Department Radiology and Radiological Sciences, Vanderbilt University, Nashville, TN
| | - Joao A.C. Lima
- Division of Cardiology, Department of Medicine Johns Hopkins University, Baltimore, MD
| |
Collapse
|
24
|
DiLorenzo MP, Grosse-Wortmann L. Myocardial Fibrosis in Congenital Heart Disease and the Role of MRI. Radiol Cardiothorac Imaging 2023; 5:e220255. [PMID: 37404787 PMCID: PMC10316299 DOI: 10.1148/ryct.220255] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2022] [Revised: 04/10/2023] [Accepted: 04/17/2023] [Indexed: 07/06/2023]
Abstract
Progress in the field of congenital heart surgery over the last century can only be described as revolutionary. Recent improvements in patient outcomes have been achieved through refinements in perioperative care. In the current and future eras, the preservation and restoration of myocardial health, beginning with the monitoring of tissue remodeling, will be central to improving cardiac outcomes. Visualization and quantification of fibrotic myocardial remodeling is one of the greatest assets that cardiac MRI brings to the field of cardiology, and its clinical use within the field of congenital heart disease (CHD) has been an area of particular interest in the last few decades. This review summarizes the physical underpinnings of myocardial tissue characterization in CHD, with an emphasis on T1 parametric mapping and late gadolinium enhancement. It describes methods and suggestions for obtaining images, extracting quantitative and qualitative data, and interpreting the results for children and adults with CHD. The tissue characterization observed in different lesions is used to examine the causes and pathomechanisms of fibrotic remodeling in this population. Similarly, the clinical consequences of elevated imaging biomarkers of fibrosis on patient health and outcomes are explored. Keywords: Pediatrics, MR Imaging, Cardiac, Heart, Congenital, Tissue Characterization, Congenital Heart Disease, Cardiac MRI, Parametric Mapping, Fibrosis, Late Gadolinium Enhancement © RSNA, 2023.
Collapse
|
25
|
Yoon S, Nakamori S, Amyar A, Assana S, Cirillo J, Morales MA, Chow K, Bi X, Pierce P, Goddu B, Rodriguez J, H. Ngo L, J. Manning W, Nezafat R. Accelerated Cardiac MRI Cine with Use of Resolution Enhancement Generative Adversarial Inline Neural Network. Radiology 2023; 307:e222878. [PMID: 37249435 PMCID: PMC10315558 DOI: 10.1148/radiol.222878] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2022] [Revised: 03/29/2023] [Accepted: 04/17/2023] [Indexed: 05/31/2023]
Abstract
Background Cardiac cine can benefit from deep learning-based image reconstruction to reduce scan time and/or increase spatial and temporal resolution. Purpose To develop and evaluate a deep learning model that can be combined with parallel imaging or compressed sensing (CS). Materials and Methods The deep learning model was built on the enhanced super-resolution generative adversarial inline neural network, trained with use of retrospectively identified cine images and evaluated in participants prospectively enrolled from September 2021 to September 2022. The model was applied to breath-hold electrocardiography (ECG)-gated segmented and free-breathing real-time cine images collected with reduced spatial resolution with use of generalized autocalibrating partially parallel acquisitions (GRAPPA) or CS. The deep learning model subsequently restored spatial resolution. For comparison, GRAPPA-accelerated cine images were collected. Diagnostic quality and artifacts were evaluated by two readers with use of Likert scales and compared with use of Wilcoxon signed-rank tests. Agreement for left ventricle (LV) function, volume, and strain was assessed with Bland-Altman analysis. Results The deep learning model was trained on 1616 patients (mean age ± SD, 56 years ± 16; 920 men) and evaluated in 181 individuals, 126 patients (mean age, 57 years ± 16; 77 men) and 55 healthy subjects (mean age, 27 years ± 10; 15 men). In breath-hold ECG-gated segmented cine and free-breathing real-time cine, the deep learning model and GRAPPA showed similar diagnostic quality scores (2.9 vs 2.9, P = .41, deep learning vs GRAPPA) and artifact score (4.4 vs 4.3, P = .55, deep learning vs GRAPPA). Deep learning acquired more sections per breath-hold than GRAPPA (3.1 vs one section, P < .001). In free-breathing real-time cine, the deep learning showed a similar diagnostic quality score (2.9 vs 2.9, P = .21, deep learning vs GRAPPA) and lower artifact score (3.9 vs 4.3, P < .001, deep learning vs GRAPPA). For both sequences, the deep learning model showed excellent agreement for LV parameters, with near-zero mean differences and narrow limits of agreement compared with GRAPPA. Conclusion Deep learning-accelerated cardiac cine showed similarly accurate quantification of cardiac function, volume, and strain to a standardized parallel imaging method. © RSNA, 2023 Supplemental material is available for this article. See also the editorial by Vannier and Wang in this issue.
Collapse
Affiliation(s)
- Siyeop Yoon
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Shiro Nakamori
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Amine Amyar
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Salah Assana
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Julia Cirillo
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Manuel A. Morales
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Kelvin Chow
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Xiaoming Bi
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Patrick Pierce
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Beth Goddu
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Jennifer Rodriguez
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Long H. Ngo
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Warren J. Manning
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| | - Reza Nezafat
- From the Department of Medicine (Cardiovascular Division) (S.Y.,
S.N., A.A., S.A., J.C., M.A.M., P.P., B.G., J.R., W.J.M., R.N.), Department of
Medicine (General Medicine Division) (L.H.N.), and Department of Radiology
(W.J.M.), Beth Israel Deaconess Medical Center and Harvard Medical School, 330
Brookline Ave, Boston, MA 02215; Siemens Medical Solutions, Chicago, Ill (K.C.,
X.B.); and Department of Biostatistics, Harvard T.H. Chan School of Public
Health, Boston, Mass (L.H.N.)
| |
Collapse
|
26
|
Jafari M, Shoeibi A, Khodatars M, Ghassemi N, Moridian P, Alizadehsani R, Khosravi A, Ling SH, Delfan N, Zhang YD, Wang SH, Gorriz JM, Alinejad-Rokny H, Acharya UR. Automated diagnosis of cardiovascular diseases from cardiac magnetic resonance imaging using deep learning models: A review. Comput Biol Med 2023; 160:106998. [PMID: 37182422 DOI: 10.1016/j.compbiomed.2023.106998] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2022] [Revised: 03/01/2023] [Accepted: 04/28/2023] [Indexed: 05/16/2023]
Abstract
In recent years, cardiovascular diseases (CVDs) have become one of the leading causes of mortality globally. At early stages, CVDs appear with minor symptoms and progressively get worse. The majority of people experience symptoms such as exhaustion, shortness of breath, ankle swelling, fluid retention, and other symptoms when starting CVD. Coronary artery disease (CAD), arrhythmia, cardiomyopathy, congenital heart defect (CHD), mitral regurgitation, and angina are the most common CVDs. Clinical methods such as blood tests, electrocardiography (ECG) signals, and medical imaging are the most effective methods used for the detection of CVDs. Among the diagnostic methods, cardiac magnetic resonance imaging (CMRI) is increasingly used to diagnose, monitor the disease, plan treatment and predict CVDs. Coupled with all the advantages of CMR data, CVDs diagnosis is challenging for physicians as each scan has many slices of data, and the contrast of it might be low. To address these issues, deep learning (DL) techniques have been employed in the diagnosis of CVDs using CMR data, and much research is currently being conducted in this field. This review provides an overview of the studies performed in CVDs detection using CMR images and DL techniques. The introduction section examined CVDs types, diagnostic methods, and the most important medical imaging techniques. The following presents research to detect CVDs using CMR images and the most significant DL methods. Another section discussed the challenges in diagnosing CVDs from CMRI data. Next, the discussion section discusses the results of this review, and future work in CVDs diagnosis from CMR images and DL techniques are outlined. Finally, the most important findings of this study are presented in the conclusion section.
Collapse
Affiliation(s)
- Mahboobeh Jafari
- Internship in BioMedical Machine Learning Lab, The Graduate School of Biomedical Engineering, UNSW Sydney, Sydney, NSW, 2052, Australia
| | - Afshin Shoeibi
- Internship in BioMedical Machine Learning Lab, The Graduate School of Biomedical Engineering, UNSW Sydney, Sydney, NSW, 2052, Australia; Data Science and Computational Intelligence Institute, University of Granada, Spain.
| | - Marjane Khodatars
- Data Science and Computational Intelligence Institute, University of Granada, Spain
| | - Navid Ghassemi
- Internship in BioMedical Machine Learning Lab, The Graduate School of Biomedical Engineering, UNSW Sydney, Sydney, NSW, 2052, Australia
| | - Parisa Moridian
- Data Science and Computational Intelligence Institute, University of Granada, Spain
| | - Roohallah Alizadehsani
- Institute for Intelligent Systems Research and Innovation, Deakin University, Geelong, Australia
| | - Abbas Khosravi
- Institute for Intelligent Systems Research and Innovation, Deakin University, Geelong, Australia
| | - Sai Ho Ling
- Faculty of Engineering and IT, University of Technology Sydney (UTS), Australia
| | - Niloufar Delfan
- Faculty of Computer Engineering, Dept. of Artificial Intelligence Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Yu-Dong Zhang
- School of Computing and Mathematical Sciences, University of Leicester, Leicester, UK
| | - Shui-Hua Wang
- School of Computing and Mathematical Sciences, University of Leicester, Leicester, UK
| | - Juan M Gorriz
- Data Science and Computational Intelligence Institute, University of Granada, Spain; Department of Psychiatry, University of Cambridge, UK
| | - Hamid Alinejad-Rokny
- BioMedical Machine Learning Lab, The Graduate School of Biomedical Engineering, UNSW Sydney, Sydney, NSW, 2052, Australia; UNSW Data Science Hub, The University of New South Wales, Sydney, NSW, 2052, Australia; Health Data Analytics Program, Centre for Applied Artificial Intelligence, Macquarie University, Sydney, 2109, Australia
| | - U Rajendra Acharya
- School of Mathematics, Physics and Computing, University of Southern Queensland, Springfield, Australia; Dept. of Biomedical Informatics and Medical Engineering, Asia University, Taichung, Taiwan
| |
Collapse
|
27
|
Pujadas ER, Raisi-Estabragh Z, Szabo L, McCracken C, Morcillo CI, Campello VM, Martín-Isla C, Atehortua AM, Vago H, Merkely B, Maurovich-Horvat P, Harvey NC, Neubauer S, Petersen SE, Lekadir K. Prediction of incident cardiovascular events using machine learning and CMR radiomics. Eur Radiol 2023; 33:3488-3500. [PMID: 36512045 PMCID: PMC10121487 DOI: 10.1007/s00330-022-09323-z] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2022] [Revised: 09/28/2022] [Accepted: 11/28/2022] [Indexed: 12/15/2022]
Abstract
OBJECTIVES Evaluation of the feasibility of using cardiovascular magnetic resonance (CMR) radiomics in the prediction of incident atrial fibrillation (AF), heart failure (HF), myocardial infarction (MI), and stroke using machine learning techniques. METHODS We identified participants from the UK Biobank who experienced incident AF, HF, MI, or stroke during the continuous longitudinal follow-up. The CMR indices and the vascular risk factors (VRFs) as well as the CMR images were obtained for each participant. Three-segmented regions of interest (ROIs) were computed: right ventricle cavity, left ventricle (LV) cavity, and LV myocardium in end-systole and end-diastole phases. Radiomics features were extracted from the 3D volumes of the ROIs. Seven integrative models were built for each incident cardiovascular disease (CVD) as an outcome. Each model was built with VRF, CMR indices, and radiomics features and a combination of them. Support vector machine was used for classification. To assess the model performance, the accuracy, sensitivity, specificity, and AUC were reported. RESULTS AF prediction model using the VRF+CMR+Rad model (accuracy: 0.71, AUC 0.76) obtained the best result. However, the AUC was similar to the VRF+Rad model. HF showed the most significant improvement with the inclusion of CMR metrics (VRF+CMR+Rad: 0.79, AUC 0.84). Moreover, adding only the radiomics features to the VRF reached an almost similarly good performance (VRF+Rad: accuracy 0.77, AUC 0.83). Prediction models looking into incident MI and stroke reached slightly smaller improvement. CONCLUSIONS Radiomics features may provide incremental predictive value over VRF and CMR indices in the prediction of incident CVDs. KEY POINTS • Prediction of incident atrial fibrillation, heart failure, stroke, and myocardial infarction using machine learning techniques. • CMR radiomics, vascular risk factors, and standard CMR indices will be considered in the machine learning models. • The experiments show that radiomics features can provide incremental predictive value over VRF and CMR indices in the prediction of incident cardiovascular diseases.
Collapse
Affiliation(s)
- Esmeralda Ruiz Pujadas
- Artificial Intelligence in Medicine Lab (BCN-AIM), Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Barcelona, Spain.
| | - Zahra Raisi-Estabragh
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, Charterhouse Square, London, EC1M 6BQ, UK
- Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, West Smithfield, London, EC1A 7BE, UK
| | - Liliana Szabo
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, Charterhouse Square, London, EC1M 6BQ, UK
- Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, West Smithfield, London, EC1A 7BE, UK
- Semmelweis University Heart and Vascular Center, Budapest, Hungary
| | - Celeste McCracken
- Division of Cardiovascular Medicine, Radcliffe Department of Medicine, University of Oxford, National Institute for Health Research Oxford Biomedical Research Centre, Oxford University Hospitals NHS Foundation Trust, Oxford, OX3 9DU, UK
| | - Cristian Izquierdo Morcillo
- Artificial Intelligence in Medicine Lab (BCN-AIM), Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Barcelona, Spain
| | - Víctor M Campello
- Artificial Intelligence in Medicine Lab (BCN-AIM), Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Barcelona, Spain
| | - Carlos Martín-Isla
- Artificial Intelligence in Medicine Lab (BCN-AIM), Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Barcelona, Spain
| | - Angelica M Atehortua
- Artificial Intelligence in Medicine Lab (BCN-AIM), Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Barcelona, Spain
| | - Hajnalka Vago
- Semmelweis University Heart and Vascular Center, Budapest, Hungary
| | - Bela Merkely
- Semmelweis University Heart and Vascular Center, Budapest, Hungary
| | | | - Nicholas C Harvey
- MRC Lifecourse Epidemiology Centre, University of Southampton, Southampton, UK
- NIHR Southampton Biomedical Research Centre, University of Southampton and University Hospital Southampton NHS Foundation Trust, Southampton, UK
| | - Stefan Neubauer
- Division of Cardiovascular Medicine, Radcliffe Department of Medicine, University of Oxford, National Institute for Health Research Oxford Biomedical Research Centre, Oxford University Hospitals NHS Foundation Trust, Oxford, OX3 9DU, UK
| | - Steffen E Petersen
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, Charterhouse Square, London, EC1M 6BQ, UK
- Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, West Smithfield, London, EC1A 7BE, UK
- Health Data Research UK, London, UK
- Alan Turing Institute, London, UK
| | - Karim Lekadir
- Artificial Intelligence in Medicine Lab (BCN-AIM), Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Barcelona, Spain.
| |
Collapse
|
28
|
Al Khalil Y, Amirrajab S, Lorenz C, Weese J, Pluim J, Breeuwer M. Reducing segmentation failures in cardiac MRI via late feature fusion and GAN-based augmentation. Comput Biol Med 2023; 161:106973. [PMID: 37209615 DOI: 10.1016/j.compbiomed.2023.106973] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2022] [Revised: 04/05/2023] [Accepted: 04/22/2023] [Indexed: 05/22/2023]
Abstract
Cardiac magnetic resonance (CMR) image segmentation is an integral step in the analysis of cardiac function and diagnosis of heart related diseases. While recent deep learning-based approaches in automatic segmentation have shown great promise to alleviate the need for manual segmentation, most of these are not applicable to realistic clinical scenarios. This is largely due to training on mainly homogeneous datasets, without variation in acquisition, which typically occurs in multi-vendor and multi-site settings, as well as pathological data. Such approaches frequently exhibit a degradation in prediction performance, particularly on outlier cases commonly associated with difficult pathologies, artifacts and extensive changes in tissue shape and appearance. In this work, we present a model aimed at segmenting all three cardiac structures in a multi-center, multi-disease and multi-view scenario. We propose a pipeline, addressing different challenges with segmentation of such heterogeneous data, consisting of heart region detection, augmentation through image synthesis and a late-fusion segmentation approach. Extensive experiments and analysis demonstrate the ability of the proposed approach to tackle the presence of outlier cases during both training and testing, allowing for better adaptation to unseen and difficult examples. Overall, we show that the effective reduction of segmentation failures on outlier cases has a positive impact on not only the average segmentation performance, but also on the estimation of clinical parameters, leading to a better consistency in derived metrics.
Collapse
Affiliation(s)
- Yasmina Al Khalil
- Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands.
| | - Sina Amirrajab
- Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands
| | | | | | - Josien Pluim
- Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands
| | - Marcel Breeuwer
- Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands; Philips Healthcare, MR R&D - Clinical Science, Best, The Netherlands
| |
Collapse
|
29
|
Ünlü S, Özden Ö, Çelik A. Imaging in Heart Failure with Preserved Ejection Fraction: A Multimodality Imaging Point of View. Card Fail Rev 2023; 9:e04. [PMID: 37387734 PMCID: PMC10301698 DOI: 10.15420/cfr.2022.27] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/15/2022] [Accepted: 10/18/2022] [Indexed: 07/01/2023] Open
Abstract
Heart failure with preserved ejection fraction (HFpEF) is an important global health problem. Despite increased prevalence due to improved diagnostic options, limited improvement has been achieved in cardiac outcomes. HFpEF is an extremely complex syndrome and multimodality imaging is important for diagnosis, identifying its different phenotypes and determining prognosis. Evaluation of left ventricular filling pressures using echocardiographic diastolic function parameters is the first step of imaging in clinical practice. The role of echocardiography is becoming more popular and with the recent developments in deformation imaging, cardiac MRI is extremely important as it can provide tissue characterisation, identify fibrosis and optimal volume measurements of cardiac chambers. Nuclear imaging methods can also be used in the diagnosis of specific diseases, such as cardiac amyloidosis.
Collapse
Affiliation(s)
- Serkan Ünlü
- Department of Cardiology, Gazi UniversityAnkara, Turkey
| | - Özge Özden
- Cardiology Department, Memorial Bahçelievler HospitalIstanbul, Turkey
| | - Ahmet Çelik
- Department of Cardiology, Mersin UniversityMersin, Turkey
| |
Collapse
|
30
|
Zaman S, Vimalesvaran K, Howard JP, Chappell D, Varela M, Peters NS, Francis DP, Bharath AA, Linton NWF, Cole GD. Efficient labelling for efficient deep learning: the benefit of a multiple-image-ranking method to generate high volume training data applied to ventricular slice level classification in cardiac MRI. JOURNAL OF MEDICAL ARTIFICIAL INTELLIGENCE 2023; 6:4. [PMID: 37346802 PMCID: PMC7614685 DOI: 10.21037/jmai-22-55] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/23/2023]
Abstract
Background Getting the most value from expert clinicians' limited labelling time is a major challenge for artificial intelligence (AI) development in clinical imaging. We present a novel method for ground-truth labelling of cardiac magnetic resonance imaging (CMR) image data by leveraging multiple clinician experts ranking multiple images on a single ordinal axis, rather than manual labelling of one image at a time. We apply this strategy to train a deep learning (DL) model to classify the anatomical position of CMR images. This allows the automated removal of slices that do not contain the left ventricular (LV) myocardium. Methods Anonymised LV short-axis slices from 300 random scans (3,552 individual images) were extracted. Each image's anatomical position relative to the LV was labelled using two different strategies performed for 5 hours each: (I) 'one-image-at-a-time': each image labelled according to its position: 'too basal', 'LV', or 'too apical' individually by one of three experts; and (II) 'multiple-image-ranking': three independent experts ordered slices according to their relative position from 'most-basal' to 'most apical' in batches of eight until each image had been viewed at least 3 times. Two convolutional neural networks were trained for a three-way classification task (each model using data from one labelling strategy). The models' performance was evaluated by accuracy, F1-score, and area under the receiver operating characteristics curve (ROC AUC). Results After excluding images with artefact, 3,323 images were labelled by both strategies. The model trained using labels from the 'multiple-image-ranking strategy' performed better than the model using the 'one-image-at-a-time' labelling strategy (accuracy 86% vs. 72%, P=0.02; F1-score 0.86 vs. 0.75; ROC AUC 0.95 vs. 0.86). For expert clinicians performing this task manually the intra-observer variability was low (Cohen's κ=0.90), but the inter-observer variability was higher (Cohen's κ=0.77). Conclusions We present proof of concept that, given the same clinician labelling effort, comparing multiple images side-by-side using a 'multiple-image-ranking' strategy achieves ground truth labels for DL more accurately than by classifying images individually. We demonstrate a potential clinical application: the automatic removal of unrequired CMR images. This leads to increased efficiency by focussing human and machine attention on images which are needed to answer clinical questions.
Collapse
Affiliation(s)
- Sameer Zaman
- National Heart and Lung Institute, Imperial College London, London, UK
- Imperial College Healthcare NHS Trust, London, UK
- AI for Healthcare Centre for Doctoral Training, Imperial College London, London, UK
| | - Kavitha Vimalesvaran
- National Heart and Lung Institute, Imperial College London, London, UK
- Imperial College Healthcare NHS Trust, London, UK
- AI for Healthcare Centre for Doctoral Training, Imperial College London, London, UK
| | - James P. Howard
- National Heart and Lung Institute, Imperial College London, London, UK
- Imperial College Healthcare NHS Trust, London, UK
| | - Digby Chappell
- AI for Healthcare Centre for Doctoral Training, Imperial College London, London, UK
| | - Marta Varela
- National Heart and Lung Institute, Imperial College London, London, UK
| | | | - Darrel P. Francis
- National Heart and Lung Institute, Imperial College London, London, UK
| | - Anil A. Bharath
- Department of Bioengineering, Imperial College London, London, UK
| | - Nick W. F. Linton
- Imperial College Healthcare NHS Trust, London, UK
- Department of Bioengineering, Imperial College London, London, UK
| | - Graham D. Cole
- Imperial College Healthcare NHS Trust, London, UK
- Department of Bioengineering, Imperial College London, London, UK
| |
Collapse
|
31
|
Machine Learning Approaches in Diagnosis, Prognosis and Treatment Selection of Cardiac Amyloidosis. Int J Mol Sci 2023; 24:ijms24065680. [PMID: 36982754 PMCID: PMC10051237 DOI: 10.3390/ijms24065680] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2023] [Revised: 03/12/2023] [Accepted: 03/14/2023] [Indexed: 03/18/2023] Open
Abstract
Cardiac amyloidosis is an uncommon restrictive cardiomyopathy featuring an unregulated amyloid protein deposition that impairs organic function. Early cardiac amyloidosis diagnosis is generally delayed by indistinguishable clinical findings of more frequent hypertrophic diseases. Furthermore, amyloidosis is divided into various groups, according to a generally accepted taxonomy, based on the proteins that make up the amyloid deposits; a careful differentiation between the various forms of amyloidosis is necessary to undertake an adequate therapeutic treatment. Thus, cardiac amyloidosis is thought to be underdiagnosed, which delays necessary therapeutic procedures, diminishing quality of life and impairing clinical prognosis. The diagnostic work-up for cardiac amyloidosis begins with the identification of clinical features, electrocardiographic and imaging findings suggestive or compatible with cardiac amyloidosis, and often requires the histological demonstration of amyloid deposition. One approach to overcome the difficulty of an early diagnosis is the use of automated diagnostic algorithms. Machine learning enables the automatic extraction of salient information from “raw data” without the need for pre-processing methods based on the a priori knowledge of the human operator. This review attempts to assess the various diagnostic approaches and artificial intelligence computational techniques in the detection of cardiac amyloidosis.
Collapse
|
32
|
Hooper SM, Wu S, Davies RH, Bhuva A, Schelbert EB, Moon JC, Kellman P, Xue H, Langlotz C, Ré C. Evaluating semi-supervision methods for medical image segmentation: applications in cardiac magnetic resonance imaging. J Med Imaging (Bellingham) 2023; 10:024007. [PMID: 37009059 PMCID: PMC10061343 DOI: 10.1117/1.jmi.10.2.024007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2022] [Accepted: 02/27/2023] [Indexed: 03/31/2023] Open
Abstract
Purpose Neural networks have potential to automate medical image segmentation but require expensive labeling efforts. While methods have been proposed to reduce the labeling burden, most have not been thoroughly evaluated on large, clinical datasets or clinical tasks. We propose a method to train segmentation networks with limited labeled data and focus on thorough network evaluation. Approach We propose a semi-supervised method that leverages data augmentation, consistency regularization, and pseudolabeling and train four cardiac magnetic resonance (MR) segmentation networks. We evaluate the models on multiinstitutional, multiscanner, multidisease cardiac MR datasets using five cardiac functional biomarkers, which are compared to an expert's measurements using Lin's concordance correlation coefficient (CCC), the within-subject coefficient of variation (CV), and the Dice coefficient. Results The semi-supervised networks achieve strong agreement using Lin's CCC ( > 0.8 ), CV similar to an expert, and strong generalization performance. We compare the error modes of the semi-supervised networks against fully supervised networks. We evaluate semi-supervised model performance as a function of labeled training data and with different types of model supervision, showing that a model trained with 100 labeled image slices can achieve a Dice coefficient within 1.10% of a network trained with 16,000+ labeled image slices. Conclusion We evaluate semi-supervision for medical image segmentation using heterogeneous datasets and clinical metrics. As methods for training models with little labeled data become more common, knowledge about how they perform on clinical tasks, how they fail, and how they perform with different amounts of labeled data is useful to model developers and users.
Collapse
Affiliation(s)
- Sarah M. Hooper
- Stanford University, Department of Electrical Engineering, Stanford, California, United States
| | - Sen Wu
- Stanford University, Department of Computer Science, Stanford, California, United States
| | - Rhodri H. Davies
- Barts Health NHS Trust, Barts Heart Centre, London, United Kingdom
- University of College London, Institute of Cardiovascular Sciences, London, United Kingdom
- University of College London, MRC Centre for Lifelong Health and Ageing, London, United Kingdom
| | - Anish Bhuva
- Barts Health NHS Trust, Barts Heart Centre, London, United Kingdom
- University of College London, Institute of Cardiovascular Sciences, London, United Kingdom
| | - Erik B. Schelbert
- United Hospital, St. Paul, Minnesota, and Abbott Northwestern Hospital, Minneapolis Heart Institute, Minneapolis, Minnesota, United States
- UPMC Cardiovascular Magnetic Resonance Center, UPMC, Pittsburgh, Pennsylvania, United States
- University of Pittsburgh School of Medicine, Department of Medicine, Pittsburgh, Pennsylvania, United States
| | - James C. Moon
- Barts Health NHS Trust, Barts Heart Centre, London, United Kingdom
- University of College London, Institute of Cardiovascular Sciences, London, United Kingdom
| | - Peter Kellman
- National Heart, Lung and Blood Institute, National Institutes of Health, Bethesda, Maryland, United States
| | - Hui Xue
- National Heart, Lung and Blood Institute, National Institutes of Health, Bethesda, Maryland, United States
| | - Curtis Langlotz
- Stanford University, Department of Radiology, Department of Biomedical Informatics, Stanford, California, United States
| | - Christopher Ré
- Stanford University, Department of Computer Science, Stanford, California, United States
| |
Collapse
|
33
|
Bourfiss M, Sander J, de Vos BD, Te Riele ASJM, Asselbergs FW, Išgum I, Velthuis BK. Towards automatic classification of cardiovascular magnetic resonance Task Force Criteria for diagnosis of arrhythmogenic right ventricular cardiomyopathy. Clin Res Cardiol 2023; 112:363-378. [PMID: 36066609 PMCID: PMC9998324 DOI: 10.1007/s00392-022-02088-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Accepted: 08/16/2022] [Indexed: 11/03/2022]
Abstract
BACKGROUND Arrhythmogenic right ventricular cardiomyopathy (ARVC) is diagnosed according to the Task Force Criteria (TFC) in which cardiovascular magnetic resonance (CMR) imaging plays an important role. Our study aims to apply an automatic deep learning-based segmentation for right and left ventricular CMR assessment and evaluate this approach for classification of the CMR TFC. METHODS We included 227 subjects suspected of ARVC who underwent CMR. Subjects were classified into (1) ARVC patients fulfilling TFC; (2) at-risk family members; and (3) controls. To perform automatic segmentation, a Bayesian Dilated Residual Neural Network was trained and tested. Performance of automatic versus manual segmentation was assessed using Dice-coefficient and Hausdorff distance. Since automatic segmentation is most challenging in basal slices, manual correction of the automatic segmentation in the most basal slice was simulated (automatic-basal). CMR TFC calculated using manual and automatic-basal segmentation were compared using Cohen's Kappa (κ). RESULTS Automatic segmentation was trained on CMRs of 70 subjects (39.6 ± 18.1 years, 47% female) and tested on 157 subjects (36.9 ± 17.6 years, 59% female). Dice-coefficient and Hausdorff distance showed good agreement between manual and automatic segmentations (≥ 0.89 and ≤ 10.6 mm, respectively) which further improved after simulated correction of the most basal slice (≥ 0.92 and ≤ 9.2 mm, p < 0.001). Pearson correlation of volumetric and functional CMR measurements was good to excellent (automatic (r = 0.78-0.99, p < 0.001) and automatic-basal (r = 0.88-0.99, p < 0.001) measurements). CMR TFC classification using automatic-basal segmentations was comparable to manual segmentations (κ 0.98 ± 0.02) with comparable diagnostic performance. CONCLUSIONS Combining automatic segmentation of CMRs with correction of the most basal slice results in accurate CMR TFC classification of subjects suspected of ARVC.
Collapse
Affiliation(s)
- Mimount Bourfiss
- Department of Medicine, Division of Cardiology, University Medical Center Utrecht, Utrecht University, Heidelberglaan 100, 3584 CX, Utrecht, The Netherlands.
| | - Jörg Sander
- Department of Biomedical Engineering and Physics, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, The Netherlands
| | - Bob D de Vos
- Department of Biomedical Engineering and Physics, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, The Netherlands.,Amsterdam Cardiovascular Sciences, Heart Failure & Arrhythmias, Amsterdam, The Netherlands
| | - Anneline S J M Te Riele
- Department of Medicine, Division of Cardiology, University Medical Center Utrecht, Utrecht University, Heidelberglaan 100, 3584 CX, Utrecht, The Netherlands.,Netherlands Heart Institute, Utrecht, The Netherlands
| | - Folkert W Asselbergs
- Department of Medicine, Division of Cardiology, University Medical Center Utrecht, Utrecht University, Heidelberglaan 100, 3584 CX, Utrecht, The Netherlands.,Institute of Cardiovascular Science, Faculty of Population Health Sciences, University College London, London, UK.,Health Data Research UK and Institute of Health Informatics, University College London, London, UK
| | - Ivana Išgum
- Department of Biomedical Engineering and Physics, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, The Netherlands.,Amsterdam Cardiovascular Sciences, Heart Failure & Arrhythmias, Amsterdam, The Netherlands.,Department of Radiology and Nuclear Medicine, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, The Netherlands
| | - Birgitta K Velthuis
- Department of Radiology, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
34
|
Artificial Intelligence as a Diagnostic Tool in Non-Invasive Imaging in the Assessment of Coronary Artery Disease. Med Sci (Basel) 2023; 11:medsci11010020. [PMID: 36976528 PMCID: PMC10053913 DOI: 10.3390/medsci11010020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2023] [Revised: 02/20/2023] [Accepted: 02/22/2023] [Indexed: 03/02/2023] Open
Abstract
Coronary artery disease (CAD) remains a leading cause of mortality and morbidity worldwide, and it is associated with considerable economic burden. In an ageing, multimorbid population, it has become increasingly important to develop reliable, consistent, low-risk, non-invasive means of diagnosing CAD. The evolution of multiple cardiac modalities in this field has addressed this dilemma to a large extent, not only in providing information regarding anatomical disease, as is the case with coronary computed tomography angiography (CCTA), but also in contributing critical details about functional assessment, for instance, using stress cardiac magnetic resonance (S-CMR). The field of artificial intelligence (AI) is developing at an astounding pace, especially in healthcare. In healthcare, key milestones have been achieved using AI and machine learning (ML) in various clinical settings, from smartwatches detecting arrhythmias to retinal image analysis and skin cancer prediction. In recent times, we have seen an emerging interest in developing AI-based technology in the field of cardiovascular imaging, as it is felt that ML methods have potential to overcome some limitations of current risk models by applying computer algorithms to large databases with multidimensional variables, thus enabling the inclusion of complex relationships to predict outcomes. In this paper, we review the current literature on the various applications of AI in the assessment of CAD, with a focus on multimodality imaging, followed by a discussion on future perspectives and critical challenges that this field is likely to encounter as it continues to evolve in cardiology.
Collapse
|
35
|
Moradi H, Al-Hourani A, Concilia G, Khoshmanesh F, Nezami FR, Needham S, Baratchi S, Khoshmanesh K. Recent developments in modeling, imaging, and monitoring of cardiovascular diseases using machine learning. Biophys Rev 2023; 15:19-33. [PMID: 36909958 PMCID: PMC9995635 DOI: 10.1007/s12551-022-01040-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Accepted: 12/21/2022] [Indexed: 01/12/2023] Open
Abstract
Cardiovascular diseases are the leading cause of mortality, morbidity, and hospitalization around the world. Recent technological advances have facilitated analyzing, visualizing, and monitoring cardiovascular diseases using emerging computational fluid dynamics, blood flow imaging, and wearable sensing technologies. Yet, computational cost, limited spatiotemporal resolution, and obstacles for thorough data analysis have hindered the utility of such techniques to curb cardiovascular diseases. We herein discuss how leveraging machine learning techniques, and in particular deep learning methods, could overcome these limitations and offer promise for translation. We discuss the remarkable capacity of recently developed machine learning techniques to accelerate flow modeling, enhance the resolution while reduce the noise and scanning time of current blood flow imaging techniques, and accurate detection of cardiovascular diseases using a plethora of data collected by wearable sensors.
Collapse
Affiliation(s)
- Hamed Moradi
- Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, Netherlands
| | - Akram Al-Hourani
- School of Engineering, RMIT University, Melbourne, Victoria Australia
| | | | - Farnaz Khoshmanesh
- School of Allied Health, Human Services & Sport, La Trobe University, Melbourne, Victoria Australia
| | - Farhad R. Nezami
- Division of Thoracic and Cardiac Surgery, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA USA
| | - Scott Needham
- Leading Technology Group, Melbourne, Victoria Australia
| | - Sara Baratchi
- School of Health and Biomedical Sciences, RMIT University, Melbourne, Victoria Australia
| | | |
Collapse
|
36
|
Tuna EE, Franson D, Seiberlich N, Çavuşoğlu MC. Deformable cardiac surface tracking by adaptive estimation algorithms. Sci Rep 2023; 13:1387. [PMID: 36697497 PMCID: PMC9877032 DOI: 10.1038/s41598-023-28578-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2022] [Accepted: 01/20/2023] [Indexed: 01/26/2023] Open
Abstract
This study presents a particle filter based framework to track cardiac surface from a time sequence of single magnetic resonance imaging (MRI) slices with the future goal of utilizing the presented framework for interventional cardiovascular magnetic resonance procedures, which rely on the accurate and online tracking of the cardiac surface from MRI data. The framework exploits a low-order parametric deformable model of the cardiac surface. A stochastic dynamic system represents the cardiac surface motion. Deformable models are employed to introduce shape prior to control the degree of the deformations. Adaptive filters are used to model complex cardiac motion in the dynamic model of the system. Particle filters are utilized to recursively estimate the current state of the system over time. The proposed method is applied to recover biventricular deformations and validated with a numerical phantom and multiple real cardiac MRI datasets. The algorithm is evaluated with multiple experiments using fixed and varying image slice planes at each time step. For the real cardiac MRI datasets, the average root-mean-square tracking errors of 2.61 mm and 3.42 mm are reported respectively for the fixed and varying image slice planes. This work serves as a proof-of-concept study for modeling and tracking the cardiac surface deformations via a low-order probabilistic model with the future goal of utilizing this method for the targeted interventional cardiac procedures under MR image guidance. For the real cardiac MRI datasets, the presented method was able to track the points-of-interests located on different sections of the cardiac surface within a precision of 3 pixels. The analyses show that the use of deformable cardiac surface tracking algorithm can pave the way for performing precise targeted intracardiac ablation procedures under MRI guidance. The main contributions of this work are twofold. First, it presents a framework for the tracking of whole cardiac surface from a time sequence of single image slices. Second, it employs adaptive filters to incorporate motion information in the tracking of nonrigid cardiac surface motion for temporal coherence.
Collapse
Affiliation(s)
- E Erdem Tuna
- Department of Electrical, Computer, and Systems Engineering, Case Western Reserve University, Cleveland, OH, 44106, USA.
| | - Dominique Franson
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, 44106, USA
| | - Nicole Seiberlich
- Department of Radiology, Michigan Medicine, University of Michigan, Ann-Anbor, MI, 48109, USA
| | - M Cenk Çavuşoğlu
- Department of Electrical, Computer, and Systems Engineering, Case Western Reserve University, Cleveland, OH, 44106, USA
| |
Collapse
|
37
|
Neural Network in the Analysis of the MR Signal as an Image Segmentation Tool for the Determination of T 1 and T 2 Relaxation Times with Application to Cancer Cell Culture. Int J Mol Sci 2023; 24:ijms24021554. [PMID: 36675075 PMCID: PMC9861169 DOI: 10.3390/ijms24021554] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2022] [Revised: 12/31/2022] [Accepted: 01/03/2023] [Indexed: 01/14/2023] Open
Abstract
Artificial intelligence has been entering medical research. Today, manufacturers of diagnostic instruments are including algorithms based on neural networks. Neural networks are quickly entering all branches of medical research and beyond. Analyzing the PubMed database from the last 5 years (2017 to 2021), we see that the number of responses to the query "neural network in medicine" exceeds 10,500 papers. Deep learning algorithms are of particular importance in oncology. This paper presents the use of neural networks to analyze the magnetic resonance imaging (MRI) images used to determine MRI relaxometry of the samples. Relaxometry is becoming an increasingly common tool in diagnostics. The aim of this work was to optimize the processing time of DICOM images by using a neural network implemented in the MATLAB package by The MathWorks with the patternnet function. The application of a neural network helps to eliminate spaces in which there are no objects with characteristics matching the phenomenon of longitudinal or transverse MRI relaxation. The result of this work is the elimination of aerated spaces in MRI images. The whole algorithm was implemented as an application in the MATLAB package.
Collapse
|
38
|
Radiomics in Cardiac Computed Tomography. Diagnostics (Basel) 2023; 13:diagnostics13020307. [PMID: 36673115 PMCID: PMC9857691 DOI: 10.3390/diagnostics13020307] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2022] [Revised: 01/09/2023] [Accepted: 01/12/2023] [Indexed: 01/18/2023] Open
Abstract
In recent years, there has been an increasing recognition of coronary computed tomographic angiography (CCTA) and gated non-contrast cardiac CT in the workup of coronary artery disease in patients with low and intermediate pretest probability, through the readjustment guidelines by medical societies. However, in routine clinical practice, these CT data sets are usually evaluated dominantly regarding relevant coronary artery stenosis and calcification. The implementation of radiomics analysis, which provides visually elusive quantitative information from digital images, has the potential to open a new era for cardiac CT that goes far beyond mere stenosis or calcification grade estimation. This review offers an overview of the results obtained from radiomics analyses in cardiac CT, including the evaluation of coronary plaques, pericoronary adipose tissue, and the myocardium itself. It also highlights the advantages and disadvantages of use in routine clinical practice.
Collapse
|
39
|
Stature estimation by semi-automatic measurements of 3D CT images of the femur. Int J Legal Med 2023; 137:359-377. [PMID: 36474127 PMCID: PMC9902306 DOI: 10.1007/s00414-022-02921-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Accepted: 11/15/2022] [Indexed: 12/12/2022]
Abstract
Stature estimation is one of the most basic and important methods of personal identification. The long bones of the limbs provide the most accurate stature estimation, with the femur being one of the most useful. In all the previously reported methods of stature estimation using computed tomography (CT) images of the femur, laborious manual measurement was necessary. A semi-automatic bone measuring method can simplify this process, so we firstly reported a stature estimation process using semi-automatic bone measurement software equipped with artificial intelligence. Multiple measurements of femurs of adult Japanese cadavers were performed using automatic three-dimensional reconstructed CT images of femurs. After manually setting four points on the femur, an automatic measurement was acquired. The relationships between stature and five femoral measurements, with acceptable intraobserver and interobserver errors, were analyzed with single regression analysis using the standard error of the estimate (SEE) and the coefficient of determination (R2). The maximum length of the femur (MLF) provided the lowest SEE and the highest R2; the SEE and R2 in all cadavers, males and females, respectively, were 3.913 cm (R2 = 0.842), 3.664 cm (R2 = 0.705), and 3.456 cm (R2 = 0.686) for MLF on the right femur, and 3.837 cm (R2 = 0.848), 3.667 cm (R2 = 0.705), and 3.384 cm (R2 = 0.699) for MLF on the left femur. These results were non-inferior to those of previous reports regarding stature estimation using the MLF. Stature estimation with this simple and time-saving method would be useful in forensic medical practice.
Collapse
|
40
|
Tian L, Dong T, Hu S, Zhao C, Yu G, Hu H, Yang W. Radiomic and clinical nomogram for cognitive impairment prediction in Wilson's disease. Front Neurol 2023; 14:1131968. [PMID: 37188313 PMCID: PMC10177658 DOI: 10.3389/fneur.2023.1131968] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2022] [Accepted: 03/30/2023] [Indexed: 05/17/2023] Open
Abstract
Objective To investigate potential biomarkers for the early detection of cognitive impairment in patients with Wilson's disease (WD), we developed a computer-assisted radiomics model to distinguish between WD and WD cognitive impairment. Methods Overall, 136 T1-weighted MR images were retrieved from the First Affiliated Hospital of Anhui University of Chinese Medicine, including 77 from patients with WD and 59 from patients with WD cognitive impairment. The images were divided into training and test groups at a ratio of 70:30. The radiomic features of each T1-weighted image were extracted using 3D Slicer software. R software was used to establish clinical and radiomic models based on clinical characteristics and radiomic features, respectively. The receiver operating characteristic profiles of the three models were evaluated to assess their diagnostic accuracy and reliability in distinguishing between WD and WD cognitive impairment. We combined relevant neuropsychological test scores of prospective memory to construct an integrated predictive model and visual nomogram to effectively assess the risk of cognitive decline in patients with WD. Results The area under the curve values for distinguishing WD and WD cognitive impairment for the clinical, radiomic, and integrated models were 0.863, 0.922, and 0.935 respectively, indicative of excellent performance. The nomogram based on the integrated model successfully differentiated between WD and WD cognitive impairment. Conclusion The nomogram developed in the current study may assist clinicians in the early identification of cognitive impairment in patients with WD. Early intervention following such identification may help improve long-term prognosis and quality of life of these patients.
Collapse
Affiliation(s)
- Liwei Tian
- Graduate School, Anhui University of Traditional Chinese Medicine, Hefei, China
| | - Ting Dong
- Department of Neurology, The First Affiliated Hospital of Anhui University of Traditional Chinese Medicine, Hefei, China
- Key Laboratory of Xin’An Medicine, Ministry of Education, Hefei, Anhui, China
- *Correspondence: Ting Dong,
| | - Sheng Hu
- Centers for Biomedical Engineering, University of Science and Technology of China, Hefei, China
| | - Chenling Zhao
- Graduate School, Anhui University of Traditional Chinese Medicine, Hefei, China
| | - Guofang Yu
- Graduate School, Anhui University of Traditional Chinese Medicine, Hefei, China
| | - Huibing Hu
- Qimen People's Hospital, Huangshan, Anhui, China
| | - Wenming Yang
- Department of Neurology, The First Affiliated Hospital of Anhui University of Traditional Chinese Medicine, Hefei, China
- Key Laboratory of Xin’An Medicine, Ministry of Education, Hefei, Anhui, China
| |
Collapse
|
41
|
Rabbat MG, Kwong RY, Heitner JF, Young AA, Shanbhag SM, Petersen SE, Selvanayagam JB, Berry C, Nagel E, Heydari B, Maceira AM, Shenoy C, Dyke C, Bilchick KC. The Future of Cardiac Magnetic Resonance Clinical Trials. JACC Cardiovasc Imaging 2022; 15:2127-2138. [PMID: 34922874 DOI: 10.1016/j.jcmg.2021.07.029] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/06/2020] [Revised: 05/17/2021] [Accepted: 07/27/2021] [Indexed: 01/13/2023]
Abstract
Over the past 2 decades, cardiac magnetic resonance (CMR) has become an essential component of cardiovascular clinical care and contributed to imaging-guided diagnosis and management of coronary artery disease, cardiomyopathy, congenital heart disease, cardio-oncology, valvular, and vascular disease, amongst others. The widespread availability, safety, and capability of CMR to provide corresponding anatomical, physiological, and functional data in 1 imaging session can improve the design and conduct of clinical trials through both a reduction of sample size and provision of important mechanistic data that may augment clinical trial findings. Moreover, prospective imaging-guided strategies using CMR can enhance safety, efficacy, and cost-effectiveness of cardiovascular pathways in clinical practice around the world. As the future of large-scale clinical trial design evolves to integrate personalized medicine, cost-effectiveness, and mechanistic insights of novel therapies, the integration of CMR will continue to play a critical role. In this document, the attributes, limitations, and challenges of CMR's integration into the future design and conduct of clinical trials will also be covered, and recommendations for trialists will be explored. Several prominent examples of clinical trials that test the efficacy of CMR-imaging guided pathways will also be discussed.
Collapse
Affiliation(s)
- Mark G Rabbat
- Division of Cardiology, Loyola University Chicago, Chicago, Illinois, USA; Division of Cardiology, Edward Hines Jr VA Hospital, Hines, Illinois, USA
| | - Raymond Y Kwong
- Cardiovascular Division, Department of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA.
| | - John F Heitner
- Department of Medicine, New York-Presbyterian Brooklyn Methodist Hospital, Brooklyn, New York, USA
| | - Alistair A Young
- Department of Biomedical Engineering, King's College London, London, United Kingdom
| | - Sujata M Shanbhag
- National Heart, Lung, and Blood Institute, National Institutes of Health, Bethesda, Maryland, USA
| | - Steffen E Petersen
- Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, West Smithfield, London, United Kingdom; National Institute for Health Research Barts Biomedical Research Centre, William Harvey Research Institute, Queen Mary University of London, London, United Kingdom
| | - Joseph B Selvanayagam
- College of Medicine, Flinders University of South Australia, Department of Cardiovascular Medicine, Flinders Medical Centre, Southern Adelaide Local Health Network, and Cardiac Imaging Research Group, South Australian Health and Medical Research Institute, Adelaide, South Australia
| | - Colin Berry
- West of Scotland Heart and Lung Centre, Golden Jubilee National Hospital, and British Heart Foundation Glasgow Cardiovascular Research Centre, Institute of Cardiovascular and Medical Sciences, University of Glasgow, Scotland, United Kingdom
| | - Eike Nagel
- Institute for Experimental and Translational Cardiovascular Imaging, Klinikum der Johann Wolfgang Goethe-Universitat Frankfurt, Frankfurt am Main, Germany
| | - Bobak Heydari
- Stephenson Cardiac Imaging Centre and Department of Cardiac Sciences, Libin Cardiovascular Institute of Alberta, and Department of Cardiac Sciences, University of Calgary, Calgary, Alberta, Canada
| | - Alicia M Maceira
- Cardiovascular Unit, Ascires Biomedical Group, and Department of Medicine, Health Sciences School, UCH-CEU University, Valencia, Spain
| | - Chetan Shenoy
- Cardiovascular Division, Department of Medicine, University of Minnesota Medical School, Minneapolis, Minnesota, USA
| | - Christopher Dyke
- Division of Cardiology, National Jewish Health, Denver, Colorado, USA
| | - Kenneth C Bilchick
- Division of Cardiovascular Medicine, University of Virginia Health System, Charlottesville, Virginia, USA
| | | |
Collapse
|
42
|
Penso M, Babbaro M, Moccia S, Guglielmo M, Carerj ML, Giacari CM, Chiesa M, Maragna R, Rabbat MG, Barison A, Martini N, Pepi M, Caiani EG, Pontone G. Cardiovascular magnetic resonance images with susceptibility artifacts: artificial intelligence with spatial-attention for ventricular volumes and mass assessment. J Cardiovasc Magn Reson 2022; 24:62. [PMID: 36437452 PMCID: PMC9703740 DOI: 10.1186/s12968-022-00899-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2022] [Accepted: 11/02/2022] [Indexed: 11/29/2022] Open
Abstract
BACKGROUND Segmentation of cardiovascular magnetic resonance (CMR) images is an essential step for evaluating dimensional and functional ventricular parameters as ejection fraction (EF) but may be limited by artifacts, which represent the major challenge to automatically derive clinical information. The aim of this study is to investigate the accuracy of a deep learning (DL) approach for automatic segmentation of cardiac structures from CMR images characterized by magnetic susceptibility artifact in patient with cardiac implanted electronic devices (CIED). METHODS In this retrospective study, 230 patients (100 with CIED) who underwent clinically indicated CMR were used to developed and test a DL model. A novel convolutional neural network was proposed to extract the left ventricle (LV) and right (RV) ventricle endocardium and LV epicardium. In order to perform a successful segmentation, it is important the network learns to identify salient image regions even during local magnetic field inhomogeneities. The proposed network takes advantage from a spatial attention module to selectively process the most relevant information and focus on the structures of interest. To improve segmentation, especially for images with artifacts, multiple loss functions were minimized in unison. Segmentation results were assessed against manual tracings and commercial CMR analysis software cvi42(Circle Cardiovascular Imaging, Calgary, Alberta, Canada). An external dataset of 56 patients with CIED was used to assess model generalizability. RESULTS In the internal datasets, on image with artifacts, the median Dice coefficients for end-diastolic LV cavity, LV myocardium and RV cavity, were 0.93, 0.77 and 0.87 and 0.91, 0.82, and 0.83 in end-systole, respectively. The proposed method reached higher segmentation accuracy than commercial software, with performance comparable to expert inter-observer variability (bias ± 95%LoA): LVEF 1 ± 8% vs 3 ± 9%, RVEF - 2 ± 15% vs 3 ± 21%. In the external cohort, EF well correlated with manual tracing (intraclass correlation coefficient: LVEF 0.98, RVEF 0.93). The automatic approach was significant faster than manual segmentation in providing cardiac parameters (approximately 1.5 s vs 450 s). CONCLUSIONS Experimental results show that the proposed method reached promising performance in cardiac segmentation from CMR images with susceptibility artifacts and alleviates time consuming expert physician contour segmentation.
Collapse
Affiliation(s)
- Marco Penso
- Cardiovascular Imaging Department, Centro Cardiologico Monzino IRCCS, Via C. Parea 4, 20138 Milan, Italy
- Department of Electronics, Information and Biomedical Engineering, Politecnico di Milano, Milan, Italy
| | - Mario Babbaro
- Cardiovascular Imaging Department, Centro Cardiologico Monzino IRCCS, Via C. Parea 4, 20138 Milan, Italy
| | - Sara Moccia
- The BioRobotics Institute and Department of Excellence in Robotics and AI, Scuola Superiore Sant’Anna, Pisa, Italy
| | - Marco Guglielmo
- Cardiovascular Imaging Department, Centro Cardiologico Monzino IRCCS, Via C. Parea 4, 20138 Milan, Italy
| | - Maria Ludovica Carerj
- Cardiovascular Imaging Department, Centro Cardiologico Monzino IRCCS, Via C. Parea 4, 20138 Milan, Italy
- Department of Biomedical Sciences and Morphological and Functional Imaging, “G. Martino” University Hospital Messina, Messina, Italy
| | - Carlo Maria Giacari
- Cardiovascular Imaging Department, Centro Cardiologico Monzino IRCCS, Via C. Parea 4, 20138 Milan, Italy
| | - Mattia Chiesa
- Cardiovascular Imaging Department, Centro Cardiologico Monzino IRCCS, Via C. Parea 4, 20138 Milan, Italy
- Department of Electronics, Information and Biomedical Engineering, Politecnico di Milano, Milan, Italy
| | - Riccardo Maragna
- Cardiovascular Imaging Department, Centro Cardiologico Monzino IRCCS, Via C. Parea 4, 20138 Milan, Italy
| | - Mark G. Rabbat
- Loyola University of Chicago, Chicago, IL USA
- Edward Hines Jr. VA Hospital, Hines, IL USA
| | | | | | - Mauro Pepi
- Cardiovascular Imaging Department, Centro Cardiologico Monzino IRCCS, Via C. Parea 4, 20138 Milan, Italy
| | - Enrico G. Caiani
- Department of Electronics, Information and Biomedical Engineering, Politecnico di Milano, Milan, Italy
- Istituto di Elettronica e di Ingegneria dell’Informazione e delle Telecomunicazioni, Consiglio Nazionale delle Ricerche, Milan, Italy
| | - Gianluca Pontone
- Cardiovascular Imaging Department, Centro Cardiologico Monzino IRCCS, Via C. Parea 4, 20138 Milan, Italy
| |
Collapse
|
43
|
Szabo L, Raisi-Estabragh Z, Salih A, McCracken C, Ruiz Pujadas E, Gkontra P, Kiss M, Maurovich-Horvath P, Vago H, Merkely B, Lee AM, Lekadir K, Petersen SE. Clinician's guide to trustworthy and responsible artificial intelligence in cardiovascular imaging. Front Cardiovasc Med 2022; 9:1016032. [PMID: 36426221 PMCID: PMC9681217 DOI: 10.3389/fcvm.2022.1016032] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2022] [Accepted: 10/11/2022] [Indexed: 12/01/2023] Open
Abstract
A growing number of artificial intelligence (AI)-based systems are being proposed and developed in cardiology, driven by the increasing need to deal with the vast amount of clinical and imaging data with the ultimate aim of advancing patient care, diagnosis and prognostication. However, there is a critical gap between the development and clinical deployment of AI tools. A key consideration for implementing AI tools into real-life clinical practice is their "trustworthiness" by end-users. Namely, we must ensure that AI systems can be trusted and adopted by all parties involved, including clinicians and patients. Here we provide a summary of the concepts involved in developing a "trustworthy AI system." We describe the main risks of AI applications and potential mitigation techniques for the wider application of these promising techniques in the context of cardiovascular imaging. Finally, we show why trustworthy AI concepts are important governing forces of AI development.
Collapse
Affiliation(s)
- Liliana Szabo
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, London, United Kingdom
- Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, London, United Kingdom
- Semmelweis University Heart and Vascular Center, Budapest, Hungary
| | - Zahra Raisi-Estabragh
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, London, United Kingdom
- Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, London, United Kingdom
| | - Ahmed Salih
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, London, United Kingdom
- Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, London, United Kingdom
| | - Celeste McCracken
- Division of Cardiovascular Medicine, Radcliffe Department of Medicine, National Institute for Health Research Oxford Biomedical Research Centre, Oxford University Hospitals NHS Foundation Trust, University of Oxford, Oxford, United Kingdom
| | - Esmeralda Ruiz Pujadas
- Departament de Matemàtiques i Informàtica, Artificial Intelligence in Medicine Lab (BCN-AIM), Universitat de Barcelona, Barcelona, Spain
| | - Polyxeni Gkontra
- Departament de Matemàtiques i Informàtica, Artificial Intelligence in Medicine Lab (BCN-AIM), Universitat de Barcelona, Barcelona, Spain
| | - Mate Kiss
- Siemens Healthcare Hungary, Budapest, Hungary
| | - Pal Maurovich-Horvath
- Department of Radiology, Medical Imaging Centre, Semmelweis University, Budapest, Hungary
| | - Hajnalka Vago
- Semmelweis University Heart and Vascular Center, Budapest, Hungary
| | - Bela Merkely
- Semmelweis University Heart and Vascular Center, Budapest, Hungary
| | - Aaron M. Lee
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, London, United Kingdom
- Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, London, United Kingdom
| | - Karim Lekadir
- Departament de Matemàtiques i Informàtica, Artificial Intelligence in Medicine Lab (BCN-AIM), Universitat de Barcelona, Barcelona, Spain
| | - Steffen E. Petersen
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, London, United Kingdom
- Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, London, United Kingdom
- Health Data Research UK, London, United Kingdom
- Alan Turing Institute, London, United Kingdom
| |
Collapse
|
44
|
Lustermans DRPRM, Amirrajab S, Veta M, Breeuwer M, Scannell CM. Optimized automated cardiac MR scar quantification with GAN-based data augmentation. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 226:107116. [PMID: 36148718 DOI: 10.1016/j.cmpb.2022.107116] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/28/2021] [Revised: 08/26/2022] [Accepted: 09/05/2022] [Indexed: 06/16/2023]
Abstract
BACKGROUND The clinical utility of late gadolinium enhancement (LGE) cardiac MRI is limited by the lack of standardization, and time-consuming postprocessing. In this work, we tested the hypothesis that a cascaded deep learning pipeline trained with augmentation by synthetically generated data would improve model accuracy and robustness for automated scar quantification. METHODS A cascaded pipeline consisting of three consecutive neural networks is proposed, starting with a bounding box regression network to identify a region of interest around the left ventricular (LV) myocardium. Two further nnU-Net models are then used to segment the myocardium and, if present, scar. The models were trained on the data from the EMIDEC challenge, supplemented with an extensive synthetic dataset generated with a conditional GAN. RESULTS The cascaded pipeline significantly outperformed a single nnU-Net directly segmenting both the myocardium (mean Dice similarity coefficient (DSC) (standard deviation (SD)): 0.84 (0.09) vs 0.63 (0.20), p < 0.01) and scar (DSC: 0.72 (0.34) vs 0.46 (0.39), p < 0.01) on a per-slice level. The inclusion of the synthetic data as data augmentation during training improved the scar segmentation DSC by 0.06 (p < 0.01). The mean DSC per-subject on the challenge test set, for the cascaded pipeline augmented by synthetic generated data, was 0.86 (0.03) and 0.67 (0.29) for myocardium and scar, respectively. CONCLUSION A cascaded deep learning-based pipeline trained with augmentation by synthetically generated data leads to myocardium and scar segmentations that are similar to the manual operator, and outperforms direct segmentation without the synthetic images.
Collapse
Affiliation(s)
- Didier R P R M Lustermans
- Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands.
| | - Sina Amirrajab
- Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
| | - Mitko Veta
- Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
| | - Marcel Breeuwer
- Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands; Department of MR R&D - Clinical Science, Philips Healthcare, Best, the Netherlands
| | - Cian M Scannell
- Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands; School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom.
| |
Collapse
|
45
|
The Merits, Limitations, and Future Directions of Cost-Effectiveness Analysis in Cardiac MRI with a Focus on Coronary Artery Disease: A Literature Review. J Cardiovasc Dev Dis 2022; 9:jcdd9100357. [PMID: 36286309 PMCID: PMC9604922 DOI: 10.3390/jcdd9100357] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2022] [Revised: 10/12/2022] [Accepted: 10/14/2022] [Indexed: 11/17/2022] Open
Abstract
Cardiac magnetic resonance (CMR) imaging has a wide range of clinical applications with a high degree of accuracy for many myocardial pathologies. Recent literature has shown great utility of CMR in diagnosing many diseases, often changing the course of treatment. Despite this, it is often underutilized possibly due to perceived costs, limiting patient factors and comfort, and longer examination periods compared to other imaging modalities. In this regard, we conducted a literature review using keywords “Cost-Effectiveness” and “Cardiac MRI” and selected articles from the PubMed MEDLINE database that met our inclusion and exclusion criteria to examine the cost-effectiveness of CMR. Our search result yielded 17 articles included in our review. We found that CMR can be cost-effective in quality-adjusted life years (QALYs) in select patient populations with various cardiac pathologies. Specifically, the use of CMR in coronary artery disease (CAD) patients with a pretest probability below a certain threshold may be more cost-effective compared to patients with a higher pretest probability, although its use can be limited based on geographic location, professional society guidelines, and differing reimbursement patterns. In addition, a stepwise combination of different imaging modalities, with conjunction of AHA/ACC guidelines can further enhance the cost-effectiveness of CMR.
Collapse
|
46
|
Eyre K, Lindsay K, Razzaq S, Chetrit M, Friedrich M. Simultaneous multi-parametric acquisition and reconstruction techniques in cardiac magnetic resonance imaging: Basic concepts and status of clinical development. Front Cardiovasc Med 2022; 9:953823. [PMID: 36277755 PMCID: PMC9582154 DOI: 10.3389/fcvm.2022.953823] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2022] [Accepted: 09/22/2022] [Indexed: 11/13/2022] Open
Abstract
Simultaneous multi-parametric acquisition and reconstruction techniques (SMART) are gaining attention for their potential to overcome some of cardiovascular magnetic resonance imaging's (CMR) clinical limitations. The major advantages of SMART lie within their ability to simultaneously capture multiple "features" such as cardiac motion, respiratory motion, T1/T2 relaxation. This review aims to summarize the overarching theory of SMART, describing key concepts that many of these techniques share to produce co-registered, high quality CMR images in less time and with less requirements for specialized personnel. Further, this review provides an overview of the recent developments in the field of SMART by describing how they work, the parameters they can acquire, their status of clinical testing and validation, and by providing examples for how their use can improve the current state of clinical CMR workflows. Many of the SMART are in early phases of development and testing, thus larger scale, controlled trials are needed to evaluate their use in clinical setting and with different cardiac pathologies.
Collapse
Affiliation(s)
- Katerina Eyre
- McGill University Health Centre, Montreal, QC, Canada,Department of Experimental Medicine, McGill University, Montreal, QC, Canada,*Correspondence: Katerina Eyre,
| | - Katherine Lindsay
- McGill University Health Centre, Montreal, QC, Canada,Department of Experimental Medicine, McGill University, Montreal, QC, Canada
| | - Saad Razzaq
- Department of Experimental Medicine, McGill University, Montreal, QC, Canada
| | - Michael Chetrit
- McGill University Health Centre, Montreal, QC, Canada,Department of Experimental Medicine, McGill University, Montreal, QC, Canada
| | - Matthias Friedrich
- McGill University Health Centre, Montreal, QC, Canada,Department of Experimental Medicine, McGill University, Montreal, QC, Canada
| |
Collapse
|
47
|
Dirix P, Buoso S, Peper ES, Kozerke S. Synthesis of patient-specific multipoint 4D flow MRI data of turbulent aortic flow downstream of stenotic valves. Sci Rep 2022; 12:16004. [PMID: 36163357 PMCID: PMC9513106 DOI: 10.1038/s41598-022-20121-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2022] [Accepted: 09/08/2022] [Indexed: 11/09/2022] Open
Abstract
We propose to synthesize patient-specific 4D flow MRI datasets of turbulent flow paired with ground truth flow data to support training of inference methods. Turbulent blood flow is computed based on the Navier-Stokes equations with moving domains using realistic boundary conditions for aortic shapes, wall displacements and inlet velocities obtained from patient data. From the simulated flow, synthetic multipoint 4D flow MRI data is generated with user-defined spatiotemporal resolutions and reconstructed with a Bayesian approach to compute time-varying velocity and turbulence maps. For MRI data synthesis, a fixed hypothetical scan time budget is assumed and accordingly, changes to spatial resolution and time averaging result in corresponding scaling of signal-to-noise ratios (SNR). In this work, we focused on aortic stenotic flow and quantification of turbulent kinetic energy (TKE). Our results show that for spatial resolutions of 1.5 and 2.5 mm and time averaging of 5 ms as encountered in 4D flow MRI in practice, peak total turbulent kinetic energy downstream of a 50, 75 and 90% stenosis is overestimated by as much as 23, 15 and 14% (1.5 mm) and 38, 24 and 23% (2.5 mm), demonstrating the importance of paired ground truth and 4D flow MRI data for assessing accuracy and precision of turbulent flow inference using 4D flow MRI exams.
Collapse
Affiliation(s)
- Pietro Dirix
- Institute for Biomedical Engineering, University and ETH Zurich, Zurich, Switzerland.
| | - Stefano Buoso
- Institute for Biomedical Engineering, University and ETH Zurich, Zurich, Switzerland
| | - Eva S Peper
- Institute for Biomedical Engineering, University and ETH Zurich, Zurich, Switzerland
| | - Sebastian Kozerke
- Institute for Biomedical Engineering, University and ETH Zurich, Zurich, Switzerland
| |
Collapse
|
48
|
Velasco C, Fletcher TJ, Botnar RM, Prieto C. Artificial intelligence in cardiac magnetic resonance fingerprinting. Front Cardiovasc Med 2022; 9:1009131. [PMID: 36204566 PMCID: PMC9530662 DOI: 10.3389/fcvm.2022.1009131] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2022] [Accepted: 08/30/2022] [Indexed: 11/13/2022] Open
Abstract
Magnetic resonance fingerprinting (MRF) is a fast MRI-based technique that allows for multiparametric quantitative characterization of the tissues of interest in a single acquisition. In particular, it has gained attention in the field of cardiac imaging due to its ability to provide simultaneous and co-registered myocardial T1 and T2 mapping in a single breath-held cardiac MRF scan, in addition to other parameters. Initial results in small healthy subject groups and clinical studies have demonstrated the feasibility and potential of MRF imaging. Ongoing research is being conducted to improve the accuracy, efficiency, and robustness of cardiac MRF. However, these improvements usually increase the complexity of image reconstruction and dictionary generation and introduce the need for sequence optimization. Each of these steps increase the computational demand and processing time of MRF. The latest advances in artificial intelligence (AI), including progress in deep learning and the development of neural networks for MRI, now present an opportunity to efficiently address these issues. Artificial intelligence can be used to optimize candidate sequences and reduce the memory demand and computational time required for reconstruction and post-processing. Recently, proposed machine learning-based approaches have been shown to reduce dictionary generation and reconstruction times by several orders of magnitude. Such applications of AI should help to remove these bottlenecks and speed up cardiac MRF, improving its practical utility and allowing for its potential inclusion in clinical routine. This review aims to summarize the latest developments in artificial intelligence applied to cardiac MRF. Particularly, we focus on the application of machine learning at different steps of the MRF process, such as sequence optimization, dictionary generation and image reconstruction.
Collapse
Affiliation(s)
- Carlos Velasco
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
- *Correspondence: Carlos Velasco
| | - Thomas J. Fletcher
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
| | - René M. Botnar
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
- Institute for Biological and Medical Engineering, Pontificia Universidad Católica de Chile, Santiago, Chile
- Millennium Institute for Intelligent Healthcare Engineering, Santiago, Chile
| | - Claudia Prieto
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
- Institute for Biological and Medical Engineering, Pontificia Universidad Católica de Chile, Santiago, Chile
- Millennium Institute for Intelligent Healthcare Engineering, Santiago, Chile
| |
Collapse
|
49
|
Xie E, Sung E, Saad E, Trayanova N, Wu KC, Chrispin J. Advanced imaging for risk stratification for ventricular arrhythmias and sudden cardiac death. Front Cardiovasc Med 2022; 9:884767. [PMID: 36072882 PMCID: PMC9441865 DOI: 10.3389/fcvm.2022.884767] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2022] [Accepted: 08/02/2022] [Indexed: 11/13/2022] Open
Abstract
Sudden cardiac death (SCD) is a leading cause of mortality, comprising approximately half of all deaths from cardiovascular disease. In the US, the majority of SCD (85%) occurs in patients with ischemic cardiomyopathy (ICM) and a subset in patients with non-ischemic cardiomyopathy (NICM), who tend to be younger and whose risk of mortality is less clearly delineated than in ischemic cardiomyopathies. The conventional means of SCD risk stratification has been the determination of the ejection fraction (EF), typically via echocardiography, which is currently a means of determining candidacy for primary prevention in the form of implantable cardiac defibrillators (ICDs). Advanced cardiac imaging methods such as cardiac magnetic resonance imaging (CMR), single-photon emission computerized tomography (SPECT) and positron emission tomography (PET), and computed tomography (CT) have emerged as promising and non-invasive means of risk stratification for sudden death through their characterization of the underlying myocardial substrate that predisposes to SCD. Late gadolinium enhancement (LGE) on CMR detects myocardial scar, which can inform ICD decision-making. Overall scar burden, region-specific scar burden, and scar heterogeneity have all been studied in risk stratification. PET and SPECT are nuclear methods that determine myocardial viability and innervation, as well as inflammation. CT can be used for assessment of myocardial fat and its association with reentrant circuits. Emerging methodologies include the development of "virtual hearts" using complex electrophysiologic modeling derived from CMR to attempt to predict arrhythmic susceptibility. Recent developments have paired novel machine learning (ML) algorithms with established imaging techniques to improve predictive performance. The use of advanced imaging to augment risk stratification for sudden death is increasingly well-established and may soon have an expanded role in clinical decision-making. ML could help shift this paradigm further by advancing variable discovery and data analysis.
Collapse
Affiliation(s)
- Eric Xie
- Division of Cardiology, Department of Medicine, Section of Cardiac Electrophysiology, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| | - Eric Sung
- Division of Cardiology, Department of Medicine, Section of Cardiac Electrophysiology, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, United States
| | - Elie Saad
- Division of Cardiology, Department of Medicine, Section of Cardiac Electrophysiology, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| | - Natalia Trayanova
- Division of Cardiology, Department of Medicine, Section of Cardiac Electrophysiology, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, United States
| | - Katherine C. Wu
- Division of Cardiology, Department of Medicine, Section of Cardiac Electrophysiology, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| | - Jonathan Chrispin
- Division of Cardiology, Department of Medicine, Section of Cardiac Electrophysiology, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| |
Collapse
|
50
|
Assadi H, Alabed S, Maiter A, Salehi M, Li R, Ripley DP, Van der Geest RJ, Zhong Y, Zhong L, Swift AJ, Garg P. The Role of Artificial Intelligence in Predicting Outcomes by Cardiovascular Magnetic Resonance: A Comprehensive Systematic Review. MEDICINA (KAUNAS, LITHUANIA) 2022; 58:medicina58081087. [PMID: 36013554 PMCID: PMC9412853 DOI: 10.3390/medicina58081087] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/07/2022] [Revised: 07/28/2022] [Accepted: 08/06/2022] [Indexed: 11/16/2022]
Abstract
Background and Objectives: Interest in artificial intelligence (AI) for outcome prediction has grown substantially in recent years. However, the prognostic role of AI using advanced cardiac magnetic resonance imaging (CMR) remains unclear. This systematic review assesses the existing literature on AI in CMR to predict outcomes in patients with cardiovascular disease. Materials and Methods: Medline and Embase were searched for studies published up to November 2021. Any study assessing outcome prediction using AI in CMR in patients with cardiovascular disease was eligible for inclusion. All studies were assessed for compliance with the Checklist for Artificial Intelligence in Medical Imaging (CLAIM). Results: A total of 5 studies were included, with a total of 3679 patients, with 225 deaths and 265 major adverse cardiovascular events. Three methods demonstrated high prognostic accuracy: (1) three-dimensional motion assessment model in pulmonary hypertension (hazard ratio (HR) 2.74, 95%CI 1.73−4.34, p < 0.001), (2) automated perfusion quantification in patients with coronary artery disease (HR 2.14, 95%CI 1.58−2.90, p < 0.001), and (3) automated volumetric, functional, and area assessment in patients with myocardial infarction (HR 0.94, 95%CI 0.92−0.96, p < 0.001). Conclusion: There is emerging evidence of the prognostic role of AI in predicting outcomes for three-dimensional motion assessment in pulmonary hypertension, ischaemia assessment by automated perfusion quantification, and automated functional assessment in myocardial infarction.
Collapse
Affiliation(s)
- Hosamadin Assadi
- Department of Medicine, Norwich Medical School, University of East Anglia, Norfolk NR4 7TJ, UK
- Department of Cardiology, Norfolk and Norwich University Hospitals NHS Foundation Trust, Norfolk NR4 7UY, UK
| | - Samer Alabed
- Department of Infection, Immunity & Cardiovascular Disease, University of Sheffield, Sheffield S10 2RX, UK
- Department of Clinical Radiology, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield S10 2JF, UK
| | - Ahmed Maiter
- Department of Infection, Immunity & Cardiovascular Disease, University of Sheffield, Sheffield S10 2RX, UK
- Department of Clinical Radiology, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield S10 2JF, UK
| | - Mahan Salehi
- Department of Infection, Immunity & Cardiovascular Disease, University of Sheffield, Sheffield S10 2RX, UK
- Department of Clinical Radiology, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield S10 2JF, UK
| | - Rui Li
- Department of Medicine, Norwich Medical School, University of East Anglia, Norfolk NR4 7TJ, UK
- Department of Cardiology, Norfolk and Norwich University Hospitals NHS Foundation Trust, Norfolk NR4 7UY, UK
| | - David P. Ripley
- Northumbria Healthcare Foundation Trust, Northumbria Specialist Care Emergency Hospital, Northumbria Way, Northumberland NE23 6NZ, UK
| | - Rob J. Van der Geest
- Department of Radiology, Division of Image Processing, Leiden University Medical Center, 2333 ZA Leiden, The Netherlands
| | - Yumin Zhong
- Department of Radiology, Shanghai Children’s Medical Center, Shanghai Jiao Tong University School of Medicine, 1678 Dong Fang Rd., Shanghai 200127, China
| | - Liang Zhong
- National Heart Research Institute Singapore, National Heart Centre Singapore, 5 Hospital Drive, Singapore 169609, Singapore
- Cardiovascular Sciences, Duke-NUS Medical School, 8 College Road, Singapore 169856, Singapore
| | - Andrew J. Swift
- Department of Infection, Immunity & Cardiovascular Disease, University of Sheffield, Sheffield S10 2RX, UK
- Department of Clinical Radiology, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield S10 2JF, UK
| | - Pankaj Garg
- Department of Medicine, Norwich Medical School, University of East Anglia, Norfolk NR4 7TJ, UK
- Department of Cardiology, Norfolk and Norwich University Hospitals NHS Foundation Trust, Norfolk NR4 7UY, UK
- Correspondence:
| |
Collapse
|