1
|
Salih AM, Galazzo IB, Gkontra P, Rauseo E, Lee AM, Lekadir K, Radeva P, Petersen SE, Menegaz G. A review of evaluation approaches for explainable AI with applications in cardiology. Artif Intell Rev 2024; 57:240. [PMID: 39132011 PMCID: PMC11315784 DOI: 10.1007/s10462-024-10852-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/03/2024] [Indexed: 08/13/2024]
Abstract
Explainable artificial intelligence (XAI) elucidates the decision-making process of complex AI models and is important in building trust in model predictions. XAI explanations themselves require evaluation as to accuracy and reasonableness and in the context of use of the underlying AI model. This review details the evaluation of XAI in cardiac AI applications and has found that, of the studies examined, 37% evaluated XAI quality using literature results, 11% used clinicians as domain-experts, 11% used proxies or statistical analysis, with the remaining 43% not assessing the XAI used at all. We aim to inspire additional studies within healthcare, urging researchers not only to apply XAI methods but to systematically assess the resulting explanations, as a step towards developing trustworthy and safe models. Supplementary Information The online version contains supplementary material available at 10.1007/s10462-024-10852-w.
Collapse
Affiliation(s)
- Ahmed M. Salih
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, Charterhouse Square, London, EC1M 6BQ UK
- Department of Population Health Sciences, University of Leicester, University Rd, Leicester, LE1 7RH UK
- Department of Computer Science, University of Zakho, Duhok road, Zakho, Kurdistan Iraq
| | - Ilaria Boscolo Galazzo
- Department of Engineering for Innovative Medicine, University of Verona, S. Francesco, 22, 37129 Verona, Italy
| | - Polyxeni Gkontra
- Artificial Intelligence in Medicine Lab (BCN-AIM), Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Gran Via de les Corts Catalanes, 585, 08007 Barcelona, Spain
| | - Elisa Rauseo
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, Charterhouse Square, London, EC1M 6BQ UK
| | - Aaron Mark Lee
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, Charterhouse Square, London, EC1M 6BQ UK
| | - Karim Lekadir
- Artificial Intelligence in Medicine Lab (BCN-AIM), Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Gran Via de les Corts Catalanes, 585, 08007 Barcelona, Spain
- Institució Catalana de Recerca i Estudis Avançats (ICREA), Passeig Lluís Companys 23, Barcelona, Spain
| | - Petia Radeva
- Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Gran Via de les Corts Catalanes, 585, 08007 Barcelona, Spain
| | - Steffen E. Petersen
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, Charterhouse Square, London, EC1M 6BQ UK
- Barts Heart Centre, St Bartholomew’s Hospital, Barts Health NHS Trust, West Smithfield, London, UK
- Health Data Research, London, UK
- Alan Turing Institute, London, UK
| | - Gloria Menegaz
- Department of Engineering for Innovative Medicine, University of Verona, S. Francesco, 22, 37129 Verona, Italy
| |
Collapse
|
2
|
Zhang J, Xiao S, Zhu Y, Zhang Z, Cao H, Xie M, Zhang L. Advances in the Application of Artificial Intelligence in Fetal Echocardiography. J Am Soc Echocardiogr 2024; 37:550-561. [PMID: 38199332 DOI: 10.1016/j.echo.2023.12.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Revised: 12/23/2023] [Accepted: 12/23/2023] [Indexed: 01/12/2024]
Abstract
Congenital heart disease is a severe health risk for newborns. Early detection of abnormalities in fetal cardiac structure and function during pregnancy can help patients seek timely diagnostic and therapeutic advice, and early intervention planning can significantly improve fetal survival rates. Echocardiography is one of the most accessible and widely used diagnostic tools in the diagnosis of fetal congenital heart disease. However, traditional fetal echocardiography has limitations due to fetal, maternal, and ultrasound equipment factors and is highly dependent on the skill level of the operator. Artificial intelligence (AI) technology, with its rapid development utilizing advanced computer algorithms, has great potential to empower sonographers in time-saving and accurate diagnosis and to bridge the skill gap in different regions. In recent years, AI-assisted fetal echocardiography has been successfully applied to a wide range of ultrasound diagnoses. This review systematically reviews the applications of AI in the field of fetal echocardiography over the years in terms of image processing, biometrics, and disease diagnosis and provides an outlook for future research.
Collapse
Affiliation(s)
- Junmin Zhang
- Department of Ultrasound Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China; Clinical Research Center for Medical Imaging, Hubei Province, Wuhan, China; Hubei Province Key Laboratory of Molecular Imaging, Wuhan, China
| | - Sushan Xiao
- Department of Ultrasound Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China; Clinical Research Center for Medical Imaging, Hubei Province, Wuhan, China; Hubei Province Key Laboratory of Molecular Imaging, Wuhan, China
| | - Ye Zhu
- Department of Ultrasound Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China; Clinical Research Center for Medical Imaging, Hubei Province, Wuhan, China; Hubei Province Key Laboratory of Molecular Imaging, Wuhan, China
| | - Zisang Zhang
- Department of Ultrasound Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China; Clinical Research Center for Medical Imaging, Hubei Province, Wuhan, China; Hubei Province Key Laboratory of Molecular Imaging, Wuhan, China
| | - Haiyan Cao
- Department of Ultrasound Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China; Clinical Research Center for Medical Imaging, Hubei Province, Wuhan, China; Hubei Province Key Laboratory of Molecular Imaging, Wuhan, China
| | - Mingxing Xie
- Department of Ultrasound Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China; Clinical Research Center for Medical Imaging, Hubei Province, Wuhan, China; Hubei Province Key Laboratory of Molecular Imaging, Wuhan, China
| | - Li Zhang
- Department of Ultrasound Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China; Clinical Research Center for Medical Imaging, Hubei Province, Wuhan, China; Hubei Province Key Laboratory of Molecular Imaging, Wuhan, China.
| |
Collapse
|
3
|
Yan L, Ling S, Mao R, Xi H, Wang F. A deep learning framework for identifying and segmenting three vessels in fetal heart ultrasound images. Biomed Eng Online 2024; 23:39. [PMID: 38566181 PMCID: PMC10985891 DOI: 10.1186/s12938-024-01230-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2023] [Accepted: 03/18/2024] [Indexed: 04/04/2024] Open
Abstract
BACKGROUND Congenital heart disease (CHD) is one of the most common birth defects in the world. It is the leading cause of infant mortality, necessitating an early diagnosis for timely intervention. Prenatal screening using ultrasound is the primary method for CHD detection. However, its effectiveness is heavily reliant on the expertise of physicians, leading to subjective interpretations and potential underdiagnosis. Therefore, a method for automatic analysis of fetal cardiac ultrasound images is highly desired to assist an objective and effective CHD diagnosis. METHOD In this study, we propose a deep learning-based framework for the identification and segmentation of the three vessels-the pulmonary artery, aorta, and superior vena cava-in the ultrasound three vessel view (3VV) of the fetal heart. In the first stage of the framework, the object detection model Yolov5 is employed to identify the three vessels and localize the Region of Interest (ROI) within the original full-sized ultrasound images. Subsequently, a modified Deeplabv3 equipped with our novel AMFF (Attentional Multi-scale Feature Fusion) module is applied in the second stage to segment the three vessels within the cropped ROI images. RESULTS We evaluated our method with a dataset consisting of 511 fetal heart 3VV images. Compared to existing models, our framework exhibits superior performance in the segmentation of all the three vessels, demonstrating the Dice coefficients of 85.55%, 89.12%, and 77.54% for PA, Ao and SVC respectively. CONCLUSIONS Our experimental results show that our proposed framework can automatically and accurately detect and segment the three vessels in fetal heart 3VV images. This method has the potential to assist sonographers in enhancing the precision of vessel assessment during fetal heart examinations.
Collapse
Affiliation(s)
- Laifa Yan
- College of Information Engineering, Zhejiang University of Technology, Hangzhou, Zhejiang, China
- Hangzhou Institute of Medicine, Chinese Academy of Sciences, Hangzhou, Zhejiang, China
| | - Shan Ling
- Hangzhou Institute of Medicine, Chinese Academy of Sciences, Hangzhou, Zhejiang, China
| | - Rongsong Mao
- College of Information Engineering, Zhejiang University of Technology, Hangzhou, Zhejiang, China
- Hangzhou Institute of Medicine, Chinese Academy of Sciences, Hangzhou, Zhejiang, China
| | - Haoran Xi
- Hangzhou Institute of Medicine, Chinese Academy of Sciences, Hangzhou, Zhejiang, China
| | - Fei Wang
- The Center of Four-Dimensional Ultrasound, Affiliated Xiaoshan Hospital, Hangzhou Normal University, Hangzhou, Zhejiang, China.
| |
Collapse
|
4
|
Jacquemyn X, Kutty S, Manlhiot C. The Lifelong Impact of Artificial Intelligence and Clinical Prediction Models on Patients With Tetralogy of Fallot. CJC PEDIATRIC AND CONGENITAL HEART DISEASE 2023; 2:440-452. [PMID: 38161675 PMCID: PMC10755786 DOI: 10.1016/j.cjcpc.2023.08.005] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/14/2023] [Accepted: 08/24/2023] [Indexed: 01/03/2024]
Abstract
Medical advancements in the diagnosis, surgical techniques, perioperative care, and continued care throughout childhood have transformed the outlook for individuals with tetralogy of Fallot (TOF), improving survival and shifting the perspective towards lifelong care. However, with a growing population of survivors, longstanding challenges have been accentuated, and new challenges have surfaced, necessitating a re-evaluation of TOF care. Availability of prenatal diagnostics, insufficient information from traditional imaging techniques, previously unforeseen medical complications, and debates surrounding optimal timing and indications for reintervention are among the emerging issues. To address these challenges, the integration of artificial intelligence and machine learning holds great promise as they have the potential to revolutionize patient management and positively impact lifelong outcomes for individuals with TOF. Innovative applications of artificial intelligence and machine learning have spanned across multiple domains of TOF care, including screening and diagnosis, automated image processing and interpretation, clinical risk stratification, and planning and performing cardiac interventions. By embracing these advancements and incorporating them into routine clinical practice, personalized medicine could be delivered, leading to the best possible outcomes for patients. In this review, we provide an overview of these evolving applications and emphasize the challenges, limitations, and future potential for integrating them into clinical care.
Collapse
Affiliation(s)
- Xander Jacquemyn
- Blalock-Taussig-Thomas Pediatric and Congenital Heart Center, Department of Pediatrics, Johns Hopkins School of Medicine, Baltimore, Maryland, USA
- Department of Cardiovascular Sciences, KU Leuven, Leuven, Belgium
| | - Shelby Kutty
- Blalock-Taussig-Thomas Pediatric and Congenital Heart Center, Department of Pediatrics, Johns Hopkins School of Medicine, Baltimore, Maryland, USA
| | - Cedric Manlhiot
- Blalock-Taussig-Thomas Pediatric and Congenital Heart Center, Department of Pediatrics, Johns Hopkins School of Medicine, Baltimore, Maryland, USA
| |
Collapse
|
5
|
Jost E, Kosian P, Jimenez Cruz J, Albarqouni S, Gembruch U, Strizek B, Recker F. Evolving the Era of 5D Ultrasound? A Systematic Literature Review on the Applications for Artificial Intelligence Ultrasound Imaging in Obstetrics and Gynecology. J Clin Med 2023; 12:6833. [PMID: 37959298 PMCID: PMC10649694 DOI: 10.3390/jcm12216833] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2023] [Revised: 10/17/2023] [Accepted: 10/25/2023] [Indexed: 11/15/2023] Open
Abstract
Artificial intelligence (AI) has gained prominence in medical imaging, particularly in obstetrics and gynecology (OB/GYN), where ultrasound (US) is the preferred method. It is considered cost effective and easily accessible but is time consuming and hindered by the need for specialized training. To overcome these limitations, AI models have been proposed for automated plane acquisition, anatomical measurements, and pathology detection. This study aims to overview recent literature on AI applications in OB/GYN US imaging, highlighting their benefits and limitations. For the methodology, a systematic literature search was performed in the PubMed and Cochrane Library databases. Matching abstracts were screened based on the PICOS (Participants, Intervention or Exposure, Comparison, Outcome, Study type) scheme. Articles with full text copies were distributed to the sections of OB/GYN and their research topics. As a result, this review includes 189 articles published from 1994 to 2023. Among these, 148 focus on obstetrics and 41 on gynecology. AI-assisted US applications span fetal biometry, echocardiography, or neurosonography, as well as the identification of adnexal and breast masses, and assessment of the endometrium and pelvic floor. To conclude, the applications for AI-assisted US in OB/GYN are abundant, especially in the subspecialty of obstetrics. However, while most studies focus on common application fields such as fetal biometry, this review outlines emerging and still experimental fields to promote further research.
Collapse
Affiliation(s)
- Elena Jost
- Department of Obstetrics and Gynecology, University Hospital Bonn, Venusberg Campus 1, 53127 Bonn, Germany
| | - Philipp Kosian
- Department of Obstetrics and Gynecology, University Hospital Bonn, Venusberg Campus 1, 53127 Bonn, Germany
| | - Jorge Jimenez Cruz
- Department of Obstetrics and Gynecology, University Hospital Bonn, Venusberg Campus 1, 53127 Bonn, Germany
| | - Shadi Albarqouni
- Department of Diagnostic and Interventional Radiology, University Hospital Bonn, Venusberg Campus 1, 53127 Bonn, Germany
- Helmholtz AI, Helmholtz Munich, Ingolstädter Landstraße 1, 85764 Neuherberg, Germany
| | - Ulrich Gembruch
- Department of Obstetrics and Gynecology, University Hospital Bonn, Venusberg Campus 1, 53127 Bonn, Germany
| | - Brigitte Strizek
- Department of Obstetrics and Gynecology, University Hospital Bonn, Venusberg Campus 1, 53127 Bonn, Germany
| | - Florian Recker
- Department of Obstetrics and Gynecology, University Hospital Bonn, Venusberg Campus 1, 53127 Bonn, Germany
| |
Collapse
|
6
|
Mohsin SN, Gapizov A, Ekhator C, Ain NU, Ahmad S, Khan M, Barker C, Hussain M, Malineni J, Ramadhan A, Halappa Nagaraj R. The Role of Artificial Intelligence in Prediction, Risk Stratification, and Personalized Treatment Planning for Congenital Heart Diseases. Cureus 2023; 15:e44374. [PMID: 37664359 PMCID: PMC10469091 DOI: 10.7759/cureus.44374] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/30/2023] [Indexed: 09/05/2023] Open
Abstract
This narrative review delves into the potential of artificial intelligence (AI) in predicting, stratifying risk, and personalizing treatment planning for congenital heart disease (CHD). CHD is a complex condition that affects individuals across various age groups. The review highlights the challenges in predicting risks, planning treatments, and prognosticating long-term outcomes due to CHD's multifaceted nature, limited data, ethical concerns, and individual variabilities. AI, with its ability to analyze extensive data sets, presents a promising solution. The review emphasizes the need for larger, diverse datasets, the integration of various data sources, and the analysis of longitudinal data. Prospective validation in real-world clinical settings, interpretability, and the importance of human clinical expertise are also underscored. The ethical considerations surrounding privacy, consent, bias, monitoring, and human oversight are examined. AI's implications include improved patient outcomes, cost-effectiveness, and real-time decision support. The review aims to provide a comprehensive understanding of AI's potential for revolutionizing CHD management and highlights the significance of collaboration and transparency to address challenges and limitations.
Collapse
Affiliation(s)
| | | | - Chukwuyem Ekhator
- Neuro-Oncology, New York Institute of Technology, College of Osteopathic Medicine, Old Westbury, USA
| | - Noor U Ain
- Medicine, Mayo Hospital, Lahore, PAK
- Medicine, King Edward Medical University, Lahore, PAK
| | | | - Mavra Khan
- Medicine and Surgery, Mayo Hospital, Lahore , PAK
| | - Chad Barker
- Public Health, University of South Florida, Tampa, USA
| | | | - Jahnavi Malineni
- Medicine and Surgery, Maharajah's Institute of Medical Sciences, Vizianagaram, IND
| | - Afif Ramadhan
- Medicine, Universal Scientific Education and Research Network (USERN), Yogyakarta, IDN
- Medicine, Faculty of Medicine, Public Health, and Nursing, Gadjah Mada University, Yogyakarta, IDN
| | | |
Collapse
|
7
|
Granese R, Gulino FA, Incognito GG, Cianci S, Martinelli C, Ercoli A. Ultrasonographic Prenatal Diagnosis: Unveiling the Path to Improved Antenatal Care. J Clin Med 2023; 12:4450. [PMID: 37445485 DOI: 10.3390/jcm12134450] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2023] [Accepted: 06/06/2023] [Indexed: 07/15/2023] Open
Abstract
The realm of prenatal diagnosis has witnessed remarkable advancements in recent years, primarily due to the widespread use of ultrasonography [...].
Collapse
Affiliation(s)
- Roberta Granese
- Unit of Gynecology and Obstetric, Department of Biomedical and Dental Sciences and Morpho Functional Imaging, University Hospital "G. Martino" of Messina, 98100 Messina, Italy
| | - Ferdinando Antonio Gulino
- Unit of Gynecology and Obstetric, Department of Human Pathology of Adults and Developmental Age, University Hospital "G. Martino" of Messina, 98100 Messina, Italy
| | - Giosuè Giordano Incognito
- Department of General Surgery and Medical Surgical Specialties, University of Catania, 95125 Catania, Italy
| | - Stefano Cianci
- Unit of Gynecology and Obstetric, Department of Human Pathology of Adults and Developmental Age, University Hospital "G. Martino" of Messina, 98100 Messina, Italy
| | - Canio Martinelli
- Unit of Gynecology and Obstetric, Department of Human Pathology of Adults and Developmental Age, University Hospital "G. Martino" of Messina, 98100 Messina, Italy
| | - Alfredo Ercoli
- Unit of Gynecology and Obstetric, Department of Human Pathology of Adults and Developmental Age, University Hospital "G. Martino" of Messina, 98100 Messina, Italy
| |
Collapse
|
8
|
Salih A, Boscolo Galazzo I, Gkontra P, Lee AM, Lekadir K, Raisi-Estabragh Z, Petersen SE. Explainable Artificial Intelligence and Cardiac Imaging: Toward More Interpretable Models. Circ Cardiovasc Imaging 2023; 16:e014519. [PMID: 37042240 DOI: 10.1161/circimaging.122.014519] [Citation(s) in RCA: 12] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 04/13/2023]
Abstract
Artificial intelligence applications have shown success in different medical and health care domains, and cardiac imaging is no exception. However, some machine learning models, especially deep learning, are considered black box as they do not provide an explanation or rationale for model outcomes. Complexity and vagueness in these models necessitate a transition to explainable artificial intelligence (XAI) methods to ensure that model results are both transparent and understandable to end users. In cardiac imaging studies, there are a limited number of papers that use XAI methodologies. This article provides a comprehensive literature review of state-of-the-art works using XAI methods for cardiac imaging. Moreover, it provides simple and comprehensive guidelines on XAI. Finally, open issues and directions for XAI in cardiac imaging are discussed.
Collapse
Affiliation(s)
- Ahmed Salih
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, United Kingdom (A.S., A.M.L., Z.R.-E., S.E.P.)
| | | | - Polyxeni Gkontra
- Department of de Matemàtiques i Informàtica, University of Barcelona, Spain (P.G., K.L.)
| | - Aaron Mark Lee
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, United Kingdom (A.S., A.M.L., Z.R.-E., S.E.P.)
| | - Karim Lekadir
- Department of de Matemàtiques i Informàtica, University of Barcelona, Spain (P.G., K.L.)
| | - Zahra Raisi-Estabragh
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, United Kingdom (A.S., A.M.L., Z.R.-E., S.E.P.)
- Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, London, United Kingdom (Z.R.-E., S.E.P.)
| | - Steffen E Petersen
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, United Kingdom (A.S., A.M.L., Z.R.-E., S.E.P.)
- Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, London, United Kingdom (Z.R.-E., S.E.P.)
- Health Data Research UK, London (S.E.P.)
- Alan Turing Institute, London, United Kingdom (S.E.P.)
| |
Collapse
|