1
|
Champendal M, Müller H, Prior JO, Dos Reis CS. A scoping review of interpretability and explainability concerning artificial intelligence methods in medical imaging. Eur J Radiol 2023; 169:111159. [PMID: 37976760 DOI: 10.1016/j.ejrad.2023.111159] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Revised: 09/26/2023] [Accepted: 10/19/2023] [Indexed: 11/19/2023]
Abstract
PURPOSE To review eXplainable Artificial Intelligence/(XAI) methods available for medical imaging/(MI). METHOD A scoping review was conducted following the Joanna Briggs Institute's methodology. The search was performed on Pubmed, Embase, Cinhal, Web of Science, BioRxiv, MedRxiv, and Google Scholar. Studies published in French and English after 2017 were included. Keyword combinations and descriptors related to explainability, and MI modalities were employed. Two independent reviewers screened abstracts, titles and full text, resolving differences through discussion. RESULTS 228 studies met the criteria. XAI publications are increasing, targeting MRI (n = 73), radiography (n = 47), CT (n = 46). Lung (n = 82) and brain (n = 74) pathologies, Covid-19 (n = 48), Alzheimer's disease (n = 25), brain tumors (n = 15) are the main pathologies explained. Explanations are presented visually (n = 186), numerically (n = 67), rule-based (n = 11), textually (n = 11), and example-based (n = 6). Commonly explained tasks include classification (n = 89), prediction (n = 47), diagnosis (n = 39), detection (n = 29), segmentation (n = 13), and image quality improvement (n = 6). The most frequently provided explanations were local (78.1 %), 5.7 % were global, and 16.2 % combined both local and global approaches. Post-hoc approaches were predominantly employed. The used terminology varied, sometimes indistinctively using explainable (n = 207), interpretable (n = 187), understandable (n = 112), transparent (n = 61), reliable (n = 31), and intelligible (n = 3). CONCLUSION The number of XAI publications in medical imaging is increasing, primarily focusing on applying XAI techniques to MRI, CT, and radiography for classifying and predicting lung and brain pathologies. Visual and numerical output formats are predominantly used. Terminology standardisation remains a challenge, as terms like "explainable" and "interpretable" are sometimes being used indistinctively. Future XAI development should consider user needs and perspectives.
Collapse
Affiliation(s)
- Mélanie Champendal
- School of Health Sciences HESAV, HES-SO, University of Applied Sciences Western Switzerland, Lausanne, CH, Switzerland; Faculty of Biology and Medicine, University of Lausanne, Lausanne, CH, Switzerland.
| | - Henning Müller
- Informatics Institute, University of Applied Sciences Western Switzerland (HES-SO Valais) Sierre, CH, Switzerland; Medical faculty, University of Geneva, CH, Switzerland.
| | - John O Prior
- Faculty of Biology and Medicine, University of Lausanne, Lausanne, CH, Switzerland; Nuclear Medicine and Molecular Imaging Department, Lausanne University Hospital (CHUV), Lausanne, CH, Switzerland.
| | - Cláudia Sá Dos Reis
- School of Health Sciences HESAV, HES-SO, University of Applied Sciences Western Switzerland, Lausanne, CH, Switzerland.
| |
Collapse
|
2
|
Salih A, Boscolo Galazzo I, Gkontra P, Lee AM, Lekadir K, Raisi-Estabragh Z, Petersen SE. Explainable Artificial Intelligence and Cardiac Imaging: Toward More Interpretable Models. Circ Cardiovasc Imaging 2023; 16:e014519. [PMID: 37042240 DOI: 10.1161/circimaging.122.014519] [Citation(s) in RCA: 10] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 04/13/2023]
Abstract
Artificial intelligence applications have shown success in different medical and health care domains, and cardiac imaging is no exception. However, some machine learning models, especially deep learning, are considered black box as they do not provide an explanation or rationale for model outcomes. Complexity and vagueness in these models necessitate a transition to explainable artificial intelligence (XAI) methods to ensure that model results are both transparent and understandable to end users. In cardiac imaging studies, there are a limited number of papers that use XAI methodologies. This article provides a comprehensive literature review of state-of-the-art works using XAI methods for cardiac imaging. Moreover, it provides simple and comprehensive guidelines on XAI. Finally, open issues and directions for XAI in cardiac imaging are discussed.
Collapse
Affiliation(s)
- Ahmed Salih
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, United Kingdom (A.S., A.M.L., Z.R.-E., S.E.P.)
| | | | - Polyxeni Gkontra
- Department of de Matemàtiques i Informàtica, University of Barcelona, Spain (P.G., K.L.)
| | - Aaron Mark Lee
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, United Kingdom (A.S., A.M.L., Z.R.-E., S.E.P.)
| | - Karim Lekadir
- Department of de Matemàtiques i Informàtica, University of Barcelona, Spain (P.G., K.L.)
| | - Zahra Raisi-Estabragh
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, United Kingdom (A.S., A.M.L., Z.R.-E., S.E.P.)
- Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, London, United Kingdom (Z.R.-E., S.E.P.)
| | - Steffen E Petersen
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, United Kingdom (A.S., A.M.L., Z.R.-E., S.E.P.)
- Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, London, United Kingdom (Z.R.-E., S.E.P.)
- Health Data Research UK, London (S.E.P.)
- Alan Turing Institute, London, United Kingdom (S.E.P.)
| |
Collapse
|
3
|
HERZ THORAX – MRT verbessert Risikovorhersage bei Herzinsuffizienz mit erhaltener Ejektionsfraktion. ROFO-FORTSCHR RONTG 2023. [DOI: 10.1055/a-1962-2317] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2023]
|
4
|
Heinzel FR, Shah SJ. The future of heart failure with preserved ejection fraction : Deep phenotyping for targeted therapeutics. Herz 2022; 47:308-323. [PMID: 35767073 PMCID: PMC9244058 DOI: 10.1007/s00059-022-05124-8] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/19/2022] [Indexed: 12/25/2022]
Abstract
Heart failure (HF) with preserved ejection fraction (HFpEF) is a multi-organ, systemic syndrome that involves multiple cardiac and extracardiac pathophysiologic abnormalities. Because HFpEF is a heterogeneous syndrome and resistant to a “one-size-fits-all” approach it has proven to be very difficult to treat. For this reason, several research groups have been working on methods for classifying HFpEF and testing targeted therapeutics for the HFpEF subtypes identified. Apart from conventional classification strategies based on comorbidity, etiology, left ventricular remodeling, and hemodynamic subtypes, researchers have been combining deep phenotyping with innovative analytical strategies (e.g., machine learning) to classify HFpEF into therapeutically homogeneous subtypes over the past few years. Despite the growing excitement for such approaches, there are several potential pitfalls to their use, and there is a pressing need to follow up on data-driven HFpEF subtypes in order to determine their underlying mechanisms and molecular basis. Here we provide a framework for understanding the phenotype-based approach to HFpEF by reviewing (1) the historical context of HFpEF; (2) the current HFpEF paradigm of comorbidity-induced inflammation and endothelial dysfunction; (3) various methods of sub-phenotyping HFpEF; (4) comorbidity-based classification and treatment of HFpEF; (5) machine learning approaches to classifying HFpEF; (6) examples from HFpEF clinical trials; and (7) the future of phenomapping (machine learning and other advanced analytics) for the classification of HFpEF.
Collapse
Affiliation(s)
- Frank R Heinzel
- Medizinische Klinik mit Schwerpunkt Kardiologie, Charité - Universitätsmedizin, Campus Virchow-Klinikum, Berlin, Germany. .,Partner Site Berlin, Deutsches Zentrum für Herz-Kreislauf-Forschung eV, Berlin, Germany.
| | - Sanjiv J Shah
- Division of Cardiology, Department of Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| |
Collapse
|
5
|
Ji M, Wu W, He L, Gao L, Zhang Y, Lin Y, Qian M, Wang J, Zhang L, Xie M, Li Y. Right Ventricular Longitudinal Strain in Patients with Heart Failure. Diagnostics (Basel) 2022; 12:diagnostics12020445. [PMID: 35204536 PMCID: PMC8871506 DOI: 10.3390/diagnostics12020445] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2021] [Revised: 02/03/2022] [Accepted: 02/04/2022] [Indexed: 11/16/2022] Open
Abstract
Patients with heart failure (HF) have high morbidity and mortality. Accurate assessment of right ventricular (RV) function has important prognostic significance in patients with HF. However, conventional echocardiographic parameters of RV function have limitations in RV assessments due to the complex geometry of right ventricle. In recent years, speckle tracking echocardiography (STE) has been developed as promising imaging technique to accurately evaluate RV function. RV longitudinal strain (RVLS) using STE, as a sensitive index for RV function evaluation, displays the powerfully prognostic value in patients with HF. Therefore, the aim of the present review was to summarize the utility of RVLS in patients with HF.
Collapse
Affiliation(s)
- Mengmeng Ji
- Department of Ultrasound Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430022, China; (M.J.); (W.W.); (L.H.); (L.G.); (Y.Z.); (Y.L.); (M.Q.); (J.W.); (L.Z.)
- Clinical Research Center for Medical Imaging in Hubei Province, Wuhan 430022, China
- Hubei Province Key Laboratory of Molecular Imaging, Wuhan 430022, China
| | - Wenqian Wu
- Department of Ultrasound Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430022, China; (M.J.); (W.W.); (L.H.); (L.G.); (Y.Z.); (Y.L.); (M.Q.); (J.W.); (L.Z.)
- Clinical Research Center for Medical Imaging in Hubei Province, Wuhan 430022, China
- Hubei Province Key Laboratory of Molecular Imaging, Wuhan 430022, China
| | - Lin He
- Department of Ultrasound Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430022, China; (M.J.); (W.W.); (L.H.); (L.G.); (Y.Z.); (Y.L.); (M.Q.); (J.W.); (L.Z.)
- Clinical Research Center for Medical Imaging in Hubei Province, Wuhan 430022, China
- Hubei Province Key Laboratory of Molecular Imaging, Wuhan 430022, China
| | - Lang Gao
- Department of Ultrasound Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430022, China; (M.J.); (W.W.); (L.H.); (L.G.); (Y.Z.); (Y.L.); (M.Q.); (J.W.); (L.Z.)
- Clinical Research Center for Medical Imaging in Hubei Province, Wuhan 430022, China
- Hubei Province Key Laboratory of Molecular Imaging, Wuhan 430022, China
| | - Yanting Zhang
- Department of Ultrasound Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430022, China; (M.J.); (W.W.); (L.H.); (L.G.); (Y.Z.); (Y.L.); (M.Q.); (J.W.); (L.Z.)
- Clinical Research Center for Medical Imaging in Hubei Province, Wuhan 430022, China
- Hubei Province Key Laboratory of Molecular Imaging, Wuhan 430022, China
| | - Yixia Lin
- Department of Ultrasound Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430022, China; (M.J.); (W.W.); (L.H.); (L.G.); (Y.Z.); (Y.L.); (M.Q.); (J.W.); (L.Z.)
- Clinical Research Center for Medical Imaging in Hubei Province, Wuhan 430022, China
- Hubei Province Key Laboratory of Molecular Imaging, Wuhan 430022, China
| | - Mingzhu Qian
- Department of Ultrasound Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430022, China; (M.J.); (W.W.); (L.H.); (L.G.); (Y.Z.); (Y.L.); (M.Q.); (J.W.); (L.Z.)
- Clinical Research Center for Medical Imaging in Hubei Province, Wuhan 430022, China
- Hubei Province Key Laboratory of Molecular Imaging, Wuhan 430022, China
| | - Jing Wang
- Department of Ultrasound Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430022, China; (M.J.); (W.W.); (L.H.); (L.G.); (Y.Z.); (Y.L.); (M.Q.); (J.W.); (L.Z.)
- Clinical Research Center for Medical Imaging in Hubei Province, Wuhan 430022, China
- Hubei Province Key Laboratory of Molecular Imaging, Wuhan 430022, China
| | - Li Zhang
- Department of Ultrasound Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430022, China; (M.J.); (W.W.); (L.H.); (L.G.); (Y.Z.); (Y.L.); (M.Q.); (J.W.); (L.Z.)
- Clinical Research Center for Medical Imaging in Hubei Province, Wuhan 430022, China
- Hubei Province Key Laboratory of Molecular Imaging, Wuhan 430022, China
- Shenzhen Huazhong University of Science and Technology Research Institute, Shenzhen 518057, China
| | - Mingxing Xie
- Department of Ultrasound Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430022, China; (M.J.); (W.W.); (L.H.); (L.G.); (Y.Z.); (Y.L.); (M.Q.); (J.W.); (L.Z.)
- Clinical Research Center for Medical Imaging in Hubei Province, Wuhan 430022, China
- Hubei Province Key Laboratory of Molecular Imaging, Wuhan 430022, China
- Shenzhen Huazhong University of Science and Technology Research Institute, Shenzhen 518057, China
- Tongji Medical College and Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430022, China
- Correspondence: (M.X.); (Y.L.); Tel.: +86-27-8572-6430 (M.X.); +86-27-8572-6386 (Y.L.); Fax: +86-27-8572-6386 (M.X.); +86-27-8572-6386 (Y.L.)
| | - Yuman Li
- Department of Ultrasound Medicine, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan 430022, China; (M.J.); (W.W.); (L.H.); (L.G.); (Y.Z.); (Y.L.); (M.Q.); (J.W.); (L.Z.)
- Clinical Research Center for Medical Imaging in Hubei Province, Wuhan 430022, China
- Hubei Province Key Laboratory of Molecular Imaging, Wuhan 430022, China
- Correspondence: (M.X.); (Y.L.); Tel.: +86-27-8572-6430 (M.X.); +86-27-8572-6386 (Y.L.); Fax: +86-27-8572-6386 (M.X.); +86-27-8572-6386 (Y.L.)
| |
Collapse
|
6
|
Hungerford SL, Kearney K, Bart NK. Editorial for "Non-Contrast Cardiac MRI Predictors of Heart Failure Hospitalization in Heart Failure With Preserved Ejection Fraction". J Magn Reson Imaging 2021; 55:1826-1827. [PMID: 34551180 DOI: 10.1002/jmri.27933] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2021] [Accepted: 08/03/2021] [Indexed: 11/08/2022] Open
Affiliation(s)
- Sara L Hungerford
- Department of Cardiology, St Vincent's Hospital, Sydney, New South Wales, Australia.,Faculty of Medicine, The University of New South Wales, Sydney, New South Wales, Australia.,Victor Chang Cardiac Research Institute, Sydney, New South Wales, Australia
| | - Katherine Kearney
- Department of Cardiology, St Vincent's Hospital, Sydney, New South Wales, Australia.,Faculty of Medicine, The University of New South Wales, Sydney, New South Wales, Australia.,Victor Chang Cardiac Research Institute, Sydney, New South Wales, Australia
| | - Nicole K Bart
- Department of Cardiology, St Vincent's Hospital, Sydney, New South Wales, Australia.,Faculty of Medicine, The University of New South Wales, Sydney, New South Wales, Australia.,Victor Chang Cardiac Research Institute, Sydney, New South Wales, Australia
| |
Collapse
|