1
|
Lambert B, Forbes F, Doyle S, Dehaene H, Dojat M. Trustworthy clinical AI solutions: A unified review of uncertainty quantification in Deep Learning models for medical image analysis. Artif Intell Med 2024; 150:102830. [PMID: 38553168 DOI: 10.1016/j.artmed.2024.102830] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Revised: 02/28/2024] [Accepted: 03/01/2024] [Indexed: 04/02/2024]
Abstract
The full acceptance of Deep Learning (DL) models in the clinical field is rather low with respect to the quantity of high-performing solutions reported in the literature. End users are particularly reluctant to rely on the opaque predictions of DL models. Uncertainty quantification methods have been proposed in the literature as a potential solution, to reduce the black-box effect of DL models and increase the interpretability and the acceptability of the result by the final user. In this review, we propose an overview of the existing methods to quantify uncertainty associated with DL predictions. We focus on applications to medical image analysis, which present specific challenges due to the high dimensionality of images and their variable quality, as well as constraints associated with real-world clinical routine. Moreover, we discuss the concept of structural uncertainty, a corpus of methods to facilitate the alignment of segmentation uncertainty estimates with clinical attention. We then discuss the evaluation protocols to validate the relevance of uncertainty estimates. Finally, we highlight the open challenges for uncertainty quantification in the medical field.
Collapse
Affiliation(s)
- Benjamin Lambert
- Univ. Grenoble Alpes, Inserm, U1216, Grenoble Institut des Neurosciences, Grenoble, 38000, France; Pixyl Research and Development Laboratory, Grenoble, 38000, France
| | - Florence Forbes
- Univ. Grenoble Alpes, Inria, CNRS, Grenoble INP, LJK, Grenoble, 38000, France
| | - Senan Doyle
- Pixyl Research and Development Laboratory, Grenoble, 38000, France
| | - Harmonie Dehaene
- Pixyl Research and Development Laboratory, Grenoble, 38000, France
| | - Michel Dojat
- Univ. Grenoble Alpes, Inserm, U1216, Grenoble Institut des Neurosciences, Grenoble, 38000, France.
| |
Collapse
|
2
|
Olivetti N, Sacilotto L, Moleta DB, de França LA, Capeline LS, Wulkan F, Wu TC, Pessente GD, de Carvalho MLP, Hachul DT, Pereira ADC, Krieger JE, Scanavacca MI, Vieira MLC, Darrieux F. Enhancing Arrhythmogenic Right Ventricular Cardiomyopathy Detection and Risk Stratification: Insights from Advanced Echocardiographic Techniques. Diagnostics (Basel) 2024; 14:150. [PMID: 38248027 PMCID: PMC10814792 DOI: 10.3390/diagnostics14020150] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Revised: 12/29/2023] [Accepted: 01/02/2024] [Indexed: 01/23/2024] Open
Abstract
INTRODUCTION The echocardiographic diagnosis criteria for arrhythmogenic right ventricular cardiomyopathy (ARVC) are highly specific but sensitivity is low, especially in the early stages of the disease. The role of echocardiographic strain in ARVC has not been fully elucidated, although prior studies suggest that it can improve the detection of subtle functional abnormalities. The purposes of the study were to determine whether these advanced measures of right ventricular (RV) dysfunction on echocardiogram, including RV strain, increase diagnostic value for ARVC disease detection and to evaluate the association of echocardiographic parameters with arrhythmic outcomes. METHODS The study included 28 patients from the Heart Institute of São Paulo ARVC cohort with a definite diagnosis of ARVC established according to the 2010 Task Force Criteria. All patients were submitted to ECHO's advanced techniques including RV strain, and the parameters were compared to prior conventional visual ECHO and CMR. RESULTS In total, 28 patients were enrolled in order to perform ECHO's advanced techniques. A total of 2/28 (7%) patients died due to a cardiovascular cause, 2/28 (7%) underwent heart transplantation, and 14/28 (50%) patients developed sustained ventricular arrhythmic events. Among ECHO's parameters, RV dilatation, measured by RVDd (p = 0.018) and RVOT PSAX (p = 0.044), was significantly associated with arrhythmic outcomes. RV free wall longitudinal strain < 14.35% in absolute value was associated with arrhythmic outcomes (p = 0.033). CONCLUSION Our data suggest that ECHO's advanced techniques improve ARVC detection and that abnormal RV strain can be associated with arrhythmic risk stratification. Further studies are necessary to better demonstrate these findings and contribute to risk stratification in ARVC, in addition to other well-known risk markers.
Collapse
Affiliation(s)
- Natália Olivetti
- Arrhythmia Unit, Instituto do Coração (InCor), Hospital das Clínicas HCFMUSP, Faculdade de Medicina, Universidade de São Paulo, Sao Paulo 05403-900, Brazil; (L.S.); (T.C.W.); (G.D.P.); (D.T.H.); (M.I.S.)
- Laboratory of Genetics and Molecular Cardiology, Instituto do Coração (InCor), Hospital das Clínicas HCFMUSP, Faculdade de Medicina, Universidade de São Paulo, Sao Paulo 05403-900, Brazil; (L.S.C.); (F.W.); (M.L.P.d.C.); (A.d.C.P.); (J.E.K.)
| | - Luciana Sacilotto
- Arrhythmia Unit, Instituto do Coração (InCor), Hospital das Clínicas HCFMUSP, Faculdade de Medicina, Universidade de São Paulo, Sao Paulo 05403-900, Brazil; (L.S.); (T.C.W.); (G.D.P.); (D.T.H.); (M.I.S.)
| | - Danilo Bora Moleta
- Echocardiogram Imaging Unit, Instituto do Coração (InCor), Hospital das Clínicas HCFMUSP, Faculdade de Medicina, Universidade de São Paulo, Sao Paulo 05403-900, Brazil; (D.B.M.); (M.L.C.V.)
| | - Lucas Arraes de França
- Echocardiogram Imaging Unit, Hospital Israelita Albert Einstein, Sao Paulo 05652-900, Brazil;
| | - Lorena Squassante Capeline
- Laboratory of Genetics and Molecular Cardiology, Instituto do Coração (InCor), Hospital das Clínicas HCFMUSP, Faculdade de Medicina, Universidade de São Paulo, Sao Paulo 05403-900, Brazil; (L.S.C.); (F.W.); (M.L.P.d.C.); (A.d.C.P.); (J.E.K.)
| | - Fanny Wulkan
- Laboratory of Genetics and Molecular Cardiology, Instituto do Coração (InCor), Hospital das Clínicas HCFMUSP, Faculdade de Medicina, Universidade de São Paulo, Sao Paulo 05403-900, Brazil; (L.S.C.); (F.W.); (M.L.P.d.C.); (A.d.C.P.); (J.E.K.)
| | - Tan Chen Wu
- Arrhythmia Unit, Instituto do Coração (InCor), Hospital das Clínicas HCFMUSP, Faculdade de Medicina, Universidade de São Paulo, Sao Paulo 05403-900, Brazil; (L.S.); (T.C.W.); (G.D.P.); (D.T.H.); (M.I.S.)
| | - Gabriele D’Arezzo Pessente
- Arrhythmia Unit, Instituto do Coração (InCor), Hospital das Clínicas HCFMUSP, Faculdade de Medicina, Universidade de São Paulo, Sao Paulo 05403-900, Brazil; (L.S.); (T.C.W.); (G.D.P.); (D.T.H.); (M.I.S.)
| | - Mariana Lombardi Peres de Carvalho
- Laboratory of Genetics and Molecular Cardiology, Instituto do Coração (InCor), Hospital das Clínicas HCFMUSP, Faculdade de Medicina, Universidade de São Paulo, Sao Paulo 05403-900, Brazil; (L.S.C.); (F.W.); (M.L.P.d.C.); (A.d.C.P.); (J.E.K.)
| | - Denise Tessariol Hachul
- Arrhythmia Unit, Instituto do Coração (InCor), Hospital das Clínicas HCFMUSP, Faculdade de Medicina, Universidade de São Paulo, Sao Paulo 05403-900, Brazil; (L.S.); (T.C.W.); (G.D.P.); (D.T.H.); (M.I.S.)
| | - Alexandre da Costa Pereira
- Laboratory of Genetics and Molecular Cardiology, Instituto do Coração (InCor), Hospital das Clínicas HCFMUSP, Faculdade de Medicina, Universidade de São Paulo, Sao Paulo 05403-900, Brazil; (L.S.C.); (F.W.); (M.L.P.d.C.); (A.d.C.P.); (J.E.K.)
| | - José E. Krieger
- Laboratory of Genetics and Molecular Cardiology, Instituto do Coração (InCor), Hospital das Clínicas HCFMUSP, Faculdade de Medicina, Universidade de São Paulo, Sao Paulo 05403-900, Brazil; (L.S.C.); (F.W.); (M.L.P.d.C.); (A.d.C.P.); (J.E.K.)
| | - Mauricio Ibrahim Scanavacca
- Arrhythmia Unit, Instituto do Coração (InCor), Hospital das Clínicas HCFMUSP, Faculdade de Medicina, Universidade de São Paulo, Sao Paulo 05403-900, Brazil; (L.S.); (T.C.W.); (G.D.P.); (D.T.H.); (M.I.S.)
| | - Marcelo Luiz Campos Vieira
- Echocardiogram Imaging Unit, Instituto do Coração (InCor), Hospital das Clínicas HCFMUSP, Faculdade de Medicina, Universidade de São Paulo, Sao Paulo 05403-900, Brazil; (D.B.M.); (M.L.C.V.)
- Echocardiogram Imaging Unit, Hospital Israelita Albert Einstein, Sao Paulo 05652-900, Brazil;
| | - Francisco Darrieux
- Arrhythmia Unit, Instituto do Coração (InCor), Hospital das Clínicas HCFMUSP, Faculdade de Medicina, Universidade de São Paulo, Sao Paulo 05403-900, Brazil; (L.S.); (T.C.W.); (G.D.P.); (D.T.H.); (M.I.S.)
| |
Collapse
|