1
|
Li X, Zhang H, Yue J, Yin L, Li W, Ding G, Peng B, Xie S. A multi-task deep learning approach for real-time view classification and quality assessment of echocardiographic images. Sci Rep 2024; 14:20484. [PMID: 39227373 PMCID: PMC11372079 DOI: 10.1038/s41598-024-71530-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2024] [Accepted: 08/28/2024] [Indexed: 09/05/2024] Open
Abstract
High-quality standard views in two-dimensional echocardiography are essential for accurate cardiovascular disease diagnosis and treatment decisions. However, the quality of echocardiographic images is highly dependent on the practitioner's experience. Ensuring timely quality control of echocardiographic images in the clinical setting remains a significant challenge. In this study, we aimed to propose new quality assessment criteria and develop a multi-task deep learning model for real-time multi-view classification and image quality assessment (six standard views and "others"). A total of 170,311 echocardiographic images collected between 2015 and 2022 were utilized to develop and evaluate the model. On the test set, the model achieved an overall classification accuracy of 97.8% (95%CI 97.7-98.0) and a mean absolute error of 6.54 (95%CI 6.43-6.66). A single-frame inference time of 2.8 ms was achieved, meeting real-time requirements. We also analyzed pre-stored images from three distinct groups of echocardiographers (junior, senior, and expert) to evaluate the clinical feasibility of the model. Our multi-task model can provide objective, reproducible, and clinically significant view quality assessment results for echocardiographic images, potentially optimizing the clinical image acquisition process and improving AI-assisted diagnosis accuracy.
Collapse
Affiliation(s)
- Xinyu Li
- School of Computer Science and Software Engineering, Southwest Petroleum University, Chengdu, 610500, China
| | - Hongmei Zhang
- Ultrasound in Cardiac Electrophysiology and Biomechanics Key Laboratory of Sichuan Province, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, 32# W. Sec 2, 1st Ring Rd., Chengdu, 610072, China
- Department of Cardiovascular Ultrasound & Noninvasive Cardiology, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, 32# W. Sec 2, 1st Ring Rd., Chengdu, 610072, China
| | - Jing Yue
- School of Computer Science and Software Engineering, Southwest Petroleum University, Chengdu, 610500, China
| | - Lixue Yin
- Ultrasound in Cardiac Electrophysiology and Biomechanics Key Laboratory of Sichuan Province, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, 32# W. Sec 2, 1st Ring Rd., Chengdu, 610072, China
- Department of Cardiovascular Ultrasound & Noninvasive Cardiology, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, 32# W. Sec 2, 1st Ring Rd., Chengdu, 610072, China
| | - Wenhua Li
- Ultrasound in Cardiac Electrophysiology and Biomechanics Key Laboratory of Sichuan Province, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, 32# W. Sec 2, 1st Ring Rd., Chengdu, 610072, China
- Department of Cardiovascular Ultrasound & Noninvasive Cardiology, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, 32# W. Sec 2, 1st Ring Rd., Chengdu, 610072, China
| | - Geqi Ding
- Ultrasound in Cardiac Electrophysiology and Biomechanics Key Laboratory of Sichuan Province, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, 32# W. Sec 2, 1st Ring Rd., Chengdu, 610072, China
- Department of Cardiovascular Ultrasound & Noninvasive Cardiology, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, 32# W. Sec 2, 1st Ring Rd., Chengdu, 610072, China
| | - Bo Peng
- School of Computer Science and Software Engineering, Southwest Petroleum University, Chengdu, 610500, China
| | - Shenghua Xie
- Ultrasound in Cardiac Electrophysiology and Biomechanics Key Laboratory of Sichuan Province, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, 32# W. Sec 2, 1st Ring Rd., Chengdu, 610072, China.
- Department of Cardiovascular Ultrasound & Noninvasive Cardiology, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, 32# W. Sec 2, 1st Ring Rd., Chengdu, 610072, China.
| |
Collapse
|
2
|
Decoodt P, Sierra-Sosa D, Anghel L, Cuminetti G, De Keyzer E, Morissens M. Transfer Learning Video Classification of Preserved, Mid-Range, and Reduced Left Ventricular Ejection Fraction in Echocardiography. Diagnostics (Basel) 2024; 14:1439. [PMID: 39001328 PMCID: PMC11241427 DOI: 10.3390/diagnostics14131439] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2024] [Revised: 07/01/2024] [Accepted: 07/02/2024] [Indexed: 07/16/2024] Open
Abstract
Identifying patients with left ventricular ejection fraction (EF), either reduced [EF < 40% (rEF)], mid-range [EF 40-50% (mEF)], or preserved [EF > 50% (pEF)], is considered of primary clinical importance. An end-to-end video classification using AutoML in Google Vertex AI was applied to echocardiographic recordings. Datasets balanced by majority undersampling, each corresponding to one out of three possible classifications, were obtained from the Standford EchoNet-Dynamic repository. A train-test split of 75/25 was applied. A binary video classification of rEF vs. not rEF demonstrated good performance (test dataset: ROC AUC score 0.939, accuracy 0.863, sensitivity 0.894, specificity 0.831, positive predicting value 0.842). A second binary classification of not pEF vs. pEF was slightly less performing (test dataset: ROC AUC score 0.917, accuracy 0.829, sensitivity 0.761, specificity 0.891, positive predicting value 0.888). A ternary classification was also explored, and lower performance was observed, mainly for the mEF class. A non-AutoML PyTorch implementation in open access confirmed the feasibility of our approach. With this proof of concept, end-to-end video classification based on transfer learning to categorize EF merits consideration for further evaluation in prospective clinical studies.
Collapse
Affiliation(s)
- Pierre Decoodt
- Cardiologie, Centre Hospitalier Universitaire Brugmann, Faculté de Médecine, Université Libre de Bruxelles, Place Van Gehuchten 4, 1020 Brussels, Belgium; (L.A.); (G.C.); (E.D.K.); (M.M.)
| | - Daniel Sierra-Sosa
- Computer Science and Information Technologies Department, Hood College, 401 Rosemont Ave., Frederick, MD 21702, USA;
| | - Laura Anghel
- Cardiologie, Centre Hospitalier Universitaire Brugmann, Faculté de Médecine, Université Libre de Bruxelles, Place Van Gehuchten 4, 1020 Brussels, Belgium; (L.A.); (G.C.); (E.D.K.); (M.M.)
| | - Giovanni Cuminetti
- Cardiologie, Centre Hospitalier Universitaire Brugmann, Faculté de Médecine, Université Libre de Bruxelles, Place Van Gehuchten 4, 1020 Brussels, Belgium; (L.A.); (G.C.); (E.D.K.); (M.M.)
| | - Eva De Keyzer
- Cardiologie, Centre Hospitalier Universitaire Brugmann, Faculté de Médecine, Université Libre de Bruxelles, Place Van Gehuchten 4, 1020 Brussels, Belgium; (L.A.); (G.C.); (E.D.K.); (M.M.)
| | - Marielle Morissens
- Cardiologie, Centre Hospitalier Universitaire Brugmann, Faculté de Médecine, Université Libre de Bruxelles, Place Van Gehuchten 4, 1020 Brussels, Belgium; (L.A.); (G.C.); (E.D.K.); (M.M.)
| |
Collapse
|
3
|
Barris B, Karp A, Jacobs M, Frishman WH. Harnessing the Power of AI: A Comprehensive Review of Left Ventricular Ejection Fraction Assessment With Echocardiography. Cardiol Rev 2024:00045415-990000000-00237. [PMID: 38520327 DOI: 10.1097/crd.0000000000000691] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/25/2024]
Abstract
The quantification of left ventricular ejection fraction (LVEF) has important clinical utility in the assessment of cardiac function and is vital for the diagnosis of cardiovascular diseases. A transthoracic echocardiogram serves as the most commonly used tool for LVEF assessment for several reasons, including, its noninvasive nature, great safety profile, real-time image processing ability, portability, and cost-effectiveness. However, transthoracic echocardiogram is highly dependent on the clinical skill of the sonographer and interpreting physician. Moreover, even amongst well-trained clinicians, significant interobserver variability exists in the quantification of LVEF. In search of possible solutions, the usage of artificial intelligence (AI) has been increasingly tested in the clinical setting. While AI-derived ejection fraction is in the preliminary stages of development, it has shown promise in its ability to rapidly quantify LVEF, decrease variability, increase accuracy, and utilize higher-order processing capabilities. This review will delineate the latest advancements of AI in evaluating LVEF through echocardiography and explore the challenges and future trajectory of this emerging domain.
Collapse
Affiliation(s)
- Ben Barris
- From the Department of Medicine, Westchester Medical Center, Valhalla, NY
| | - Avrohom Karp
- From the Department of Medicine, Westchester Medical Center, Valhalla, NY
| | - Menachem Jacobs
- Department of Medicine, SUNY Downstate Medical Center, Brooklyn, NY
| | - William H Frishman
- From the Department of Medicine, Westchester Medical Center, Valhalla, NY
| |
Collapse
|
4
|
Wang Y, Lin W, Zhuang X, Wang X, He Y, Li L, Lyu G. Advances in artificial intelligence for the diagnosis and treatment of ovarian cancer (Review). Oncol Rep 2024; 51:46. [PMID: 38240090 PMCID: PMC10828921 DOI: 10.3892/or.2024.8705] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2023] [Accepted: 01/05/2024] [Indexed: 01/23/2024] Open
Abstract
Artificial intelligence (AI) has emerged as a crucial technique for extracting high‑throughput information from various sources, including medical images, pathological images, and genomics, transcriptomics, proteomics and metabolomics data. AI has been widely used in the field of diagnosis, for the differentiation of benign and malignant ovarian cancer (OC), and for prognostic assessment, with favorable results. Notably, AI‑based radiomics has proven to be a non‑invasive, convenient and economical approach, making it an essential asset in a gynecological setting. The present study reviews the application of AI in the diagnosis, differentiation and prognostic assessment of OC. It is suggested that AI‑based multi‑omics studies have the potential to improve the diagnostic and prognostic predictive ability in patients with OC, thereby facilitating the realization of precision medicine.
Collapse
Affiliation(s)
- Yanli Wang
- Department of Ultrasound, The Second Affiliated Hospital of Fujian Medical University, Quanzhou, Fujian 362000, P.R. China
| | - Weihong Lin
- Department of Obstetrics and Gynecology, The Second Affiliated Hospital of Fujian Medical University, Quanzhou, Fujian 362000, P.R. China
| | - Xiaoling Zhuang
- Department of Pathology, The Second Affiliated Hospital of Fujian Medical University, Quanzhou, Fujian 362000, P.R. China
| | - Xiali Wang
- Department of Clinical Medicine, Quanzhou Medical College, Quanzhou, Fujian 362000, P.R. China
| | - Yifang He
- Department of Ultrasound, The Second Affiliated Hospital of Fujian Medical University, Quanzhou, Fujian 362000, P.R. China
| | - Luhong Li
- Department of Obstetrics and Gynecology, The Second Affiliated Hospital of Fujian Medical University, Quanzhou, Fujian 362000, P.R. China
| | - Guorong Lyu
- Department of Ultrasound, The Second Affiliated Hospital of Fujian Medical University, Quanzhou, Fujian 362000, P.R. China
- Department of Clinical Medicine, Quanzhou Medical College, Quanzhou, Fujian 362000, P.R. China
| |
Collapse
|
5
|
Gala D, Behl H, Shah M, Makaryus AN. The Role of Artificial Intelligence in Improving Patient Outcomes and Future of Healthcare Delivery in Cardiology: A Narrative Review of the Literature. Healthcare (Basel) 2024; 12:481. [PMID: 38391856 PMCID: PMC10887513 DOI: 10.3390/healthcare12040481] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2023] [Revised: 02/13/2024] [Accepted: 02/14/2024] [Indexed: 02/24/2024] Open
Abstract
Cardiovascular diseases exert a significant burden on the healthcare system worldwide. This narrative literature review discusses the role of artificial intelligence (AI) in the field of cardiology. AI has the potential to assist healthcare professionals in several ways, such as diagnosing pathologies, guiding treatments, and monitoring patients, which can lead to improved patient outcomes and a more efficient healthcare system. Moreover, clinical decision support systems in cardiology have improved significantly over the past decade. The addition of AI to these clinical decision support systems can improve patient outcomes by processing large amounts of data, identifying subtle associations, and providing a timely, evidence-based recommendation to healthcare professionals. Lastly, the application of AI allows for personalized care by utilizing predictive models and generating patient-specific treatment plans. However, there are several challenges associated with the use of AI in healthcare. The application of AI in healthcare comes with significant cost and ethical considerations. Despite these challenges, AI will be an integral part of healthcare delivery in the near future, leading to personalized patient care, improved physician efficiency, and anticipated better outcomes.
Collapse
Affiliation(s)
- Dhir Gala
- Department of Clinical Science, American University of the Caribbean School of Medicine, Cupecoy, Sint Maarten, The Netherlands
| | - Haditya Behl
- Department of Clinical Science, American University of the Caribbean School of Medicine, Cupecoy, Sint Maarten, The Netherlands
| | - Mili Shah
- Department of Clinical Science, American University of the Caribbean School of Medicine, Cupecoy, Sint Maarten, The Netherlands
| | - Amgad N Makaryus
- Donald and Barbara Zucker School of Medicine at Hofstra/Northwell, Hofstra University, 500 Hofstra Blvd., Hempstead, NY 11549, USA
- Department of Cardiology, Nassau University Medical Center, Hempstead, NY 11554, USA
| |
Collapse
|
6
|
Nicolosi GL. Artificial Intelligence in Cardiology: Why So Many Great Promises and Expectations, but Still a Limited Clinical Impact? J Clin Med 2023; 12:jcm12072734. [PMID: 37048817 PMCID: PMC10095331 DOI: 10.3390/jcm12072734] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2023] [Accepted: 04/01/2023] [Indexed: 04/14/2023] Open
Abstract
Looking at the extremely large amount of literature, as summarized in two recent reviews on applications of Artificial Intelligence in Cardiology, both in the adult and pediatric age groups, published in the Journal of Clinical Medicine [...].
Collapse
|