1
|
Huang KC, Lin DSH, Jeng GS, Lin TT, Lin LY, Lee CK, Lin LC. Left Ventricular Segmentation, Warping, and Myocardial Registration for Automated Strain Measurement. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024; 37:2274-2286. [PMID: 38639806 DOI: 10.1007/s10278-024-01119-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/21/2023] [Revised: 04/07/2024] [Accepted: 04/09/2024] [Indexed: 04/20/2024]
Abstract
The left ventricular global longitudinal strain (LVGLS) is a crucial prognostic indicator. However, inconsistencies in measurements due to the speckle tracking algorithm and manual adjustments have hindered its standardization and democratization. To solve this issue, we proposed a fully automated strain measurement by artificial intelligence-assisted LV segmentation contours. The LV segmentation model was trained from echocardiograms of 368 adults (11,125 frames). We compared the registration-like effects of dynamic time warping (DTW) with speckle tracking on a synthetic echocardiographic dataset in experiment-1. In experiment-2, we enrolled 80 patients to compare the DTW method with commercially available software. In experiment-3, we combined the segmentation model and DTW method to create the artificial intelligence (AI)-DTW method, which was then tested on 40 patients with general LV morphology, 20 with dilated cardiomyopathy (DCMP), and 20 with transthyretin-associated cardiac amyloidosis (ATTR-CA), 20 with severe aortic stenosis (AS), and 20 with severe mitral regurgitation (MR). Experiments-1 and -2 revealed that the DTW method is consistent with dedicated software. In experiment-3, the AI-DTW strain method showed comparable results for general LV morphology (bias - 0.137 ± 0.398%), DCMP (- 0.397 ± 0.607%), ATTR-CA (0.095 ± 0.581%), AS (0.334 ± 0.358%), and MR (0.237 ± 0.490%). Moreover, the strain curves showed a high correlation in their characteristics, with R-squared values of 0.8879-0.9452 for those LV morphology in experiment-3. Measuring LVGLS through dynamic warping of segmentation contour is a feasible method compared to traditional tracking techniques. This approach has the potential to decrease the need for manual demarcation and make LVGLS measurements more efficient and user-friendly for daily practice.
Collapse
Affiliation(s)
- Kuan-Chih Huang
- Graduate Institute of Clinical Medicine, College of Medicine, National Taiwan University, Taipei, Taiwan
- National Taiwan University Hospital, Hsin-Chu branch, Hsinchu, Taiwan
| | - Donna Shu-Han Lin
- Division of Cardiology, Department of Internal Medicine, Shin Kong Wu Ho-Su Memorial Hospital, Taipei, Taiwan
| | - Geng-Shi Jeng
- Institute of Electronics, National Yang Ming Chiao Tung University, Hsinchu, Taiwan
| | - Ting-Tse Lin
- Section of Cardiology, Department of Internal Medicine, National Taiwan University Hospital, Taipei, Taiwan
| | - Lian-Yu Lin
- Section of Cardiology, Department of Internal Medicine, National Taiwan University Hospital, Taipei, Taiwan
| | - Chih-Kuo Lee
- National Taiwan University Hospital, Hsin-Chu branch, Hsinchu, Taiwan
| | - Lung-Chun Lin
- Section of Cardiology, Department of Internal Medicine, National Taiwan University Hospital, Taipei, Taiwan.
| |
Collapse
|
2
|
Berger L, Coisy F, Sammoud S, de Oliveira F, Grandpierre RG, Grau-Mercier L, Bobbia X, Markarian T. Evaluation of left ventricular ejection fraction by a new automatic tool on a pocket ultrasound device: Concordance study with cardiac magnetic resonance imaging. PLoS One 2024; 19:e0308580. [PMID: 39133705 PMCID: PMC11318925 DOI: 10.1371/journal.pone.0308580] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2024] [Accepted: 07/19/2024] [Indexed: 08/15/2024] Open
Abstract
INTRODUCTION Assessment of left ventricular ejection fraction (LVEF) is one of the primary objectives of echocardiography. The gold standard assessment technique in emergency medicine is eyeballing. A new tool is now available on pocket ultrasound devices (PUD): automatic LVEF. The primary aim of this study was to evaluate the concordance between LVEF values estimated by automatic LVEF with PUD and by cardiac magnetic resonance imaging (MRI). MATERIALS This was a prospective, monocentric, and observational study. All adult patients with an indication for cardiac MRI underwent a point-of-care ultrasound. Blinded to the MRI results, the emergency physician assessed LVEF using the automatic PUD tool and by visual evaluation. RESULTS Sixty patients were included and analyzed. Visual estimation of LVEF was feasible for all patients and automatic evaluation for 52 (87%) patients. Lin's concordance correlation coefficient between automatic ejection fraction with PUD and by cardiac MRI was 0.23 (95% CI, 0.03-0.40). CONCLUSION Concordance between LVEF estimated by the automatic ejection fraction with PUD and LVEF estimated by MRI was non-existent.
Collapse
Affiliation(s)
- Lucie Berger
- Department of Emergency Medicine, UR UM 103 (IMAGINE), Nîmes University Hospital, Montpellier University, Nîmes, France
| | - Fabien Coisy
- Department of Emergency Medicine, UR UM 103 (IMAGINE), Nîmes University Hospital, Montpellier University, Nîmes, France
| | - Skander Sammoud
- Department of Medical Imaging, IPI Platform, Nîmes University Hospital, Medical Imaging Group Nîmes, IMAGINE, University of Montpellier, Nîmes, France
| | - Fabien de Oliveira
- Department of Medical Imaging, IPI Platform, Nîmes University Hospital, Medical Imaging Group Nîmes, IMAGINE, University of Montpellier, Nîmes, France
| | - Romain Genre Grandpierre
- Department of Emergency Medicine, UR UM 103 (IMAGINE), Nîmes University Hospital, Montpellier University, Nîmes, France
| | - Laura Grau-Mercier
- Department of Emergency Medicine, UR UM 103 (IMAGINE), Nîmes University Hospital, Montpellier University, Nîmes, France
| | - Xavier Bobbia
- Department of Emergency Medicine, UR UM 103 (IMAGINE), Montpellier University Hospital, Montpellier University, Montpellier, France
| | - Thibaut Markarian
- Department of Emergency Medicine, UMR 1263 (C2VN), Assistance Publique des Hôpitaux de Marseille (APHM), Timone University Hospital, Aix-Marseille University, Marseille, France
| |
Collapse
|
3
|
Vega R, Kwok C, Rakkunedeth Hareendranathan A, Nagdev A, Jaremko JL. Assessment of an Artificial Intelligence Tool for Estimating Left Ventricular Ejection Fraction in Echocardiograms from Apical and Parasternal Long-Axis Views. Diagnostics (Basel) 2024; 14:1719. [PMID: 39202209 PMCID: PMC11353168 DOI: 10.3390/diagnostics14161719] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2024] [Revised: 08/07/2024] [Accepted: 08/07/2024] [Indexed: 09/03/2024] Open
Abstract
This work aims to evaluate the performance of a new artificial intelligence tool (ExoAI) to compute the left ventricular ejection fraction (LVEF) in echocardiograms of the apical and parasternal long axis (PLAX) views. We retrospectively gathered echocardiograms from 441 individual patients (70% male, age: 67.3 ± 15.3, weight: 87.7 ± 25.4, BMI: 29.5 ± 7.4) and computed the ejection fraction in each echocardiogram using the ExoAI algorithm. We compared its performance against the ejection fraction from the clinical report. ExoAI achieved a root mean squared error of 7.58% in A2C, 7.45% in A4C, and 7.29% in PLAX, and correlations of 0.79, 0.75, and 0.89, respectively. As for the detection of low EF values (EF < 50%), ExoAI achieved an accuracy of 83% in A2C, 80% in A4C, and 91% in PLAX. Our results suggest that ExoAI effectively estimates the LVEF and it is an effective tool for estimating abnormal ejection fraction values (EF < 50%). Importantly, the PLAX view allows for the estimation of the ejection fraction when it is not feasible to acquire apical views (e.g., in ICU settings where it is not possible to move the patient to obtain an apical scan).
Collapse
Affiliation(s)
| | - Cherise Kwok
- Department of Radiology and Diagnostic Imaging, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB T6G 2R3, Canada; (C.K.); (A.R.H.); (J.L.J.)
| | - Abhilash Rakkunedeth Hareendranathan
- Department of Radiology and Diagnostic Imaging, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB T6G 2R3, Canada; (C.K.); (A.R.H.); (J.L.J.)
| | - Arun Nagdev
- Alameda Health System, Highland General Hospital, University of California San Francisco, San Francisco, CA 94143, USA;
| | - Jacob L. Jaremko
- Department of Radiology and Diagnostic Imaging, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB T6G 2R3, Canada; (C.K.); (A.R.H.); (J.L.J.)
| |
Collapse
|
4
|
de Raat FM, Bingley P, Bouwmeester S, Felix SEA, Montenij LJ, Bouwman AR. Automatic tablet-based monoplane quantification of stroke volume and left ventricular ejection fraction: A comparative assessment against computer-based biplane and monoplane tools. Echocardiography 2024; 41:e15904. [PMID: 39158960 DOI: 10.1111/echo.15904] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2024] [Revised: 07/26/2024] [Accepted: 07/31/2024] [Indexed: 08/20/2024] Open
Abstract
BACKGROUND Point-of-care cardiovascular left ventricle ejection fraction (LVEF) quantification is established, but automatic tablet-based stroke volume (SV) quantification with handheld ultrasound (HAND) devices is unexplored. We evaluated a tablet-based monoplane LVEF and LV volume quantification tool (AutoEF) against a computer-based tool (Tomtec) for LVEF and SV quantification. METHODS Patients underwent HAND scans, and LVEF and SV were quantified using AutoEF and computer-based software that utilized either apical four-chamber views (Auto Strain-monoplane [AS-mono]) or both apical four-chamber and apical two-chamber views (Auto Strain-biplane [AS-bi]). Correlation and Bland-Altman analysis were used to compare AutoEF with AS-mono and AS-bi. RESULTS Out of 43 participants, eight were excluded. AutoEF showed a correlation of .83 [.69:.91] with AS-mono for LVEF and .68 [.44:.82] for SV. The correlation with AS-bi was .79 [.62:.89] for LVEF and .66 [.42:.81] for SV. The bias between AutoEF and AS-mono was 4.88% [3.15:6.61] for LVEF and 17.46 mL [12.99:21.92] for SV. The limits of agreement (LOA) were [-5.50:15.26]% for LVEF and [-8.02:42.94] mL for SV. The bias between AutoEF and AS-bi was 6.63% [5.31:7.94] for LVEF and 20.62 mL [16.18:25.05] for SV, with LOA of [-1.20:14.47]% for LVEF and [-4.71:45.94] mL for SV. CONCLUSION LVEF quantification with AutoEF software was accurate and reliable, but SV quantification showed limitations, indicating non-interchangeability with neither AS-mono nor AS-bi. Further refinement of AutoEF is needed for reliable SV quantification at the point of care.
Collapse
Affiliation(s)
- Frederique M de Raat
- Department of Anesthesiology, Catharina Hospital, Eindhoven, The Netherlands
- Department of Electrical Engineering, Technical University of Eindhoven, Eindhoven, The Netherlands
| | - Peter Bingley
- Department of Electrical Engineering, Technical University of Eindhoven, Eindhoven, The Netherlands
| | - Sjoerd Bouwmeester
- Department of Cardiology, Catharina Hospital, Eindhoven, The Netherlands
| | - Suzanne E A Felix
- Department of Cardiology, Catharina Hospital, Eindhoven, The Netherlands
| | - Leon J Montenij
- Department of Anesthesiology, Catharina Hospital, Eindhoven, The Netherlands
- Department of Electrical Engineering, Technical University of Eindhoven, Eindhoven, The Netherlands
| | - Arthur R Bouwman
- Department of Anesthesiology, Catharina Hospital, Eindhoven, The Netherlands
- Department of Electrical Engineering, Technical University of Eindhoven, Eindhoven, The Netherlands
| |
Collapse
|
5
|
Tromp J, Sarra C, Nidhal B, Mejdi BM, Zouari F, Hummel Y, Mzoughi K, Kraiem S, Fehri W, Gamra H, Lam CSP, Mebazaa A, Addad F. Nurse-led home-based detection of cardiac dysfunction by ultrasound: results of the CUMIN pilot study. EUROPEAN HEART JOURNAL. DIGITAL HEALTH 2024; 5:163-169. [PMID: 38505488 PMCID: PMC10944680 DOI: 10.1093/ehjdh/ztad079] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Revised: 10/12/2023] [Accepted: 11/07/2023] [Indexed: 03/21/2024]
Abstract
Aims Access to echocardiography is a significant barrier to heart failure (HF) care in many low- and middle-income countries. In this study, we hypothesized that an artificial intelligence (AI)-enhanced point-of-care ultrasound (POCUS) device could enable the detection of cardiac dysfunction by nurses in Tunisia. Methods and results This CUMIN study was a prospective feasibility pilot assessing the diagnostic accuracy of home-based AI-POCUS for HF conducted by novice nurses compared with conventional clinic-based transthoracic echocardiography (TTE). Seven nurses underwent a one-day training program in AI-POCUS. A total of 94 patients without a previous HF diagnosis received home-based AI-POCUS, POC N-terminal pro-B-type natriuretic peptide (NT-proBNP) testing, and clinic-based TTE. The primary outcome was the sensitivity of AI-POCUS in detecting a left ventricular ejection fraction (LVEF) <50% or left atrial volume index (LAVI) >34 mL/m2, using clinic-based TTE as the reference. Out of seven nurses, five achieved a minimum standard to participate in the study. Out of the 94 patients (60% women, median age 67), 16 (17%) had an LVEF < 50% or LAVI > 34 mL/m2. AI-POCUS provided an interpretable LVEF in 75 (80%) patients and LAVI in 64 (68%). The only significant predictor of an interpretable LVEF or LAVI proportion was the nurse operator. The sensitivity for the primary outcome was 92% [95% confidence interval (CI): 62-99] for AI-POCUS compared with 87% (95% CI: 60-98) for NT-proBNP > 125 pg/mL, with AI-POCUS having a significantly higher area under the curve (P = 0.040). Conclusion The study demonstrated the feasibility of novice nurse-led home-based detection of cardiac dysfunction using AI-POCUS in HF patients, which could alleviate the burden on under-resourced healthcare systems.
Collapse
Affiliation(s)
- Jasper Tromp
- Saw Swee Hock School of Public Health, National University of Singapore & The National University Health System, 12 Science Drive 2, #10-01, Singapore 117549, Singapore
- Duke-NUS Medical School, 8 College Rd, Singapore 169857, Singapore
| | - Chenik Sarra
- Military Hospital Tunis, Q5PH+896, Tunis, Tunisia
| | - Bouchahda Nidhal
- Fattouma Bourguiba University Hospital—Research Laboratory LR12SP16 and University of Monastir, QRCM+4GJ, Monastir, Tunisia
| | - Ben Messaoud Mejdi
- Fattouma Bourguiba University Hospital—Research Laboratory LR12SP16 and University of Monastir, QRCM+4GJ, Monastir, Tunisia
| | - Fourat Zouari
- Hannibal Clinic, Rue de la feuille d'Erable - les berges du lac 2, Tunis, Tunisia
| | - Yoran Hummel
- Us2.ai, 2 College Rd, #02-00, Singapore 169850, Singapore
| | - Khadija Mzoughi
- Faculty of Medicine of Tunis, Habib Thameur Hospital Tunis & University of Tunis El Manar, Q5PG+CJ7, Rue Ali Ben Ayed, Tunis, Tunisia
| | - Sondes Kraiem
- Faculty of Medicine of Tunis, Habib Thameur Hospital Tunis & University of Tunis El Manar, Q5PG+CJ7, Rue Ali Ben Ayed, Tunis, Tunisia
| | - Wafa Fehri
- Military Hospital Tunis, Q5PH+896, Tunis, Tunisia
| | - Habib Gamra
- Fattouma Bourguiba University Hospital—Research Laboratory LR12SP16 and University of Monastir, QRCM+4GJ, Monastir, Tunisia
| | - Carolyn S P Lam
- Duke-NUS Medical School, 8 College Rd, Singapore 169857, Singapore
- National Heart Centre Singapore, 5 Hospital Dr, Singapore 169609, Singapore
| | - Alexandre Mebazaa
- Université Paris Cité, MASCOT Inserm Unit, 45 Rue des Saints-Pères, 75006 Paris, France
- Department of Anesthesia, Burn and Critical Care Medicine, AP-HP, Hôpital Lariboisière, 2 Rue Ambroise Paré, 75010 Paris, France
| | - Faouzi Addad
- Hannibal Clinic, Rue de la feuille d'Erable - les berges du lac 2, Tunis, Tunisia
| |
Collapse
|
6
|
Takeuchi M. Can artificial intelligence-derived left ventricular ejection fraction supplant manual measurements of left ventricular ejection fraction in daily practice? Int J Cardiol 2024; 397:131420. [PMID: 37806359 DOI: 10.1016/j.ijcard.2023.131420] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/26/2023] [Accepted: 10/03/2023] [Indexed: 10/10/2023]
Affiliation(s)
- Masaaki Takeuchi
- Department of Laboratory and Transfusion Medicine, Hospital of University of Occupational and Environmental Health, School of Medicine, Iseigaoka, Yahatanishi, Kitakyushu 807-8555, Japan.
| |
Collapse
|
7
|
Vrudhula A, Kwan AC, Ouyang D, Cheng S. Machine Learning and Bias in Medical Imaging: Opportunities and Challenges. Circ Cardiovasc Imaging 2024; 17:e015495. [PMID: 38377237 PMCID: PMC10883605 DOI: 10.1161/circimaging.123.015495] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/22/2024]
Abstract
Bias in health care has been well documented and results in disparate and worsened outcomes for at-risk groups. Medical imaging plays a critical role in facilitating patient diagnoses but involves multiple sources of bias including factors related to access to imaging modalities, acquisition of images, and assessment (ie, interpretation) of imaging data. Machine learning (ML) applied to diagnostic imaging has demonstrated the potential to improve the quality of imaging-based diagnosis and the precision of measuring imaging-based traits. Algorithms can leverage subtle information not visible to the human eye to detect underdiagnosed conditions or derive new disease phenotypes by linking imaging features with clinical outcomes, all while mitigating cognitive bias in interpretation. Importantly, however, the application of ML to diagnostic imaging has the potential to either reduce or propagate bias. Understanding the potential gain as well as the potential risks requires an understanding of how and what ML models learn. Common risks of propagating bias can arise from unbalanced training, suboptimal architecture design or selection, and uneven application of models. Notwithstanding these risks, ML may yet be applied to improve gain from imaging across all 3A's (access, acquisition, and assessment) for all patients. In this review, we present a framework for understanding the balance of opportunities and challenges for minimizing bias in medical imaging, how ML may improve current approaches to imaging, and what specific design considerations should be made as part of efforts to maximize the quality of health care for all.
Collapse
Affiliation(s)
- Amey Vrudhula
- Icahn School of Medicine at Mount Sinai, New York
- Department of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center
| | - Alan C Kwan
- Department of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center
| | - David Ouyang
- Department of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center
- Division of Artificial Intelligence in Medicine, Department of Medicine, Cedars-Sinai Medical Center
| | - Susan Cheng
- Department of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center
| |
Collapse
|
8
|
Teira Calderón A, Levine M, Ruisánchez C, Serrano D, Catoya S, Llano M, Lerena P, Cuesta JM, Fernández-Valls M, González Vilchez F, de la Torre Hernández JM, García-García HM, Vazquez de Prada JA. Clinical comparison of a handheld cardiac ultrasound device for the assessment of left ventricular function. THE INTERNATIONAL JOURNAL OF CARDIOVASCULAR IMAGING 2024; 40:55-64. [PMID: 37882957 DOI: 10.1007/s10554-023-02979-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/26/2023] [Accepted: 09/29/2023] [Indexed: 10/27/2023]
Abstract
PURPOSE Recently developed handheld ultrasound devices (HHUD) represent a promising method to evaluate the cardiovascular abnormalities at the point of care. However, this technology has not been rigorously evaluated. The aim of this study was to explore the correlation and the agreement between the LVEF (Left Ventricular Ejection Fraction) visually assessed by a moderately experienced sonographer using an HHUD compared to the routine LVEF assessment performed at the Echocardiography Laboratory. METHODS This was a prospective single center study which enrolled 120 adult inpatients and outpatients referred for a comprehensive Echocardiography (EC). RESULTS The mean age of the patients was 69.9 ± 12.5 years. There were 47 females (39.2%). The R-squared was r 0.94 (p < 0.0001) and the ICC was 0.93 (IC 95% 0.91-0.95, p ≤ 0.0001). The Bland-Altman plot showed limits of agreement (LOA): Upper LOA 10.61 and Lower LOA - 8.95. The overall agreement on the LVEF assessment when it was stratified as "normal" or "reduced" was 89.1%, with a kappa of 0.77 (p < 0.0001). When the LVEF was classified as "normal", "mildly reduced", "moderately reduced", or "severely reduced," the kappa was 0.77 (p < 0.0001). The kappa between the HHUD EC and the comprehensive EC for the detection of RWMAs in the territories supplied by the LAD, LCX and RCA was 0.85, 0.73 and 0.85, respectively. CONCLUSION With current HHUD, an averagely experienced operator can accurately bedside visual estimate the LVEF. This may facilitate the incorporation of this technology in daily clinical practice improving the management of patients.
Collapse
Affiliation(s)
- Andrea Teira Calderón
- Hospital Universitari i Politécnic La Fe, Valencia (Valencia), España.
- Grupo de Investigación Cardiovascular, Instituto de Investigación Valdecilla (IDIVAL), Santander (Cantabria), España.
| | - Molly Levine
- Section of Interventional Cardiology, MedStar Washington Hospital Center, Washington, DC, United States
| | - Cristina Ruisánchez
- Grupo de Investigación Cardiovascular, Instituto de Investigación Valdecilla (IDIVAL), Santander (Cantabria), España
- Department of Cardiology, Hospital Universitario Marqués de Valdecilla, Av. de Valdecilla, 25, 39008, Santander, Cantabria, España
| | - David Serrano
- Department of Cardiology, Hospital Universitario Marqués de Valdecilla, Av. de Valdecilla, 25, 39008, Santander, Cantabria, España
| | - Santiago Catoya
- Department of Cardiology, Hospital Universitario Marqués de Valdecilla, Av. de Valdecilla, 25, 39008, Santander, Cantabria, España
| | - Miguel Llano
- Department of Cardiology, Hospital Universitario Marqués de Valdecilla, Av. de Valdecilla, 25, 39008, Santander, Cantabria, España
| | - Piedad Lerena
- Department of Cardiology, Hospital Universitario Marqués de Valdecilla, Av. de Valdecilla, 25, 39008, Santander, Cantabria, España
| | - José María Cuesta
- Department of Cardiology, Hospital Universitario Marqués de Valdecilla, Av. de Valdecilla, 25, 39008, Santander, Cantabria, España
| | - Mónica Fernández-Valls
- Grupo de Investigación Cardiovascular, Instituto de Investigación Valdecilla (IDIVAL), Santander (Cantabria), España
- Department of Cardiology, Hospital Universitario Marqués de Valdecilla, Av. de Valdecilla, 25, 39008, Santander, Cantabria, España
| | - Francisco González Vilchez
- Grupo de Investigación Cardiovascular, Instituto de Investigación Valdecilla (IDIVAL), Santander (Cantabria), España
- Department of Cardiology, Hospital Universitario Marqués de Valdecilla, Av. de Valdecilla, 25, 39008, Santander, Cantabria, España
| | - Jose María de la Torre Hernández
- Grupo de Investigación Cardiovascular, Instituto de Investigación Valdecilla (IDIVAL), Santander (Cantabria), España
- Department of Cardiology, Hospital Universitario Marqués de Valdecilla, Av. de Valdecilla, 25, 39008, Santander, Cantabria, España
| | - Héctor M García-García
- Section of Interventional Cardiology, MedStar Washington Hospital Center, Washington, DC, United States
| | - Jose Antonio Vazquez de Prada
- Grupo de Investigación Cardiovascular, Instituto de Investigación Valdecilla (IDIVAL), Santander (Cantabria), España
- Department of Cardiology, Hospital Universitario Marqués de Valdecilla, Av. de Valdecilla, 25, 39008, Santander, Cantabria, España
| |
Collapse
|
9
|
García-Moll X, Croci F, Solé A, Hartgers-Gubbels ES, Calleja-Hernández MA. A cost-effectiveness analysis of empagliflozin for heart failure patients across the full spectrum of ejection fraction in Spain: combined results of the EMPEROR-Preserved and EMPEROR-Reduced trials. Expert Rev Cardiovasc Ther 2024; 22:131-139. [PMID: 38416135 DOI: 10.1080/14779072.2024.2324027] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/14/2023] [Accepted: 02/23/2024] [Indexed: 02/29/2024]
Abstract
BACKGROUND Heart failure (HF) is a chronic condition with considerable clinical burden for patients and economic burden for healthcare systems. Treatment for HF is typically based on ejection fraction (EF) phenotype. The cost-effectiveness of empagliflozin + standard of care (SoC) compared to SoC has been examined for HF phenotypes below or above 40% EF separately, but not across the full spectrum of EF in Spain. METHODS The results of two preexisting, validated, and published phenotype-specific Markov cohort models were combined using a population-weighted approach, reflecting the incidence of each phenotype in the total HF population in Spain. A probabilistic sensitivity analysis was performed by sampling each model's probabilistic results. RESULTS Empagliflozin + SoC compared to SoC resulted in increased life-years (LYs) (6.48 vs. 6.35), quality-adjusted LYs (QALYs) (4.80 vs. 4.63), and healthcare costs (€19,090 vs. €18,246), over a lifetime time horizon for the combined HF population in Spain. The incremental cost-effectiveness ratio (ICER) was €5,089/QALY. All subgroup, scenario, and probabilistic ICERs were consistently below €10,000/QALY. CONCLUSIONS Empagliflozin is the first treatment with established efficacy and cost-effectiveness for HF patients across EF from the perspective of healthcare payers in Spain. Empagliflozin also proved to be cost-effective for all subgroups of patients included in the analysis.
Collapse
Affiliation(s)
- Xavier García-Moll
- Cardiology Department, Santa Creu I Sant Pau University Hospital, Barcelona, Spain
| | - Francesco Croci
- EMEA Real World Methods & Evidence Generation, IQVIA, London, UK
| | - Alexandra Solé
- Market Access, Boehringer Ingelheim España S.A., Barcelona, Spain
| | - Elisabeth S Hartgers-Gubbels
- Corporate Market Access CardioRenalMetabolism, Boehringer Ingelheim International GmbH, Ingelheim am Rhein, Germany
| | | |
Collapse
|
10
|
Magelssen MI, Hjorth-Hansen AK, Andersen GN, Graven T, Kleinau JO, Skjetne K, Lovstakken L, Dalen H, Mjølstad OC. The importance of patient characteristics, operators, and image quality for the accuracy of heart failure diagnosis by general practitioners using handheld ultrasound devices. EUROPEAN HEART JOURNAL. IMAGING METHODS AND PRACTICE 2024; 2:qyad047. [PMID: 39045176 PMCID: PMC11195733 DOI: 10.1093/ehjimp/qyad047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/30/2023] [Accepted: 12/20/2023] [Indexed: 07/25/2024]
Abstract
Aims To evaluate whether the characteristics of patients, operators, and image quality could explain the accuracy of heart failure (HF) diagnostics by general practitioners (GPs) using handheld ultrasound devices (HUDs) with automatic decision-support software and telemedical support. Methods and results Patients referred to an outpatient cardiac clinic due to symptoms indicating HF were examined by one of five GPs after dedicated training. In total, 166 patients were included [median (inter-quartile range) age 73 (63-78) years; mean ± standard deviation ejection fraction 53 ± 10%]. The GPs considered whether the patients had HF in four diagnostic steps: (i) clinical examination, (ii) adding focused cardiac HUD examination, (iii) adding automatic decision-support software measuring mitral annular plane systolic excursion (autoMAPSE) and ejection fraction (autoEF), and (iv) adding telemedical support. Overall, the characteristics of patients, operators, and image quality explained little of the diagnostic accuracy. Except for atrial fibrillation [lower accuracy for HUD alone and after adding autoEF (P < 0.05)], no patient characteristics influenced the accuracy. Some differences between operators were found after adding autoMAPSE (P < 0.05). Acquisition errors of the four-chamber view and a poor visualization of the mitral plane were associated with reduced accuracy after telemedical support (P < 0.05). Conclusion The characteristics of patients, operators, and image quality explained just minor parts of the modest accuracy of GPs' HF diagnostics using HUDs with and without decision-support software. Atrial fibrillation and not well-standardized recordings challenged the diagnostic accuracy. However, the accuracy was only modest in well-recorded images, indicating a need for refinement of the technology.
Collapse
Affiliation(s)
- Malgorzata Izabela Magelssen
- Department of Circulation and Medical Imaging, Norwegian University of Science and Technology, Prinsesse Kristinas gt 3, Akutten og Hjerte-lunge-senteret, 7491Trondheim, Norway
- Clinic of Cardiology, St. Olavs Hospital, Trondheim University Hospital, Prinsesse Kristinas gt 3, Akutten og Hjerte-lunge-senteret, 7491 Trondheim, Norway
| | - Anna Katarina Hjorth-Hansen
- Department of Circulation and Medical Imaging, Norwegian University of Science and Technology, Prinsesse Kristinas gt 3, Akutten og Hjerte-lunge-senteret, 7491Trondheim, Norway
- Department of Internal Medicine, Levanger Hospital, Nord-Trøndelag Hospital Trust, Kirkegate 2, 7600 Levanger, Norway
| | - Garrett Newton Andersen
- Department of Internal Medicine, Levanger Hospital, Nord-Trøndelag Hospital Trust, Kirkegate 2, 7600 Levanger, Norway
| | - Torbjørn Graven
- Department of Internal Medicine, Levanger Hospital, Nord-Trøndelag Hospital Trust, Kirkegate 2, 7600 Levanger, Norway
| | - Jens Olaf Kleinau
- Department of Internal Medicine, Levanger Hospital, Nord-Trøndelag Hospital Trust, Kirkegate 2, 7600 Levanger, Norway
| | - Kyrre Skjetne
- Department of Internal Medicine, Levanger Hospital, Nord-Trøndelag Hospital Trust, Kirkegate 2, 7600 Levanger, Norway
| | - Lasse Lovstakken
- Department of Circulation and Medical Imaging, Norwegian University of Science and Technology, Prinsesse Kristinas gt 3, Akutten og Hjerte-lunge-senteret, 7491Trondheim, Norway
| | - Havard Dalen
- Department of Circulation and Medical Imaging, Norwegian University of Science and Technology, Prinsesse Kristinas gt 3, Akutten og Hjerte-lunge-senteret, 7491Trondheim, Norway
- Clinic of Cardiology, St. Olavs Hospital, Trondheim University Hospital, Prinsesse Kristinas gt 3, Akutten og Hjerte-lunge-senteret, 7491 Trondheim, Norway
- Department of Internal Medicine, Levanger Hospital, Nord-Trøndelag Hospital Trust, Kirkegate 2, 7600 Levanger, Norway
| | - Ole Christian Mjølstad
- Department of Circulation and Medical Imaging, Norwegian University of Science and Technology, Prinsesse Kristinas gt 3, Akutten og Hjerte-lunge-senteret, 7491Trondheim, Norway
- Clinic of Cardiology, St. Olavs Hospital, Trondheim University Hospital, Prinsesse Kristinas gt 3, Akutten og Hjerte-lunge-senteret, 7491 Trondheim, Norway
| |
Collapse
|
11
|
Motazedian P, Marbach JA, Prosperi-Porta G, Parlow S, Di Santo P, Abdel-Razek O, Jung R, Bradford WB, Tsang M, Hyon M, Pacifici S, Mohanty S, Ramirez FD, Huggins GS, Simard T, Hon S, Hibbert B. Diagnostic accuracy of point-of-care ultrasound with artificial intelligence-assisted assessment of left ventricular ejection fraction. NPJ Digit Med 2023; 6:201. [PMID: 37898711 PMCID: PMC10613290 DOI: 10.1038/s41746-023-00945-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2023] [Accepted: 10/13/2023] [Indexed: 10/30/2023] Open
Abstract
Focused cardiac ultrasound (FoCUS) is becoming standard practice in a wide spectrum of clinical settings. There is limited data evaluating the real-world use of FoCUS with artificial intelligence (AI). Our objective was to determine the accuracy of FoCUS AI-assisted left ventricular ejection fraction (LVEF) assessment and compare its accuracy between novice and experienced users. In this prospective, multicentre study, participants requiring a transthoracic echocardiogram (TTE) were recruited to have a FoCUS done by a novice or experienced user. The AI-assisted device calculated LVEF at the bedside, which was subsequently compared to TTE. 449 participants were enrolled with 424 studies included in the final analysis. The overall intraclass coefficient was 0.904, and 0.921 in the novice (n = 208) and 0.845 in the experienced (n = 216) cohorts. There was a significant bias of 0.73% towards TTE (p = 0.005) with a level of agreement of 11.2%. Categorical grading of LVEF severity had excellent agreement to TTE (weighted kappa = 0.83). The area under the curve (AUC) was 0.98 for identifying an abnormal LVEF (<50%) with a sensitivity of 92.8%, specificity of 92.3%, negative predictive value (NPV) of 0.97 and a positive predictive value (PPV) of 0.83. In identifying severe dysfunction (<30%) the AUC was 0.99 with a sensitivity of 78.1%, specificity of 98.0%, NPV of 0.98 and PPV of 0.76. Here we report that FoCUS AI-assisted LVEF assessments provide highly reproducible LVEF estimations in comparison to formal TTE. This finding was consistent among senior and novice echocardiographers suggesting applicability in a variety of clinical settings.
Collapse
Affiliation(s)
- Pouya Motazedian
- CAPITAL Research Group, Division of Cardiology, University of Ottawa Heart Institute, Ottawa, Ontario, Canada
- Division of Cardiology, University of Ottawa Heart Institute, Ottawa, Ontario, Canada
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada
| | - Jeffrey A Marbach
- Division of Cardiology, Knight Cardiovascular Institute, Oregon Health and Sciences University, Portland, OR, USA
| | - Graeme Prosperi-Porta
- CAPITAL Research Group, Division of Cardiology, University of Ottawa Heart Institute, Ottawa, Ontario, Canada
- Division of Cardiology, University of Ottawa Heart Institute, Ottawa, Ontario, Canada
| | - Simon Parlow
- CAPITAL Research Group, Division of Cardiology, University of Ottawa Heart Institute, Ottawa, Ontario, Canada
- Division of Cardiology, University of Ottawa Heart Institute, Ottawa, Ontario, Canada
| | - Pietro Di Santo
- CAPITAL Research Group, Division of Cardiology, University of Ottawa Heart Institute, Ottawa, Ontario, Canada
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada
- Department of Medicine, University of Ottawa, Ottawa, Ontario, Canada
| | - Omar Abdel-Razek
- CAPITAL Research Group, Division of Cardiology, University of Ottawa Heart Institute, Ottawa, Ontario, Canada
- Division of Cardiology, University of Ottawa Heart Institute, Ottawa, Ontario, Canada
| | - Richard Jung
- CAPITAL Research Group, Division of Cardiology, University of Ottawa Heart Institute, Ottawa, Ontario, Canada
- Department of Medicine, University of Ottawa, Ottawa, Ontario, Canada
| | - William B Bradford
- Division of Cardiology, Tufts Medical Center and Tufts University School of Medicine, Boston, MA, USA
| | - Miranda Tsang
- Division of Cardiology, Tufts Medical Center and Tufts University School of Medicine, Boston, MA, USA
| | - Michael Hyon
- Division of Cardiology, Tufts Medical Center and Tufts University School of Medicine, Boston, MA, USA
| | - Stefano Pacifici
- Division of Cardiology, Tufts Medical Center and Tufts University School of Medicine, Boston, MA, USA
| | - Sharanya Mohanty
- Division of Cardiology, Tufts Medical Center and Tufts University School of Medicine, Boston, MA, USA
| | - F Daniel Ramirez
- Division of Cardiology, University of Ottawa Heart Institute, Ottawa, Ontario, Canada
| | - Gordon S Huggins
- Division of Cardiology, Tufts Medical Center and Tufts University School of Medicine, Boston, MA, USA
| | - Trevor Simard
- Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN, USA
| | - Stephanie Hon
- Division of Pulmonary and Critical Care Medicine, Tufts Medical Center and Tufts University School of Medicine, Boston, MA, USA
| | - Benjamin Hibbert
- Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN, USA.
| |
Collapse
|
12
|
Kolovos S, Bellanca L, Groyer H, Rosano G, Gaultney J, Linden S. Cost-effectiveness of empagliflozin in heart failure patients irrespective of ejection fraction in England. J Cardiovasc Med (Hagerstown) 2023; 24:758-764. [PMID: 37577867 PMCID: PMC10481921 DOI: 10.2459/jcm.0000000000001532] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Revised: 05/12/2023] [Accepted: 06/24/2023] [Indexed: 08/15/2023]
Abstract
AIMS Heart failure (HF) is a complex syndrome commonly categorized into two main phenotypes [left ventricular ejection fraction (LVEF) below or above 40%], and although empagliflozin is the first approved medication with proven clinical effectiveness for both phenotypes, its cost-effectiveness of treating the entire HF population remains unknown. METHODS The analysis was performed utilizing two preexisting, LVEF phenotype-specific cost-effectiveness models to estimate the cost-effectiveness of empagliflozin in adults for the treatment of symptomatic chronic HF, irrespective of ejection fraction (EF). The results of the phenotype-specific models were combined using a population-weighted approach to estimate the deterministic and probabilistic incremental cost-effectiveness ratios (ICERs). RESULTS Based on combined results, empagliflozin + standard of care (SoC) is associated with 6.13 life-years (LYs) and 3.92 quality-adjusted life-years (QALYs) compared with 5.98 LYs and 3.76 QALYs for SoC alone over a lifetime, resulting in an incremental difference of 0.15 LYs and 0.16 QALYs, respectively. Total lifetime healthcare costs per patient are £15 246 for empagliflozin + SoC and £13 982 for SoC giving an incremental difference of £1264. The ICER is £7757/QALY, which is substantially lower than the willingness-to-pay (WTP) of £30 000 per QALY used by NICE. The results of the probabilistic sensitivity analyses are in line with the deterministic results. CONCLUSION Empagliflozin is the first efficacious, approved, and cost-effective treatment option for all HF patients, irrespective of EF. The combined ICER was consistently below the WTP threshold. Therefore, empagliflozin offers value for money for the treatment of the full HF population in England.
Collapse
Affiliation(s)
| | | | | | | | | | - Stephan Linden
- Boehringer Ingelheim International GmbH, Ingelheim am Rhein, Germany
| |
Collapse
|
13
|
Karlas T, Blank V, Trenker C, Ignee A, Dietrich CF. [Ultrasound systems for abdominal diagnostics - current methods, clinical applications and new technologies]. ZEITSCHRIFT FUR GASTROENTEROLOGIE 2023; 61:1235-1245. [PMID: 36634681 DOI: 10.1055/a-1993-5356] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/14/2023]
Abstract
Abdominal ultrasound is the method of first choice in many clinical situations. Gray scale imaging (B-mode) and conventional Doppler techniques are nowadays complemented by contrast-enhanced ultrasound (CEUS), elastography, fat quantification and further technologies which allow multimodal characterization of organs and tissue structure using panoramic imaging, 3D-techniques and image fusion. The development of small portable devices augments the spectrum for sonographic diagnostics. In this review, we describe the current status of ultrasound technology based on published evidence. In addition, we provide guidance for quality assurance.
Collapse
Affiliation(s)
- Thomas Karlas
- Medizinischen Klinik 2, Bereich Gastroenterologie, Universitätsklinikum Leipzig, Leipzig, Germany
| | - Valentin Blank
- Medizinischen Klinik 2, Bereich Gastroenterologie, Universitätsklinikum Leipzig, Leipzig, Germany
- Klinik für Innere Medizin I (Gastroenterologie, Pneumologie) und Interdisziplinäre Ultraschallabteilung, Universitätsklinikum Halle (Saale), Halle, Germany
| | - Corinna Trenker
- Klinik für Hämatologie, Onkologie und Immunologie, Universitätsklinikum Marburg, Marburg, Germany
| | - André Ignee
- Medizinische Klinik mit Schwerpunkt Gastroenterologie & Rheumatologie, Klinikum Würzburg Mitte gGmbH Standort Juliusspital, Wurzburg, Germany
| | - Christoph F Dietrich
- Allgemeine Innere Medizin (DAIM), Kliniken Hirslanden Beau Site, Salem und Permanence, Bern, Switzerland
| |
Collapse
|
14
|
Magelssen MI, Hjorth-Hansen AK, Andersen GN, Graven T, Kleinau JO, Skjetne K, Løvstakken L, Dalen H, Mjølstad OC. Clinical Influence of Handheld Ultrasound, Supported by Automatic Quantification and Telemedicine, in Suspected Heart Failure. ULTRASOUND IN MEDICINE & BIOLOGY 2023; 49:1137-1144. [PMID: 36804210 DOI: 10.1016/j.ultrasmedbio.2022.12.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/19/2022] [Revised: 11/18/2022] [Accepted: 12/22/2022] [Indexed: 05/11/2023]
Abstract
Early and correct heart failure (HF) diagnosis is essential to improvement of patient care. We aimed to evaluate the clinical influence of handheld ultrasound device (HUD) examinations by general practitioners (GPs) in patients with suspected HF with or without the use of automatic measurement of left ventricular (LV) ejection fraction (autoEF), mitral annular plane systolic excursion (autoMAPSE) and telemedical support. Five GPs with limited ultrasound experience examined 166 patients with suspected HF (median interquartile range = 70 (63-78) y; mean ± SD EF = 53 ± 10%). They first performed a clinical examination. Second, they added an examination with HUD, automatic quantification tools and, finally, telemedical support by an external cardiologist. At all stages, the GPs considered whether the patients had HF. The final diagnosis was made by one of five cardiologists using medical history and clinical evaluation including a standard echocardiography. Compared with the cardiologists' decision, the GPs correctly classified 54% by clinical evaluation. The proportion increased to 71% after adding HUDs, and to 74 % after telemedical evaluation. Net reclassification improvement was highest for HUD with telemedicine. There was no significant benefit of the automatic tools (p ≥ 0.58). Addition of HUD and telemedicine improved the GPs' diagnostic precision in suspected HF. Automatic LV quantification added no benefit. Refined algorithms and more training may be needed before inexperienced users benefit from automatic quantification of cardiac function by HUDs.
Collapse
Affiliation(s)
- Malgorzata Izabela Magelssen
- Department of Circulation and Medical Imaging, Norwegian University of Science and Technology, Trondheim, Norway; Clinic of Cardiology, St. Olavs University Hospital, Trondheim, Norway.
| | - Anna Katarina Hjorth-Hansen
- Department of Circulation and Medical Imaging, Norwegian University of Science and Technology, Trondheim, Norway; Department of Internal Medicine, Levanger Hospital, Nord-Trøndelag Hospital Trust, Levanger, Norway
| | - Garrett Newton Andersen
- Department of Internal Medicine, Levanger Hospital, Nord-Trøndelag Hospital Trust, Levanger, Norway
| | - Torbjørn Graven
- Department of Internal Medicine, Levanger Hospital, Nord-Trøndelag Hospital Trust, Levanger, Norway
| | - Jens Olaf Kleinau
- Department of Internal Medicine, Levanger Hospital, Nord-Trøndelag Hospital Trust, Levanger, Norway
| | - Kyrre Skjetne
- Department of Internal Medicine, Levanger Hospital, Nord-Trøndelag Hospital Trust, Levanger, Norway
| | - Lasse Løvstakken
- Department of Circulation and Medical Imaging, Norwegian University of Science and Technology, Trondheim, Norway
| | - Håvard Dalen
- Department of Circulation and Medical Imaging, Norwegian University of Science and Technology, Trondheim, Norway; Clinic of Cardiology, St. Olavs University Hospital, Trondheim, Norway; Department of Internal Medicine, Levanger Hospital, Nord-Trøndelag Hospital Trust, Levanger, Norway
| | - Ole Christian Mjølstad
- Department of Circulation and Medical Imaging, Norwegian University of Science and Technology, Trondheim, Norway; Clinic of Cardiology, St. Olavs University Hospital, Trondheim, Norway
| |
Collapse
|
15
|
Gonzalez FA, Varudo R, Leote J, Martins C, Bacariza J, Fernandes A, Michard F. The automation of sub-aortic velocity time integral measurements by transthoracic echocardiography: clinical evaluation of an artificial intelligence-enabled tool in critically ill patients. Br J Anaesth 2022; 129:e116-e119. [PMID: 36031414 DOI: 10.1016/j.bja.2022.07.037] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2022] [Revised: 07/13/2022] [Accepted: 07/18/2022] [Indexed: 11/30/2022] Open
Affiliation(s)
- Filipe A Gonzalez
- Intensive Care Department, Hospital Garcia de Orta, Almada, Portugal; Faculdade de Medicina da Universidade de Lisboa, Lisbon, Portugal
| | - Rita Varudo
- Intensive Care Department, Hospital Garcia de Orta, Almada, Portugal
| | - João Leote
- Intensive Care Department, Hospital Garcia de Orta, Almada, Portugal
| | - Cristina Martins
- Intensive Care Department, Hospital Garcia de Orta, Almada, Portugal
| | - Jacobo Bacariza
- Intensive Care Department, Hospital Garcia de Orta, Almada, Portugal
| | - Antero Fernandes
- Intensive Care Department, Hospital Garcia de Orta, Almada, Portugal; Faculdade de Medicina da Universidade de Lisboa, Lisbon, Portugal; Faculdade de Ciencias da Saude da Universidade da Beira Interior, Covilha, Portugal
| | | |
Collapse
|
16
|
Blaivas M, Blaivas LN, Campbell K, Thomas J, Shah S, Yadav K, Liu YT. Making Artificial Intelligence Lemonade Out of Data Lemons: Adaptation of a Public Apical Echo Database for Creation of a Subxiphoid Visual Estimation Automatic Ejection Fraction Machine Learning Algorithm. JOURNAL OF ULTRASOUND IN MEDICINE : OFFICIAL JOURNAL OF THE AMERICAN INSTITUTE OF ULTRASOUND IN MEDICINE 2022; 41:2059-2069. [PMID: 34820867 DOI: 10.1002/jum.15889] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/15/2021] [Revised: 11/02/2021] [Accepted: 11/09/2021] [Indexed: 06/13/2023]
Abstract
OBJECTIVES A paucity of point-of-care ultrasound (POCUS) databases limits machine learning (ML). Assess feasibility of training ML algorithms to visually estimate left ventricular ejection fraction (EF) from a subxiphoid (SX) window using only apical 4-chamber (A4C) images. METHODS Researchers used a long-short-term-memory algorithm for image analysis. Using the Stanford EchoNet-Dynamic database of 10,036 A4C videos with calculated exact EF, researchers tested 3 ML training permeations. First, training on unaltered Stanford A4C videos, then unaltered and 90° clockwise (CW) rotated videos and finally unaltered, 90° rotated and horizontally flipped videos. As a real-world test, we obtained 615 SX videos from Harbor-UCLA (HUCLA) with EF calculations in 5% ranges. Researchers performed 1000 randomizations of EF point estimation within HUCLA EF ranges to compensate for ML and HUCLA EF mismatch, obtaining a mean value for absolute error (MAE) comparison and performed Bland-Altman analyses. RESULTS The ML algorithm EF mean MAE was estimated at 23.0, with a range of 22.8-23.3 using unaltered A4C video, mean MAE was 16.7, with a range of 16.5-16.9 using unaltered and 90° CW rotated video, mean MAE was 16.6, with a range of 16.3-16.8 using unaltered, 90° CW rotated and horizontally flipped video training. Bland-Altman showed weakest agreement at 40-45% EF. CONCLUSIONS Researchers successfully adapted unrelated ultrasound window data to train a POCUS ML algorithm with fair MAE using data manipulation to simulate a different ultrasound examination. This may be important for future POCUS algorithm design to help overcome a paucity of POCUS databases.
Collapse
Affiliation(s)
- Michael Blaivas
- Department of Medicine, University of South Carolina School of Medicine, Columbia, SC, USA
- Department of Emergency Medicine, St. Francis Hospital, Columbus, GA, USA
| | | | - Kendra Campbell
- Department of Emergency Medicine, Harbor-UCLA Medical Center, Torrance, CA, USA
| | - Joseph Thomas
- Department of Cardiology, Harbor-UCLA Medical Center, Torrance, CA, USA
- David Geffen School of Medicine at UCLA, Los Angeles, CA, USA
| | - Sonia Shah
- Department of Cardiology, Harbor-UCLA Medical Center, Torrance, CA, USA
- David Geffen School of Medicine at UCLA, Los Angeles, CA, USA
| | - Kabir Yadav
- Department of Emergency Medicine, Harbor-UCLA Medical Center, Torrance, CA, USA
- David Geffen School of Medicine at UCLA, Los Angeles, CA, USA
| | - Yiju Teresa Liu
- Department of Emergency Medicine, Harbor-UCLA Medical Center, Torrance, CA, USA
- David Geffen School of Medicine at UCLA, Los Angeles, CA, USA
| |
Collapse
|
17
|
Blaivas M, Blaivas L. Machine learning algorithm using publicly available echo database for simplified “visual estimation” of left ventricular ejection fraction. World J Exp Med 2022; 12:16-25. [PMID: 35433318 PMCID: PMC8968469 DOI: 10.5493/wjem.v12.i2.16] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/11/2021] [Revised: 12/14/2021] [Accepted: 03/07/2022] [Indexed: 02/06/2023] Open
Abstract
BACKGROUND Left ventricular ejection fraction calculation automation typically requires complex algorithms and is dependent of optimal visualization and tracing of endocardial borders. This significantly limits usability in bedside clinical applications, where ultrasound automation is needed most.
AIM To create a simple deep learning (DL) regression-type algorithm to visually estimate left ventricular (LV) ejection fraction (EF) from a public database of actual patient echo examinations and compare results to echocardiography laboratory EF calculations.
METHODS A simple DL architecture previously proven to perform well on ultrasound image analysis, VGG16, was utilized as a base architecture running within a long short term memory algorithm for sequential image (video) analysis. After obtaining permission to use the Stanford EchoNet-Dynamic database, researchers randomly removed approximately 15% of the approximately 10036 echo apical 4-chamber videos for later performance testing. All database echo examinations were read as part of comprehensive echocardiography study performance and were coupled with EF, end systolic and diastolic volumes, key frames and coordinates for LV endocardial tracing in csv file. To better reflect point-of-care ultrasound (POCUS) clinical settings and time pressure, the algorithm was trained on echo video correlated with calculated ejection fraction without incorporating additional volume, measurement and coordinate data. Seventy percent of the original data was used for algorithm training and 15% for validation during training. The previously randomly separated 15% (1263 echo videos) was used for algorithm performance testing after training completion. Given the inherent variability of echo EF measurement and field standards for evaluating algorithm accuracy, mean absolute error (MAE) and root mean square error (RMSE) calculations were made on algorithm EF results compared to Echo Lab calculated EF. Bland-Atlman calculation was also performed. MAE for skilled echocardiographers has been established to range from 4% to 5%.
RESULTS The DL algorithm visually estimated EF had a MAE of 8.08% (95%CI 7.60 to 8.55) suggesting good performance compared to highly skill humans. The RMSE was 11.98 and correlation of 0.348.
CONCLUSION This experimental simplified DL algorithm showed promise and proved reasonably accurate at visually estimating LV EF from short real time echo video clips. Less burdensome than complex DL approaches used for EF calculation, such an approach may be more optimal for POCUS settings once improved upon by future research and development.
Collapse
Affiliation(s)
- Michael Blaivas
- Department of Medicine, University of South Carolina School of Medicine, Roswell, GA 30076, United States
| | - Laura Blaivas
- Department of Environmental Science, Michigan State University, Roswell, Georgia 30076, United States
| |
Collapse
|
18
|
Samtani R, Bienstock S, Lai AC, Liao S, Baber U, Croft L, Stern E, Beerkens F, Ting P, Goldman ME. Assessment and validation of a novel fast fully automated artificial intelligence left ventricular ejection fraction quantification software. Echocardiography 2022; 39:473-482. [PMID: 35178746 DOI: 10.1111/echo.15318] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2021] [Revised: 01/11/2022] [Accepted: 01/27/2022] [Indexed: 11/28/2022] Open
Abstract
BACKGROUND Quantification of left ventricular ejection fraction (LVEF) by transthoracic echocardiography (TTE) is operator-dependent, time-consuming, and error-prone. LVivoEF by DIA is a new artificial intelligence (AI) software, which displays the tracking of endocardial borders and rapidly quantifies LVEF. We sought to assess the accuracy of LVivoEF compared to cardiac magnetic resonance imaging (cMRI) as the reference standard and to compare LVivoEF to the standard-of-care physician-measured LVEF (MD-EF) including studies with ultrasound enhancing agents (UEAs). METHODS In 273 consecutive patients, we compared MD-EF and AI-derived LVEF to cMRI. AI-derived LVEF was obtained from a non-UEA four-chamber view without manual correction. Thirty-one patients were excluded: 25 had interval interventions or incomplete TTE or cMRI studies and six had uninterpretable non-UEA apical views. RESULTS In the 242 subjects, the correlation between AI and cMRI was r = .890, similar to MD-EF and cMRI with r = .891 (p = 0.48). Of the 126 studies performed with UEAs, the correlation of AI using the unenhanced four-chamber view was r = .89, similar to MD-EF with r = .90. In the 116 unenhanced studies, AI correlation was r = .87, similar to MD-EF with r = .84. From Bland-Altman analysis, LVivoEF underreported the LVEF with a bias of 3.63 ± 7.40% EF points compared to cMRI while MD-EF to cMRI had a bias of .33 ± 7.52% (p = 0.80). CONCLUSIONS Compared to cMRI, LVivoEF can accurately quantify LVEF from a standard apical four-chamber view without manual correction. Thus, LVivoEF has the ability to improve and expedite LVEF quantification.
Collapse
Affiliation(s)
- Rajeev Samtani
- The Zena and Michael A. Wiener Cardiovascular Institute, Icahn School of Medicine at Mount Sinai, New York City, New York, USA
| | - Solomon Bienstock
- The Zena and Michael A. Wiener Cardiovascular Institute, Icahn School of Medicine at Mount Sinai, New York City, New York, USA
| | - Ashton C Lai
- The Zena and Michael A. Wiener Cardiovascular Institute, Icahn School of Medicine at Mount Sinai, New York City, New York, USA
| | - Steve Liao
- The Zena and Michael A. Wiener Cardiovascular Institute, Icahn School of Medicine at Mount Sinai, New York City, New York, USA
| | - Usman Baber
- The Zena and Michael A. Wiener Cardiovascular Institute, Icahn School of Medicine at Mount Sinai, New York City, New York, USA
| | - Lori Croft
- The Zena and Michael A. Wiener Cardiovascular Institute, Icahn School of Medicine at Mount Sinai, New York City, New York, USA
| | - Eric Stern
- The Zena and Michael A. Wiener Cardiovascular Institute, Icahn School of Medicine at Mount Sinai, New York City, New York, USA
| | - Frans Beerkens
- The Zena and Michael A. Wiener Cardiovascular Institute, Icahn School of Medicine at Mount Sinai, New York City, New York, USA
| | - Peter Ting
- The Zena and Michael A. Wiener Cardiovascular Institute, Icahn School of Medicine at Mount Sinai, New York City, New York, USA
| | - Martin E Goldman
- The Zena and Michael A. Wiener Cardiovascular Institute, Icahn School of Medicine at Mount Sinai, New York City, New York, USA
| |
Collapse
|
19
|
Focused Cardiac Ultrasound for the Evaluation of Heart Valve Disease in Resource-Limited Settings. CURRENT TREATMENT OPTIONS IN CARDIOVASCULAR MEDICINE 2021. [DOI: 10.1007/s11936-021-00945-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
20
|
Occelli C, Carrio G, Driessens M, Turquay C, Azulay N, Grau-Mercier L, Levraut J, Claret PG, Contenti J, Bobbia X. Focal cardiac ultrasound learning with pocked ultrasound device: A bicentric prospective blinded randomized study. JOURNAL OF CLINICAL ULTRASOUND : JCU 2021; 49:784-790. [PMID: 34322891 DOI: 10.1002/jcu.23047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/01/2021] [Revised: 06/30/2021] [Accepted: 07/10/2021] [Indexed: 06/13/2023]
Abstract
PURPOSE Point-of-care ultrasound using a pocket-ultrasound-device (PUD) is increasing in clinical medicine but the optimal way to teach focused cardiac ultrasound is not clear. We evaluated whether teaching using a PUD or a conventional-ultrasound-device (CUD) is different when the final exam was conducted on a PUD. The primary aim was to compare the weighted total quality scale (WTQS, out of 100) obtained by participants in the two groups (CUD and PUD) on a live volunteer 2-4 weeks after their initial training. The secondary aims were to compare examination time and students' confidence levels (out of 50). METHODS This bicentric, prospective single-blind randomized trial included undergraduate medical students. After watching a 15 min video about echocardiography views, students had a 45 min hands-on training session with a live volunteer using a PUD or a CUD. The final examination was conducted with a PUD on a live volunteer. RESULTS Eighty-six comparable students were included, with 4 ± 1 years of medical training. In the PUD group, the mean WTQS was 65 ± 16 versus 60 ± 15 in the CUD group [p = 0.22; in multivariate analysis, OR 0.8 95% CI (0.1;1.6), p = 0.34]. The examination time was 10.0 [6.2-12.4] min in the PUD group versus 11.4 [7.3-13.2] in the CUD group (p = 0.39), while the confidence level was 27.9 ± 7.7 in the PUD group versus 27.4 ± 7.2 in the CUD group (p = 0.76). CONCLUSION There was no difference between teaching echocardiographic views using a PUD as compared to a CUD on the PUD image quality, exam time, or confidence level of students.
Collapse
Affiliation(s)
- Céline Occelli
- Department of Emergency Medicine (Pôle Urgences SAMU SMUR), Hopital Pasteur 2, School of Medicine, University of Nice côte d'azur, Nice, France
| | - Gauthier Carrio
- Montpellier University, EA 2992 IMAGINE, Department of Anesthesiology, Emergency and Critical Care Medicine, Intensive Care Unit, Nîmes University Hospital, Nîmes, France
| | - Morgan Driessens
- Department of Emergency Medicine (Pôle Urgences SAMU SMUR), Hopital Pasteur 2, School of Medicine, University of Nice côte d'azur, Nice, France
| | - Charlotte Turquay
- Montpellier University, EA 2992 IMAGINE, Department of Anesthesiology, Emergency and Critical Care Medicine, Intensive Care Unit, Nîmes University Hospital, Nîmes, France
| | - Nicolas Azulay
- Ultrasound Department, CHU Nice, Université Côte d'Azur, Nice, France
| | - Laura Grau-Mercier
- Montpellier University, EA 2992 IMAGINE, Department of Anesthesiology, Emergency and Critical Care Medicine, Intensive Care Unit, Nîmes University Hospital, Nîmes, France
| | - Jacques Levraut
- Department of Emergency Medicine (Pôle Urgences SAMU SMUR), Hopital Pasteur 2, School of Medicine, University of Nice côte d'azur, Nice, France
| | - Pierre-Géraud Claret
- Montpellier University, EA 2992 IMAGINE, Department of Anesthesiology, Emergency and Critical Care Medicine, Intensive Care Unit, Nîmes University Hospital, Nîmes, France
| | - Julie Contenti
- Department of Emergency Medicine (Pôle Urgences SAMU SMUR), Hopital Pasteur 2, School of Medicine, University of Nice côte d'azur, Nice, France
| | - Xavier Bobbia
- Montpellier University, EA 2992 IMAGINE, Department of Anesthesiology, Emergency and Critical Care Medicine, Intensive Care Unit, Nîmes University Hospital, Nîmes, France
- Medical Faculty of Nîmes, SIMHU - University Hospital Unit of Simulation of Nîmes, Nîmes, France
| |
Collapse
|
21
|
Jenkins S, Alabed S, Swift A, Marques G, Ryding A, Sawh C, Wardley J, Shah BN, Swoboda P, Senior R, Nijveldt R, Vassiliou VS, Garg P. Diagnostic accuracy of handheld cardiac ultrasound device for assessment of left ventricular structure and function: systematic review and meta-analysis. Heart 2021; 107:1826-1834. [PMID: 34362772 PMCID: PMC8562308 DOI: 10.1136/heartjnl-2021-319561] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/20/2021] [Accepted: 07/12/2021] [Indexed: 12/02/2022] Open
Abstract
Objective Handheld ultrasound devices (HUD) has diagnostic value in the assessment of patients with suspected left ventricular (LV) dysfunction. This meta-analysis evaluates the diagnostic ability of HUD compared with transthoracic echocardiography (TTE) and assesses the importance of operator experience. Methods MEDLINE and EMBASE databases were searched in October 2020. Diagnostic studies using HUD and TTE imaging to determine LV dysfunction were included. Pooled sensitivities and specificities, and summary receiver operating characteristic curves were used to determine the diagnostic ability of HUD and evaluate the impact of operator experience on test accuracy. Results Thirty-three studies with 6062 participants were included in the meta-analysis. Experienced operators could predict reduced LV ejection fraction (LVEF), wall motion abnormality (WMA), LV dilatation and LV hypertrophy with pooled sensitivities of 88%, 85%, 89% and 85%, respectively, and pooled specificities of 96%, 95%, 98% and 91%, respectively. Non-experienced operators are able to detect cardiac abnormalities with reasonable sensitivity and specificity. There was a significant difference in the diagnostic accuracy between experienced and inexperienced users in LV dilatation, LVEF (moderate/severe) and WMA. The diagnostic OR for LVEF (moderate/severe), LV dilatation and WMA in an experienced hand was 276 (95% CI 58 to 1320), 225 (95% CI 87 to 578) and 90 (95% CI 31 to 265), respectively, compared with 41 (95% CI 18 to 94), 45 (95% CI 16 to 123) and 28 (95% CI 20 to 41), respectively, for inexperienced users. Conclusion This meta-analysis is the first to establish HUD as a powerful modality for predicting LV size and function. Experienced operators are able to accurately diagnose cardiac disease using HUD. A cautious, supervised approach should be implemented when imaging is performed by inexperienced users. This study provides a strong rationale for considering HUD as an auxiliary tool to physical examination in secondary care, to aid clinical decision making when considering referral for TTE. Trial registration number CRD42020182429.
Collapse
Affiliation(s)
- Sam Jenkins
- Department of Infection, Immunity and Cardiovascular Disease, The University of Sheffield, Sheffield, UK
| | - Samer Alabed
- Department of Infection, Immunity and Cardiovascular Disease, The University of Sheffield, Sheffield, UK
| | - Andrew Swift
- Cardiovascular and Metabolic Health, Academic Unit of Radiology, University of Sheffield, Sheffield, UK
| | - Gabriel Marques
- Cardiology, Norfolk and Norwich University Hospital NHS Trust, Norwich, UK
| | - Alisdair Ryding
- Cardiology, Norfolk and Norwich University Hospital NHS Trust, Norwich, UK
| | - Chris Sawh
- Cardiology, Norfolk and Norwich University Hospital NHS Trust, Norwich, UK
| | - James Wardley
- Cardiology, Norfolk and Norwich University Hospital NHS Trust, Norwich, UK
| | - Benoy Nalin Shah
- Cardiology, Wessex Cardiothoracic Centre, University Hospital Southampton, Southampton, UK
| | | | - Roxy Senior
- Department of Cardiology, Royal Brompton Hospital, London, UK
| | - Robin Nijveldt
- Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | | | - Pankaj Garg
- Cardiology, Norfolk and Norwich University Hospital NHS Trust, Norwich, UK
| |
Collapse
|
22
|
Cardiovascular examination using hand-held cardiac ultrasound. J Echocardiogr 2021; 20:1-9. [PMID: 34341942 PMCID: PMC8328483 DOI: 10.1007/s12574-021-00540-x] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2021] [Revised: 06/10/2021] [Accepted: 07/20/2021] [Indexed: 11/13/2022]
Abstract
Echocardiography is the first-line imaging modality for assessing cardiac function and morphology. The miniaturisation of ultrasound technology has led to the development of hand-held cardiac ultrasound (HCU) devices. The increasing sophistication of available HCU devices enables clinicians to more comprehensively examine patients at the bedside. HCU can augment clinical exam findings by offering a rapid screening assessment of cardiac dysfunction in both the Emergency Department and in cardiology clinics. Possible implications of implementing HCU into clinical practice are discussed in this review paper.
Collapse
|