1
|
Mehta S, Fernandez F, Villagran C, Cardenas G, Vieira D, Frauenfelder A, Quintero S, Vijayan Y, Merchant S, Tamayo C. Engaged with the heart – the EKG ring STEMI detector. Eur Heart J 2020. [DOI: 10.1093/ehjci/ehaa946.3480] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Abstract
Background
Our previous experience in telemedicine-centered STEMI management networks has shown delayed presentations as one of the most relevant factors in the reduction of Symptom-to-Baloon times. In order to further improve outcomes, we delved into the applications of mathematical vector algebra and engineering to incorporate an innovative Artificial Intelligence-guided Single Lead EKG methodology into a wearable ring to provide a self-administered alternative to reliable and expedite STEMI screening.
Purpose
To provide preliminary results of the application of ultra-wearable technology in a ring for accurate STEMI detection.
Methods
Our present work was done in two steps – 1) Applying mathematical vector algebra to construct an accurate and practical AI-guided Single Lead EKG algorithm for STEMI detection compatible with wearable devices, and 2) To engineer this algorithm into a wearable ring for quick and reliable STEMI detection. Throughout our first step, we provided a group of new lead waveforms (Vn') by positioning a single lead-capable wearable device into the chest positions Cn (C1, C2,..., C6) while touching the second electrode with a right-hand finger in the same device, all of which corresponded to the difference in electric potential between Right Arm (RA) and the correspondent conventional precordial Vn chest position. By using vector algebra, we recognized Vn' as the sum of (-aVR + Vn). Vector mathematical analysis was performed for 5,783 STEMI (50%) and 5,784 Not-STEMI (50%) EKG from a proprietary dataset, obtaining their corresponding new Vn' precordial leads. Finally, the AI-guided STEMI detector model was trained with 10,410 EKG records (90%) and tested with 1,157 EKG records (10%). Performance metrics were calculated to determine best new Lead for STEMI detection. In the second step, we engineered this methodology into a wearable ring device. When a patient presents chest discomfort or oppression, the most common reaction is to move the hands towards the chest. By mimicking this behavior and having our EKG-capable ring technology on the right hand, we replicate our methodology by positioning said ring to chest positions Cn to register an EKG trace of new Vn' precordial leads and calculated performance metrics to evaluate the correlation with previous experiment.
Results
Test results shows Lead V2' as the best overall lead in detecting STEMI with 91.2% Accuracy, 89.6% Sensibility, and 92.9% Specificity. These results were reproduced with both methodologies.
Conclusions
Preliminary outcomes of the implementation of our innovative Single Lead EKG methodology into an ultra-portable ring yielded promising results. Prospective studies will be needed to further validate this neoteric methodology for STEMI detection, nevertheless, we envision the potential future applications of this technology in the clinical setting, particularly with swift screening and activation of remote STEMI management networks.
Funding Acknowledgement
Type of funding source: None
Collapse
Affiliation(s)
- S Mehta
- Lumen Foundation, Miami, United States of America
| | | | | | | | - D Vieira
- Lumen Foundation, Miami, United States of America
| | | | - S Quintero
- Lumen Foundation, Miami, United States of America
| | - Y Vijayan
- Lumen Foundation, Miami, United States of America
| | - S Merchant
- Lumen Foundation, Miami, United States of America
| | - C.J Tamayo
- Lumen Foundation, Miami, United States of America
| |
Collapse
|
2
|
Mehta S, Gibson M, Avila J, Villagran C, Fernandez F, Niklitschek S, Vera F, Rocuant R, Cardenas G, Frauenfelder A, Vieira D, Merchant S, Vijayan Y, Tamayo C, Pinos D. Reconfiguring traditional EKG interpretation with artificial intelligence – a reliable, time-saving alternative? Eur Heart J 2020. [DOI: 10.1093/ehjci/ehaa946.3498] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Abstract
Background
Time and accuracy are key factors that may make or break an efficient triage and management in most medical premises, particularly so when expedited diagnosis saves lives - a not so uncommon scenario in the field of cardiology. By studying the different variables involved in cardiologist-EKG interactions that lead to the identification and management of different cardiovascular entities, we delved into the applications of Artificial Intelligence (AI) algorithms in order to improve upon the classic, but dated, EKG methodology. With this study, we pit our algorithm against cardiologists to perform a thorough analysis of the time invested to diagnose an EKG as Normal, as well as an assessment of the accuracy of said label.
Purpose
To present a faster and reliable AI-guided EKG interpretation methodology that outperforms cardiologists' capabilities in identifying Normal EKG records.
Methods
The International Telemedical System (ITMS) developed and tested an EKG assessing AI algorithm and incorporated it into the workflow of their Telemedicine Integrated Platform, a digital EKG reading program where cardiologists continuously report their findings remotely in real time. During the month of April 2019; 35 ITMS cardiologists reported a grand total of 61,441 EKG records, later subjecting them to the AI algorithm, implemented through the “One Click Report” process. Through this simple 2-step approach, the algorithm provides a suggestion of “Normal” or “Abnormal” to the cardiologist based on the patterns of the fiducial points included in said EKG reports. A comparison of the time of normal EKG diagnosis is made and the correlation between AI and cardiologists is assessed.
Results
On average, our AI algorithm discerned a normal EKG within 30.63s (95% CI 26.51s to 34.75s), in solid contrast with cardiologists' interpretations alone, which amounted to 83.54s (95% CI from 69.43s to 97.65s). This accounts for an overall saving of 52.91s (95% CI 42.45s to 63.83s) by implementing this innovative methodology in a cardiologist practice. In addition, this method correctly reported 23,213 Normal EKG records out of the total 25,013 AI output, reaching a 92.8% correlation between man and machine. The total average time saved in normal EKG readings with AI (23,213) would accrue an approximate of 20,470 minutes (ie, 42 8-hours work shifts worth of time dedicated to diagnosing a normal EKG).
Conclusions
The implementation of automated AI-driven technologies into daily EKG interpretation tasks poses an attractive time-saving alternative for faster and accurate results in a modern cardiology practice. By further expanding on the concept of an intelligent EKG characterization device, a more efficient and patient-centered clinical exercise will ensue.
Funding Acknowledgement
Type of funding source: None
Collapse
Affiliation(s)
- S Mehta
- Lumen Foundation, Miami, United States of America
| | - M Gibson
- Harvard Medical School, Boston, United States of America
| | - J Avila
- Cardionomous AI, Santiago, Chile
| | | | | | | | - F Vera
- Cardionomous AI, Santiago, Chile
| | | | | | | | - D Vieira
- Lumen Foundation, Miami, United States of America
| | - S Merchant
- Lumen Foundation, Miami, United States of America
| | - Y Vijayan
- Lumen Foundation, Miami, United States of America
| | - C.J Tamayo
- Lumen Foundation, Miami, United States of America
| | - D Pinos
- Lumen Foundation, Miami, United States of America
| |
Collapse
|
3
|
Mehta S, Avila J, Niklitschek S, Fernandez F, Villagran C, Vera F, Rocuant R, Cardenas G, Frauenfelder A, Vieira D, Vijayan Y, Pinto G, Vallenilla I, Prieto L, Cardenas J. Enhancing AI-guided STEMI detection algorithms by incorporating higher quality fiduciary EKG elements. Eur Heart J 2020. [DOI: 10.1093/ehjci/ehaa946.3554] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Abstract
Background
As EKG interpretation paradigms to a physician-free milieu, accumulating massive quantities of distilled pre-processed data becomes a must for machine learning techniques. In our pursuit of reducing ischemic times in STEMI management, we have improved our Artificial Intelligence (AI)-guided diagnostic tool by following a three-step approach: 1) Increase accuracy by adding larger clusters of data. 2) Increase the breadth of EKG classifications to provide more precise feedback and further refine the inputs which ultimately reflects in better and more accurate outputs. 3) Improving the algorithms' ability to discern between cardiovascular entities reflected in the EKG records.
Purpose
To bolster our algorithm's accuracy and reliability for electrocardiographic STEMI recognition.
Methods
Dataset: A total of 7,286 12-lead EKG records of 10-seconds length with a sampling frequency of 500 Hz obtained from Latin America Telemedicine Infarct Network from April 2014 to December 2019. This included the following balanced classes: angiographically confirmed STEMI, branch blocks, non-specific ST-T abnormalities, normal, and abnormal (200+ CPT codes, excluding the ones included in other classes). Labels of each record were manually checked by cardiologists to ensure precision (Ground truth). Pre-processing: First and last 250 samples were discarded to avoid a standardization pulse. Order 5 digital low pass filters with a 35 Hz cut-off was applied. For each record, the mean was subtracted to each individual lead. Classification: Determined classes were “STEMI” and “Not-STEMI” (A combination of randomly sampled normal, branch blocks, non-specific ST-T abnormalities and abnormal records – 25% of each subclass). Training & Testing: A 1-D Convolutional Neural Network was trained and tested with a dataset proportion of 90/10, respectively. The last dense layer outputs a probability for each record of being STEMI or Not-STEMI. Additional testing was performed with a subset of the original complete dataset of unconfirmed STEMI. Performance indicators (accuracy, sensitivity, and specificity) were calculated for each model and results were compared with our previous findings from past experiments.
Results
Complete STEMI data: Accuracy: 95.9% Sensitivity: 95.7% Specificity: 96.5%; Confirmed STEMI: Accuracy: 98.1% Sensitivity: 98.1% Specificity: 98.1%; Prior Data obtained in our previous experiments are shown below for comparison.
Conclusion(s)
After the addition of clustered pre-processed data, all performance indicators for STEMI detection increased considerably between both Confirmed STEMI datasets. On the other hand, the Complete STEMI dataset kept a strong and steady set of performance metrics when compared with past results. These findings not only validate the consistency and reliability of our algorithm but also connotes the importance of creating a pristine dataset for this and any other AI-derived medical tools.
Funding Acknowledgement
Type of funding source: None
Collapse
Affiliation(s)
- S Mehta
- Lumen Foundation, Miami, United States of America
| | - J Avila
- Cardionomous AI, Santiago, Chile
| | | | | | | | - F Vera
- Cardionomous AI, Santiago, Chile
| | | | | | | | - D Vieira
- Lumen Foundation, Miami, United States of America
| | - Y Vijayan
- Lumen Foundation, Miami, United States of America
| | - G Pinto
- Lumen Foundation, Miami, United States of America
| | - I Vallenilla
- Lumen Foundation, Miami, United States of America
| | - L Prieto
- Lumen Foundation, Miami, United States of America
| | - J Cardenas
- Lumen Foundation, Miami, United States of America
| |
Collapse
|
4
|
Mehta S, Avila J, Niklitschek S, Fernandez F, Villagran C, Vera F, Rocuant R, Cardenas G, Frauenfelder A, Vieira D, Quintero S, Vijayan Y, Merchant S, Narvaez-Caicedo C, Sanchez C. Countdown to physician-free EKG interpretation. Eur Heart J 2020. [DOI: 10.1093/ehjci/ehaa946.1832] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Abstract
Background
With the introduction of electronic medical records and other digital platforms, the classification and coding of different medical entities have become a complex, cumbersome task that is prone to diagnostic inconsistencies and errors. By incorporating Artificial Intelligence (AI) to a massive database of EKG records, we have developed an innovative methodology to accurately discriminate an EKG as “normal” or “abnormal”. We firmly believe that this algorithm sets up medicine on a path of complete computer-aided EKG interpretation.
Purpose
To present a viable AI-guided filter that can accurately discriminate between normal and abnormal EKG within a cardiologist-annotated EKG database.
Methods
An observational, retrospective, case-control study. Samples: A total of 140,000 randomly sampled 12-lead ECG of 10-seconds length with a sampling frequency of 500 [Hz] from Brazil (BR) and Colombia (CO) (divided as 70,000 normal and 70,000 abnormal EKG records per country dataset) were derived from the private International Telemedical System (ITMS) database from September 2018 to July 2019. Only de-identified records were used, records with artifacts were excluded. Preprocessing: Only the first 2s of each short lead and 9s of the long lead were considered. This data includes mobile (MOB) and transtelephonic (TTP) EKGs (50/50 ratio). Limb leads I, II and III and precordial leads V1, V2, V3 and V5 were used. The mean was removed from each lead. Training Sets: Four models were trained as depicted in the figure below. Each training dataset has 25,000 Normal and 25,000 Abnormal records, where 10% of the total records were used as a validation set. The test sets included 10,000 normal, and 10,000 abnormal records each. Testing and Class Assigning: An inception convolutional neural network was implemented; Each model was tested with 5,000 normal and 5,000 abnormal records of the corresponding country and transmission type with which they were trained. “Normal” or “Abnormal” labels were assigned to each EKG record and were compared to the cardiologists' reports; performance indicators (accuracy, sensitivity, and specificity) were calculated for each model.
Results
An overall accuracy of 82.4%; sensitivity of 88.7%; and specificity of 76.2% was achieved amongst the 4 testing models (Separate results of each training set are shown below).
Conclusion(s)
AI enables the interpretation of digital EKG records to be exercised in an organized, accurate, and straightforward manner, taking into consideration the multiple potential entities that can be diagnosed through this historical triage tool. By quickly identifying the normal records, the cardiologist is able to invest efforts in treating patients in a timely manner.
Funding Acknowledgement
Type of funding source: None
Collapse
Affiliation(s)
- S Mehta
- Lumen Foundation, Miami, United States of America
| | - J Avila
- Cardionomous AI, Santiago, Chile
| | | | | | | | - F Vera
- Cardionomous AI, Santiago, Chile
| | | | | | | | - D Vieira
- Lumen Foundation, Miami, United States of America
| | - S Quintero
- Lumen Foundation, Miami, United States of America
| | - Y Vijayan
- Lumen Foundation, Miami, United States of America
| | - S Merchant
- Lumen Foundation, Miami, United States of America
| | | | - C Sanchez
- Lumen Foundation, Miami, United States of America
| |
Collapse
|
5
|
Mehta S, Gibson M, Niklitschek S, Fernandez F, Villagran C, Escobar E, Vera F, Frauenfelder A, Vieira D, Vijayan Y, Quintero S, Vallenilla I, Pinto G, Cardenas J, Merchant S. Maximum artificial intelligence and complete reconstruct of population-based AMI care. Eur Heart J 2020. [DOI: 10.1093/ehjci/ehaa946.3520] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Abstract
Background
After creating a behemoth hub and spoke AMI network that encompasses more than 100 million patients in 5 countries, we have begun to incorporate Artificial Intelligence (AI) algorithms into our telemedicine strategy with the goal of creating comprehensive, very early AMI diagnosis and physician-free triage. In doing so, we have replaced door-to-balloon times (d2b) with symptom-to-balloon times (s2b) as an immutable objective.
Purpose
To incorporate AI attributes for very early AMI detection, triage, and management.
Methods
We expanded our effective telemedicine strategy (100 million population; 877,178 telemedicine encounters; 55% overall mortality reduction; $291 million cost savings) with a logistic reset to impact s2b. To do this, we incorporated our Single Lead 1.0 (lead I) and Single Lead 2.0 (lead V2) technology for self-administered AMI detection with our physician-free STEMI diagnosis and triage AI algorithms. Single Lead algorithms and physician-free protocols were generated by utilizing Machine Learning from our mammoth annotated EKG repository.
Results
In addition to three logistic markers of efficiency Time-to-Telemedicine Diagnosis (TTD), Door-In-Door-Out (DIDO) and Transfer Times (TT); we are monitoring s2b. A gradual release of the algorithms and single lead is occurring at the telemedicine spokes. Detailed results will be available at the time of presentation.
Conclusions
Impacting s2b, the Achilles Heel of Primary PCI, may be achieved with the use of patient-administered AMI detection tools. Incorporation of these technologies into AI algorithms will add to telemedicine efficiencies for population-based AMI care.
Funding Acknowledgement
Type of funding source: None
Collapse
Affiliation(s)
- S Mehta
- Lumen Foundation, Miami, United States of America
| | - M Gibson
- Harvard Medical School, Boston, United States of America
| | | | | | | | | | - F Vera
- Cardionomous AI, Santiago, Chile
| | | | - D Vieira
- Lumen Foundation, Miami, United States of America
| | - Y Vijayan
- Lumen Foundation, Miami, United States of America
| | - S Quintero
- Lumen Foundation, Miami, United States of America
| | - I Vallenilla
- Lumen Foundation, Miami, United States of America
| | - G Pinto
- Lumen Foundation, Miami, United States of America
| | - J Cardenas
- Lumen Foundation, Miami, United States of America
| | - S Merchant
- Lumen Foundation, Miami, United States of America
| |
Collapse
|
6
|
Mehta S, Avila J, Villagran C, Fernandez F, Niklitschek S, Vera F, Rocuant R, Cardenas G, Escobar E, Frauenfelder A, Vieira D, Vijayan Y, Pinto G, Ceschim M, Luna M. Moving in sync – concordance betweena artificial intelligence and cardiologist on detecting normal electrocardiograms. Eur Heart J 2020. [DOI: 10.1093/ehjci/ehaa946.1664] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Abstract
Abstract
Background
Merging modern technologies with classic diagnostic tests often results in a sense of insecurity within the medical community, particularly so with potentially life-saving studies such as the electrocardiogram (EKG). In order to provide a greater sense of trust between Artificial Intelligence (AI) and cardiologists, we provide an AI-driven algorithm capable of accurately and reliably characterize an EKG as normal within a highly complex, cardiologist-reviewed EKG database and report the degree of concordance between this machine vs physician scenario.
Purpose
To provide a dependable and accurate AI algorithm that conducts EKG interpretation in a cardiologist-tier manner.
Methods
The International Telemedical System (ITMS) developed and tested an EKG assessing AI algorithm and incorporated it into the workflow of their Telemedicine Integrated Platform, a digital EKG reading program where cardiologists continuously report their findings remotely in real-time. During the month of April 2,019; 35 ITMS cardiologists reported a grand total of 61,441 EKG records, later submitting them to the AI algorithm implemented through the “One Click Report” process. Through this simple 2-step approach, the algorithm provides a suggestion of “Normal” or “Abnormal” to the cardiologist based on the patterns of the fiducial points included in said EKG reports. Confirmation of these suggestions by the cardiologists ensued.
Results
Overall, cardiologists confirmed 23,213 out of 25,013 AI outputs for “Normal” EKGs, demonstrating a concordance of 92.8% for Normal diagnosis.
Conclusion
Through this methodology, we provide an AI technology that can be reliably applied and trusted in EKG digital platforms to identify and suitably label a normal EKG. Further testing will accrue into a multi label algorithm compatible with abnormal cardiovascular entities, potentially precluding the role of the cardiologist for triaging, particularly in the prehospital setting. We anticipate that this approach will become a promising methodology in modern cardiology practice.
Funding Acknowledgement
Type of funding source: None
Collapse
Affiliation(s)
- S Mehta
- Lumen Foundation, Miami, United States of America
| | - J Avila
- Cardionomous AI, Santiago, Chile
| | | | | | | | - F Vera
- Cardionomous AI, Santiago, Chile
| | | | | | - E Escobar
- Lumen Foundation, Miami, United States of America
| | | | - D Vieira
- Lumen Foundation, Miami, United States of America
| | - Y Vijayan
- Lumen Foundation, Miami, United States of America
| | - G Pinto
- Lumen Foundation, Miami, United States of America
| | - M Ceschim
- Lumen Foundation, Miami, United States of America
| | - M Luna
- Lumen Foundation, Miami, United States of America
| |
Collapse
|
7
|
Mehta S, Niklitschek S, Fernandez F, Villagran C, Escobar E, Avila J, Cardenas G, Rocuant R, Vera F, Frauenfelder A, Vieira D, Quintero S, Vijayan Y, Merchant S, Tamayo C. Enriching artificial intelligence ST-elevation myocardial infarction (STEMI) detection algorithms with differential diagnoses. Eur Heart J 2020. [DOI: 10.1093/ehjci/ehaa946.1776] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Abstract
Abstract
Background
STEMI outcomes, although improved with systems of care, are hamstrung by delayed presentation and prevaricates of a 12-lead ECG. We report an artificial intelligence (AI) guided, single lead EKG algorithm for a self-administered tool to reliably detect STEMI and trigger ambulance dispatch.
Purpose
To provide a reliable and improved AI-guided Single Lead EKG methodology.
Methods
From our cardiologist-annotated repository, we assigned a dataset of 11,118 classified ECG. Ontology organized 5 groups apportioned for an interclass balance among commoner STEMI differential diagnoses. This anonymous, pre-classified data included 5,549 STEMI, 1,391 normal, 1,393 Bundle Branch Block, 1,393 non-specific ST-T changes and 1,392 miscellaneous. Each ECG was fragmented into individual 1-lead strips. Algorithm: 1-D Convolutional Neural Networks. Gender and age were included before the last dense layer. Training and Testing: Preset 90% dataset (10,008 ECG) train, 10% test (1,110 ECG). Statistical Analysis and ROC curves: Digitized dataset, 500 samples/second, 10s duration, total 5,000 samples per lead. Statistical mean for each lead was calculated and subtracted from the original lead. Statistical values and ROC curves were assessed.
Results
Most Accurate: Lead V2 – 91%; Most Sensitive: Lead I – 92% Most Specific: Lead III – 96%. Best AUC: Lead V2 – 91%.
Conclusions
Incorporating subtypes of STEMI differential diagnosis enriches the single lead AI algorithm. Validating the derived algorithm with our entire database of 18 million ECG will further strengthen the results.
Funding Acknowledgement
Type of funding source: None
Collapse
Affiliation(s)
- S Mehta
- Lumen Foundation, Miami, United States of America
| | | | | | | | | | - J Avila
- Cardionomous AI, Santiago, Chile
| | | | | | - F Vera
- Cardionomous AI, Santiago, Chile
| | | | - D Vieira
- Lumen Foundation, Miami, United States of America
| | - S Quintero
- Lumen Foundation, Miami, United States of America
| | - Y Vijayan
- Lumen Foundation, Miami, United States of America
| | - S Merchant
- Lumen Foundation, Miami, United States of America
| | - C.J Tamayo
- Lumen Foundation, Miami, United States of America
| |
Collapse
|
8
|
Mehta S, Niklitschek S, Fernandez F, Villagran C, Avila J, Cardenas G, Rocuant R, Vera F, Frauenfelder A, Vieira D, Quintero S, Coutelle N, Bou Daher D, Vijayan Y, Luna M. Baby steps in the path of modifying the role of cardiologists for interpreting EKG for AMI. Eur Heart J 2020. [DOI: 10.1093/ehjci/ehaa946.1752] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Abstract
Background
EKG interpretation is slowly transitioning to a physician-free, Artificial Intelligence (AI)-driven endeavor. Our continued efforts to innovate follow a carefully laid stepwise approach, as follows: 1) Create an AI algorithm that accurately identifies STEMI against non-STEMI using a 12-lead EKG; 2) Challenging said algorithm by including different EKG diagnosis to the previous experiment, and now 3) To further validate the accuracy and reliability of our algorithm while also improving performance in a prehospital and hospital settings.
Purpose
To provide an accurate, reliable, and cost-effective tool for STEMI detection with the potential to redirect human resources into other clinically relevant tasks and save the need for human resources.
Methods
Database: EKG records obtained from Latin America Telemedicine Infarct Network (Mexico, Colombia, Argentina, and Brazil) from April 2014 to December 2019. Dataset: A total of 11,567 12-lead EKG records of 10-seconds length with sampling frequency of 500 [Hz], including the following balanced classes: unconfirmed and angiographically confirmed STEMI, branch blocks, non-specific ST-T abnormalities, normal and abnormal (200+ CPT codes, excluding the ones included in other classes). The label of each record was manually checked by cardiologists to ensure precision (Ground truth). Pre-processing: The first and last 250 samples were discarded as they may contain a standardization pulse. An order 5 digital low pass filter with a 35 Hz cut-off was applied. For each record, the mean was subtracted to each individual lead. Classification: The determined classes were STEMI (STEMI in different locations of the myocardium – anterior, inferior and lateral); Not-STEMI (A combination of randomly sampled normal, branch blocks, non-specific ST-T abnormalities and abnormal records – 25% of each subclass). Training & Testing: A 1-D Convolutional Neural Network was trained and tested with a dataset proportion of 90/10; respectively. The last dense layer outputs a probability for each record of being STEMI or Not-STEMI. Additional testing was performed with a subset of the original dataset of angiographically confirmed STEMI.
Results
See Figure Attached – Preliminary STEMI Dataset Accuracy: 96.4%; Sensitivity: 95.3%; Specificity: 97.4% – Confirmed STEMI Dataset: Accuracy: 97.6%; Sensitivity: 98.1%; Specificity: 97.2%.
Conclusions
Our results remain consistent with our previous experience. By further increasing the amount and complexity of the data, the performance of the model improves. Future implementations of this technology in clinical settings look promising, not only in performing swift screening and diagnostic steps but also partaking in complex STEMI management triage.
Funding Acknowledgement
Type of funding source: None
Collapse
Affiliation(s)
- S Mehta
- Lumen Foundation, Miami, United States of America
| | | | | | | | - J Avila
- Cardionomous AI, Santiago, Chile
| | | | | | - F Vera
- Cardionomous AI, Santiago, Chile
| | | | - D Vieira
- Lumen Foundation, Miami, United States of America
| | - S Quintero
- Lumen Foundation, Miami, United States of America
| | - N Coutelle
- Lumen Foundation, Miami, United States of America
| | - D Bou Daher
- Lumen Foundation, Miami, United States of America
| | - Y Vijayan
- Lumen Foundation, Miami, United States of America
| | - M Luna
- Lumen Foundation, Miami, United States of America
| |
Collapse
|
9
|
Mehta S, Niklitschek S, Fernandez F, Villagran C, Avila J, Cardenas G, Rocuant R, Vera F, Frauenfelder A, Vieira D, Quintero S, Pinto G, Vijayan Y, Merchant S, Bou Daher D. Innovative techniques to construct powerful artificial intelligence algorithms for st-elevation myocardial infarction. Eur Heart J 2020. [DOI: 10.1093/ehjci/ehaa946.3459] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Abstract
Background
With the sudden advent of Artificial Intelligence (AI), incorporation of these technologies into key aspects of our working environment has become an ever so delicate task, especially so when dealing with time-sensitive and potentially lethal scenarios such as ST-Elevation Myocardial Infarction (STEMI) management. By further expanding into our successful experiences with AI-guided algorithms for STEMI detection, we implemented an innovative ensemble method into our methodology as we seek to improve the algorithm's predictive capabilities.
Purpose
Through the ensemble method, we combined two ML techniques to boost our previous experiments' accuracy and reliability.
Methods
Database: EKG records obtained from Latin America Telemedicine Infarct Network (Mexico, Colombia, Argentina, and Brazil) from April 2014 to December 2019. Dataset: Two separate datasets were used to train and test two sets of AI algorithms. The first comprised of 11,567 records and the second 7,286 records, each composed of 12-lead EKG records of 10-second length with sampling frequency of 500 Hz, including the following balanced classes: unconfirmed & angiographically confirmed STEMI (first model); angiographically confirmed STEMI only (second model); and, for both models, we included branch blocks, non-specific ST-T abnormalities, normal, and abnormal (200+ CPT codes, excluding the ones included in other classes). Label per record was manually checked by cardiologists to ensure precision (Ground truth). Pre-processing: First and last 250 samples were discarded to avoid a standardization pulse. An order 5 digital low pass filter with a 35 Hz cut-off was applied. For each record, the mean was subtracted to each individual lead. Classification: The determined classes were STEMI and Not-STEMI (A combination of randomly sampled normal, branch blocks, non-specific ST-T abnormalities and abnormal records – 25% of each subclass). Training & Testing: The last dense layer outputs a probability for each record of being STEMI or Not-STEMI. These probabilities were calculated for each model (Model 1 trained with Complete STEMI dataset and Model 2 trained with confirmed STEMI only dataset) and aggregated using the mean aggregation to generate the final label for each record. A 1-D Convolutional Neural Network was trained and tested with a dataset proportion of 90%/10%; respectively. Results are reported for both testing datasets (Complete and confirmed STEMI only records).
Results
Complete STEMI Dataset: Accuracy: 96.5% Sensitivity: 96.2% Specificity: 96.9% – Confirmed STEMI only Dataset: Accuracy: 98.5% Sensitivity: 98.3% Specificity: 98.6%'
Conclusion(s)
While Model 1 and Model 2 achieved similar performances with promising results on their own, applying a combination of both through the ensemble model exhibits a clear improvement in performance when applied to both datasets. This provides a blueprint for advanced automated STEMI detection through wearable devices.
Funding Acknowledgement
Type of funding source: None
Collapse
Affiliation(s)
- S Mehta
- Lumen Foundation, Miami, United States of America
| | | | | | | | - J Avila
- Cardionomous AI, Santiago, Chile
| | | | | | - F Vera
- Cardionomous AI, Santiago, Chile
| | | | - D Vieira
- Lumen Foundation, Miami, United States of America
| | - S Quintero
- Lumen Foundation, Miami, United States of America
| | - G Pinto
- Lumen Foundation, Miami, United States of America
| | - Y Vijayan
- Lumen Foundation, Miami, United States of America
| | - S Merchant
- Lumen Foundation, Miami, United States of America
| | - D Bou Daher
- Lumen Foundation, Miami, United States of America
| |
Collapse
|
10
|
Fernandez F, Villagran C, Cardenas G, Niklitschek S, Mehta S, Vieira D, Frauenfelder A, Quintero S, Vijayan Y, Merchant S, Tamayo C. Novel wearable sensor device methodology for STEMI detection. Eur Heart J 2020. [DOI: 10.1093/ehjci/ehaa946.3438] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Abstract
Background
Novel STEMI detection tools using wearable Single Lead EKG methodologies demonstrate vast potential in many clinical scenarios. Recent research suggests that smartwatches and other wearable devices can be repositioned to acquire “new” chest leads that have similar, but not equal, waveforms when compared to traditional precordial leads. Throughout our previous research, only Lead I data had been used to train our Machine Learning (ML) models due to a lack of datasets from these “new” leads. We now propose an innovative methodology to tackle these limitations and compare it with our previous experience.
Purpose
To demonstrate that mathematical vector algebra can reliably transform EKG STEMI databases into different, ML-ready datasets useful to train models with entirely new leads, mainly to be used in the development and training of reliable STEMI detection tools.
Methods
Our previous research has demonstrated that the most accurate (91.2%) ML model was achieved through precordial lead 2 (V2). By definition, V2 corresponds to the difference in electric potential between the Wilson Central Terminal (Wt) and the Chest terminal 2 (C2). To obtain the Wt, at least three electrodes must be used (Right Arm [RA], Left Arm [LA], Left Leg [LL]). Due to practical reasons, we discarded this methodology and worked with Lead I instead, which needs only two body contacts (RA, LA), and provides waveforms that are compatible with the majority of wearable devices (smartwatches, rings, among others). New waveforms (Vn') were obtained by positioning a single lead-capable wearable device (Smartwatch) to chest positions Cn (C1, C2,...,C6) and touching a second electrode with a right-hand finger, which corresponds to the difference in electric potential between RA and the correspondent conventional Vn chest position, respectively. Using vector algebra, we observe that Vn' corresponds to the sum of −aVR + Vn. Vector mathematical analysis was performed for 5,783 STEMI (50%) and 5,784 Not-STEMI (50%) EKG dataset, obtaining their corresponding new precordial leads Vn'. Following this, the ML Heart Attack Detector model was trained with 10,410 EKG (90%) and tested utilizing 1,157 (10%) EKG. Performance metrics were calculated for each new Lead and compared with our Prior Data.
Results
A 1:1 correlation was seen between our previous and current experiments, with Lead V2' performing as the best overall lead with 91.2% Accuracy, 89.6% Sensibility, and 92.9% Specificity. Complete information on prior and new data are provided below.
Conclusions
With the use of this new methodology, we overcame the inherent limitations of using our best Lead (V2) in a single lead approach for STEMI screening. Further prospective data is needed to validate this approach, but it provides a promising blueprint for automated STEMI detection and management triage through the use of wearable devices.
Funding Acknowledgement
Type of funding source: None
Collapse
Affiliation(s)
| | | | | | | | - S Mehta
- Lumen Foundation, Miami, United States of America
| | - D Vieira
- Lumen Foundation, Miami, United States of America
| | | | - S Quintero
- Lumen Foundation, Miami, United States of America
| | - Y Vijayan
- Lumen Foundation, Miami, United States of America
| | - S Merchant
- Lumen Foundation, Miami, United States of America
| | - C.J Tamayo
- Lumen Foundation, Miami, United States of America
| |
Collapse
|