1
|
Cai Y, Cai YQ, Tang LY, Wang YH, Gong M, Jing TC, Li HJ, Li-Ling J, Hu W, Yin Z, Gong DX, Zhang GW. Artificial intelligence in the risk prediction models of cardiovascular disease and development of an independent validation screening tool: a systematic review. BMC Med 2024; 22:56. [PMID: 38317226 PMCID: PMC10845808 DOI: 10.1186/s12916-024-03273-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/16/2023] [Accepted: 01/23/2024] [Indexed: 02/07/2024] Open
Abstract
BACKGROUND A comprehensive overview of artificial intelligence (AI) for cardiovascular disease (CVD) prediction and a screening tool of AI models (AI-Ms) for independent external validation are lacking. This systematic review aims to identify, describe, and appraise AI-Ms of CVD prediction in the general and special populations and develop a new independent validation score (IVS) for AI-Ms replicability evaluation. METHODS PubMed, Web of Science, Embase, and IEEE library were searched up to July 2021. Data extraction and analysis were performed for the populations, distribution, predictors, algorithms, etc. The risk of bias was evaluated with the prediction risk of bias assessment tool (PROBAST). Subsequently, we designed IVS for model replicability evaluation with five steps in five items, including transparency of algorithms, performance of models, feasibility of reproduction, risk of reproduction, and clinical implication, respectively. The review is registered in PROSPERO (No. CRD42021271789). RESULTS In 20,887 screened references, 79 articles (82.5% in 2017-2021) were included, which contained 114 datasets (67 in Europe and North America, but 0 in Africa). We identified 486 AI-Ms, of which the majority were in development (n = 380), but none of them had undergone independent external validation. A total of 66 idiographic algorithms were found; however, 36.4% were used only once and only 39.4% over three times. A large number of different predictors (range 5-52,000, median 21) and large-span sample size (range 80-3,660,000, median 4466) were observed. All models were at high risk of bias according to PROBAST, primarily due to the incorrect use of statistical methods. IVS analysis confirmed only 10 models as "recommended"; however, 281 and 187 were "not recommended" and "warning," respectively. CONCLUSION AI has led the digital revolution in the field of CVD prediction, but is still in the early stage of development as the defects of research design, report, and evaluation systems. The IVS we developed may contribute to independent external validation and the development of this field.
Collapse
Affiliation(s)
- Yue Cai
- China Medical University, Shenyang, 110122, China
| | - Yu-Qing Cai
- China Medical University, Shenyang, 110122, China
| | - Li-Ying Tang
- China Medical University, Shenyang, 110122, China
| | - Yi-Han Wang
- China Medical University, Shenyang, 110122, China
| | - Mengchun Gong
- Digital Health China Co. Ltd, Beijing, 100089, China
| | - Tian-Ci Jing
- Smart Hospital Management Department, the First Hospital of China Medical University, Shenyang, 110001, China
| | - Hui-Jun Li
- Shenyang Medical & Film Science and Technology Co. Ltd., Shenyang, 110001, China
- Enduring Medicine Smart Innovation Research Institute, Shenyang, 110001, China
| | - Jesse Li-Ling
- Institute of Genetic Medicine, School of Life Science, State Key Laboratory of Biotherapy, Sichuan University, Chengdu, 610065, China
| | - Wei Hu
- Bayi Orthopedic Hospital, Chengdu, 610017, China
| | - Zhihua Yin
- Department of Epidemiology, School of Public Health, China Medical University, Shenyang, 110122, China.
| | - Da-Xin Gong
- Smart Hospital Management Department, the First Hospital of China Medical University, Shenyang, 110001, China.
- The Internet Hospital Branch of the Chinese Research Hospital Association, Beijing, 100006, China.
| | - Guang-Wei Zhang
- Smart Hospital Management Department, the First Hospital of China Medical University, Shenyang, 110001, China.
- The Internet Hospital Branch of the Chinese Research Hospital Association, Beijing, 100006, China.
| |
Collapse
|
2
|
Kuo HC, Hao S, Jin B, Chou CJ, Han Z, Chang LS, Huang YH, Hwa K, Whitin JC, Sylvester KG, Reddy CD, Chubb H, Ceresnak SR, Kanegaye JT, Tremoulet AH, Burns JC, McElhinney D, Cohen HJ, Ling XB. Single center blind testing of a US multi-center validated diagnostic algorithm for Kawasaki disease in Taiwan. Front Immunol 2022; 13:1031387. [PMID: 36263040 PMCID: PMC9575935 DOI: 10.3389/fimmu.2022.1031387] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2022] [Accepted: 09/21/2022] [Indexed: 11/13/2022] Open
Abstract
BackgroundKawasaki disease (KD) is the leading cause of acquired heart disease in children. The major challenge in KD diagnosis is that it shares clinical signs with other childhood febrile control (FC) subjects. We sought to determine if our algorithmic approach applied to a Taiwan cohort.MethodsA single center (Chang Gung Memorial Hospital in Taiwan) cohort of patients suspected with acute KD were prospectively enrolled by local KD specialists for KD analysis. Our previously single-center developed computer-based two-step algorithm was further tested by a five-center validation in US. This first blinded multi-center trial validated our approach, with sufficient sensitivity and positive predictive value, to identify most patients with KD diagnosed at centers across the US. This study involved 418 KDs and 259 FCs from the Chang Gung Memorial Hospital in Taiwan.FindingsOur diagnostic algorithm retained sensitivity (379 of 418; 90.7%), specificity (223 of 259; 86.1%), PPV (379 of 409; 92.7%), and NPV (223 of 247; 90.3%) comparable to previous US 2016 single center and US 2020 fiver center results. Only 4.7% (15 of 418) of KD and 2.3% (6 of 259) of FC patients were identified as indeterminate. The algorithm identified 18 of 50 (36%) KD patients who presented 2 or 3 principal criteria. Of 418 KD patients, 157 were infants younger than one year and 89.2% (140 of 157) were classified correctly. Of the 44 patients with KD who had coronary artery abnormalities, our diagnostic algorithm correctly identified 43 (97.7%) including all patients with dilated coronary artery but one who found to resolve in 8 weeks.InterpretationThis work demonstrates the applicability of our algorithmic approach and diagnostic portability in Taiwan.
Collapse
Affiliation(s)
- Ho-Chang Kuo
- Kawasaki Disease Center, Kaohsiung Chang Gung Memorial Hospital, Kaohsiung, Taiwan
- Department of Pediatrics, Chang Gung University College of Medicine, Kaohsiung, Taiwan
- *Correspondence: Xuefeng B. Ling, ;Ho-Chang Kuo,
| | - Shiying Hao
- School of Medicine, Stanford University, Stanford, CA, United States
| | - Bo Jin
- School of Medicine, Stanford University, Stanford, CA, United States
| | - C. James Chou
- School of Medicine, Stanford University, Stanford, CA, United States
| | - Zhi Han
- School of Medicine, Stanford University, Stanford, CA, United States
| | - Ling-Sai Chang
- Kawasaki Disease Center, Kaohsiung Chang Gung Memorial Hospital, Kaohsiung, Taiwan
- Department of Pediatrics, Chang Gung University College of Medicine, Kaohsiung, Taiwan
| | - Ying-Hsien Huang
- Kawasaki Disease Center, Kaohsiung Chang Gung Memorial Hospital, Kaohsiung, Taiwan
- Department of Pediatrics, Chang Gung University College of Medicine, Kaohsiung, Taiwan
| | - Kuoyuan Hwa
- Center for Biomedical Industry, Department of Molecular Science and Engineering, National Taipei University of Technology, Taipei, Taiwan
| | - John C. Whitin
- School of Medicine, Stanford University, Stanford, CA, United States
| | - Karl G. Sylvester
- School of Medicine, Stanford University, Stanford, CA, United States
| | - Charitha D. Reddy
- School of Medicine, Stanford University, Stanford, CA, United States
| | - Henry Chubb
- School of Medicine, Stanford University, Stanford, CA, United States
| | - Scott R. Ceresnak
- School of Medicine, Stanford University, Stanford, CA, United States
| | - John T. Kanegaye
- Pediatrics, University of California San Diego, San Diego, CA, United States
| | | | - Jane C. Burns
- Pediatrics, University of California San Diego, San Diego, CA, United States
| | - Doff McElhinney
- School of Medicine, Stanford University, Stanford, CA, United States
| | - Harvey J. Cohen
- School of Medicine, Stanford University, Stanford, CA, United States
| | - Xuefeng B. Ling
- School of Medicine, Stanford University, Stanford, CA, United States
- *Correspondence: Xuefeng B. Ling, ;Ho-Chang Kuo,
| |
Collapse
|
3
|
Svennberg E, Tjong F, Goette A, Akoum N, Di Biase L, Bordachar P, Boriani G, Burri H, Conte G, Deharo JC, Deneke T, Drossart I, Duncker D, Han JK, Heidbuchel H, Jais P, de Oliviera Figueiredo MJ, Linz D, Lip GYH, Malaczynska-Rajpold K, Márquez M, Ploem C, Soejima K, Stiles MK, Wierda E, Vernooy K, Leclercq C, Meyer C, Pisani C, Pak HN, Gupta D, Pürerfellner H, Crijns HJGM, Chavez EA, Willems S, Waldmann V, Dekker L, Wan E, Kavoor P, Turagam MK, Sinner M. How to use digital devices to detect and manage arrhythmias: an EHRA practical guide. Europace 2022; 24:979-1005. [PMID: 35368065 DOI: 10.1093/europace/euac038] [Citation(s) in RCA: 120] [Impact Index Per Article: 60.0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022] Open
Affiliation(s)
- Emma Svennberg
- Department of Medicine Huddinge, Karolinska Institutet, Stockholm, Sweden
| | - Fleur Tjong
- Heart Center, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, The Netherlands
| | - Andreas Goette
- St. Vincenz Hospital Paderborn, Paderborn, Germany
- MAESTRIA Consortium/AFNET, Münster, Germany
| | - Nazem Akoum
- Heart Institute, University of Washington School of Medicine, Seattle, WA, USA
| | - Luigi Di Biase
- Albert Einstein College of Medicine at Montefiore Hospital, New York, NY, USA
| | | | - Giuseppe Boriani
- Cardiology Division, Department of Biomedical, Metabolic and Neural Sciences, University of Modena and Reggio Emilia, Policlinico di Modena, Modena, Italy
| | - Haran Burri
- Cardiology Department, University Hospital of Geneva, Geneva, Switzerland
| | - Giulio Conte
- Cardiocentro Ticino Institute, Ente Ospedaliero Cantonale, Lugano, Switzerland
| | - Jean Claude Deharo
- Assistance Publique-Hôpitaux de Marseille, Centre Hospitalier Universitaire La Timone, Service de Cardiologie, Marseille, France
- Aix Marseille Université, C2VN, Marseille, France
| | - Thomas Deneke
- Heart Center Bad Neustadt, Bad Neustadt an der Saale, Germany
| | - Inga Drossart
- European Society of Cardiology, Sophia Antipolis, France
- ESC Patient Forum, Sophia Antipolis, France
| | - David Duncker
- Hannover Heart Rhythm Center, Department of Cardiology and Angiology, Hannover Medical School, Hannover, Germany
| | - Janet K Han
- Cardiac Arrhythmia Centers, Veterans Affairs Greater Los Angeles Healthcare System and University of California, Los Angeles, CA, USA
| | - Hein Heidbuchel
- Department of Cardiology, Antwerp University Hospital, Antwerp, Belgium
- Cardiovascular Research Group, Antwerp University, Antwerp, Belgium
| | - Pierre Jais
- Bordeaux University Hospital, Bordeaux, France
| | | | - Dominik Linz
- Department of Cardiology, Maastricht University Medical Centre and Cardiovascular Research Institute Maastricht, Maastricht, the Netherlands
| | - Gregory Y H Lip
- Liverpool Centre for Cardiovascular Science, University of Liverpool and Liverpool Heart & Chest Hospital, Liverpool, UK
- Department of Clinical Medicine, Aalborg University, Aalborg, Denmark
| | | | - Manlio Márquez
- Department of Electrocardiology, Instituto Nacional de Cardiología, Mexico City, Mexico
| | - Corrette Ploem
- Department of Ethics, Law and Medical Humanities, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, The Netherlands
| | - Kyoko Soejima
- Kyorin University School of Medicine, Mitaka, Tokyo, Japan
| | - Martin K Stiles
- Waikato Clinical School, University of Auckland, Hamilton, New Zealand
| | - Eric Wierda
- Department of Cardiology, Dijklander Hospital, Hoorn, the Netherlands
| | - Kevin Vernooy
- Department of Cardiology, Cardiovascular Research Institute Maastricht (CARIM), Maastricht University Medical Center, Maastricht, the Netherlands
| | | | - Christian Meyer
- Division of Cardiology/Angiology/Intensive Care, EVK Düsseldorf, Teaching Hospital University of Düsseldorf, Düsseldorf, Germany
| | - Cristiano Pisani
- Arrhythmia Unit, Heart Institute, InCor, University of São Paulo Medical School, São Paulo, Brazil
| | - Hui Nam Pak
- Yonsei University, Severance Cardiovascular Hospital, Yonsei University Health System, Seoul, Republic of Korea
| | - Dhiraj Gupta
- Faculty of Health and Life Sciences, Liverpool Heart and Chest Hospital, University of Liverpool, Liverpool, UK
| | | | - H J G M Crijns
- Em. Professor of Cardiology, University of Maastricht, Maastricht, Netherlands
| | - Edgar Antezana Chavez
- Division of Cardiology, Hospital General de Agudos Dr. Cosme Argerich, Pi y Margall 750, C1155AHB Buenos Aires, Argentina
- Division of Cardiology, Hospital Belga, Antezana 455, C0000 Cochabamba, Bolivia
| | | | - Victor Waldmann
- Electrophysiology Unit, European Georges Pompidou Hospital, Paris, France
- Adult Congenital Heart Disease Unit, European Georges Pompidou Hospital, Paris, France
| | - Lukas Dekker
- Catharina Ziekenhuis Eindhoven, Eindhoven, Netherlands
| | - Elaine Wan
- Cardiology and Cardiac Electrophysiology, Columbia University, New York, NY, USA
| | - Pramesh Kavoor
- Cardiology Department, Westmead Hospital, Westmead, New South Wales, Australia
| | | | - Moritz Sinner
- Univ. Hospital Munich, Campus Grosshadern, Munich, Germany
| |
Collapse
|
4
|
Ojha U, Ayathamattam J, Okonkwo K, Ogunmwonyi I. Recent Updates and Technological Developments in Evaluating Cardiac Syncope in the Emergency Department. Curr Cardiol Rev 2022; 18:e210422203887. [PMID: 35593355 PMCID: PMC9893151 DOI: 10.2174/1573403x18666220421110935] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/21/2022] [Revised: 02/21/2022] [Accepted: 02/24/2022] [Indexed: 11/22/2022] Open
Abstract
Syncope is a commonly encountered problem in the emergency department (ED), accounting for approximately 3% of presenting complaints. Clinical assessment of syncope can be challenging due to the diverse range of conditions that can precipitate the symptom. Annual mortality for patients presenting with syncope ranges from 0-12%, and if the syncope is secondary to a cardiac cause, then this figure rises to 18-33%. In ED, it is paramount to accurately identify those presenting with syncope, especially patients with an underlying cardiac aetiology, initiate appropriate management, and refer them for further investigations. In 2018, the European Society of Cardiology (ESC) updated its guidelines with regard to diagnosing and managing patients with syncope. We highlight recent developments and considerations in various components of the workup, such as history, physical examination, investigations, risk stratification, and novel biomarkers, since the establishment of the 2018 ESC guidelines. We further discuss the emerging role of artificial intelligence in diagnosing cardiac syncope and postulate how wearable technology may transform evaluating cardiac syncope in ED.
Collapse
Affiliation(s)
- Utkarsh Ojha
- Department of Cardiology, Royal Brompton & Harefield Hospitals, England, UK
| | - James Ayathamattam
- Department of Medicine, Royal Lancaster Infirmary, Lancaster, United Kingdom
| | - Kenneth Okonkwo
- Department of Medicine, Royal Lancaster Infirmary, Lancaster, United Kingdom
| | | |
Collapse
|