1
|
Oikonomou EK, Khera R. Artificial intelligence-enhanced patient evaluation: bridging art and science. Eur Heart J 2024:ehae415. [PMID: 38976371 DOI: 10.1093/eurheartj/ehae415] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/11/2024] [Revised: 04/23/2024] [Accepted: 06/18/2024] [Indexed: 07/10/2024] Open
Abstract
The advent of digital health and artificial intelligence (AI) has promised to revolutionize clinical care, but real-world patient evaluation has yet to witness transformative changes. As history taking and physical examination continue to rely on long-established practices, a growing pipeline of AI-enhanced digital tools may soon augment the traditional clinical encounter into a data-driven process. This article presents an evidence-backed vision of how promising AI applications may enhance traditional practices, streamlining tedious tasks while elevating diverse data sources, including AI-enabled stethoscopes, cameras, and wearable sensors, to platforms for personalized medicine and efficient care delivery. Through the lens of traditional patient evaluation, we illustrate how digital technologies may soon be interwoven into routine clinical workflows, introducing a novel paradigm of longitudinal monitoring. Finally, we provide a skeptic's view on the practical, ethical, and regulatory challenges that limit the uptake of such technologies.
Collapse
Affiliation(s)
- Evangelos K Oikonomou
- Section of Cardiovascular Medicine, Department of Internal Medicine, Yale School of Medicine, 333 Cedar Street, PO Box 208017, New Haven, 06520-8017 CT, USA
| | - Rohan Khera
- Section of Cardiovascular Medicine, Department of Internal Medicine, Yale School of Medicine, 333 Cedar Street, PO Box 208017, New Haven, 06520-8017 CT, USA
- Center for Outcomes Research and Evaluation, Yale New Haven Hospital, New Haven, 195 Church St, 6th Floor, New Haven, CT 06510, USA
- Section of Biomedical Informatics and Data Science, Yale School of Medicine, 100 College Street, New Haven, 06511 CT, USA
- Section of Health Informatics, Department of Biostatistics, Yale School of Public Health, 60 College Street, New Haven, 06510 CT, USA
| |
Collapse
|
2
|
Stamate E, Piraianu AI, Ciobotaru OR, Crassas R, Duca O, Fulga A, Grigore I, Vintila V, Fulga I, Ciobotaru OC. Revolutionizing Cardiology through Artificial Intelligence-Big Data from Proactive Prevention to Precise Diagnostics and Cutting-Edge Treatment-A Comprehensive Review of the Past 5 Years. Diagnostics (Basel) 2024; 14:1103. [PMID: 38893630 PMCID: PMC11172021 DOI: 10.3390/diagnostics14111103] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2024] [Revised: 05/12/2024] [Accepted: 05/23/2024] [Indexed: 06/21/2024] Open
Abstract
BACKGROUND Artificial intelligence (AI) can radically change almost every aspect of the human experience. In the medical field, there are numerous applications of AI and subsequently, in a relatively short time, significant progress has been made. Cardiology is not immune to this trend, this fact being supported by the exponential increase in the number of publications in which the algorithms play an important role in data analysis, pattern discovery, identification of anomalies, and therapeutic decision making. Furthermore, with technological development, there have appeared new models of machine learning (ML) and deep learning (DP) that are capable of exploring various applications of AI in cardiology, including areas such as prevention, cardiovascular imaging, electrophysiology, interventional cardiology, and many others. In this sense, the present article aims to provide a general vision of the current state of AI use in cardiology. RESULTS We identified and included a subset of 200 papers directly relevant to the current research covering a wide range of applications. Thus, this paper presents AI applications in cardiovascular imaging, arithmology, clinical or emergency cardiology, cardiovascular prevention, and interventional procedures in a summarized manner. Recent studies from the highly scientific literature demonstrate the feasibility and advantages of using AI in different branches of cardiology. CONCLUSIONS The integration of AI in cardiology offers promising perspectives for increasing accuracy by decreasing the error rate and increasing efficiency in cardiovascular practice. From predicting the risk of sudden death or the ability to respond to cardiac resynchronization therapy to the diagnosis of pulmonary embolism or the early detection of valvular diseases, AI algorithms have shown their potential to mitigate human error and provide feasible solutions. At the same time, limits imposed by the small samples studied are highlighted alongside the challenges presented by ethical implementation; these relate to legal implications regarding responsibility and decision making processes, ensuring patient confidentiality and data security. All these constitute future research directions that will allow the integration of AI in the progress of cardiology.
Collapse
Affiliation(s)
- Elena Stamate
- Department of Cardiology, Emergency University Hospital of Bucharest, 050098 Bucharest, Romania; (E.S.); (V.V.)
- Faculty of Medicine and Pharmacy, University “Dunarea de Jos” of Galati, 35 AI Cuza Street, 800010 Galati, Romania; (O.D.); (A.F.); (I.G.); (I.F.); (O.C.C.)
| | - Alin-Ionut Piraianu
- Faculty of Medicine and Pharmacy, University “Dunarea de Jos” of Galati, 35 AI Cuza Street, 800010 Galati, Romania; (O.D.); (A.F.); (I.G.); (I.F.); (O.C.C.)
| | - Oana Roxana Ciobotaru
- Faculty of Medicine and Pharmacy, University “Dunarea de Jos” of Galati, 35 AI Cuza Street, 800010 Galati, Romania; (O.D.); (A.F.); (I.G.); (I.F.); (O.C.C.)
- Railway Hospital Galati, 800223 Galati, Romania
| | - Rodica Crassas
- Emergency County Hospital Braila, 810325 Braila, Romania;
| | - Oana Duca
- Faculty of Medicine and Pharmacy, University “Dunarea de Jos” of Galati, 35 AI Cuza Street, 800010 Galati, Romania; (O.D.); (A.F.); (I.G.); (I.F.); (O.C.C.)
- Emergency County Hospital Braila, 810325 Braila, Romania;
| | - Ana Fulga
- Faculty of Medicine and Pharmacy, University “Dunarea de Jos” of Galati, 35 AI Cuza Street, 800010 Galati, Romania; (O.D.); (A.F.); (I.G.); (I.F.); (O.C.C.)
- Saint Apostle Andrew Emergency County Clinical Hospital, 177 Brailei Street, 800578 Galati, Romania
| | - Ionica Grigore
- Faculty of Medicine and Pharmacy, University “Dunarea de Jos” of Galati, 35 AI Cuza Street, 800010 Galati, Romania; (O.D.); (A.F.); (I.G.); (I.F.); (O.C.C.)
- Emergency County Hospital Braila, 810325 Braila, Romania;
| | - Vlad Vintila
- Department of Cardiology, Emergency University Hospital of Bucharest, 050098 Bucharest, Romania; (E.S.); (V.V.)
- Clinical Department of Cardio-Thoracic Pathology, University of Medicine and Pharmacy “Carol Davila” Bucharest, 37 Dionisie Lupu Street, 4192910 Bucharest, Romania
| | - Iuliu Fulga
- Faculty of Medicine and Pharmacy, University “Dunarea de Jos” of Galati, 35 AI Cuza Street, 800010 Galati, Romania; (O.D.); (A.F.); (I.G.); (I.F.); (O.C.C.)
- Saint Apostle Andrew Emergency County Clinical Hospital, 177 Brailei Street, 800578 Galati, Romania
| | - Octavian Catalin Ciobotaru
- Faculty of Medicine and Pharmacy, University “Dunarea de Jos” of Galati, 35 AI Cuza Street, 800010 Galati, Romania; (O.D.); (A.F.); (I.G.); (I.F.); (O.C.C.)
- Railway Hospital Galati, 800223 Galati, Romania
| |
Collapse
|
3
|
Bruce C, Gatzoulis MA, Brida M. Digital technology and artificial intelligence for improving congenital heart disease care: alea iacta est. Eur Heart J 2024; 45:1386-1389. [PMID: 38327005 DOI: 10.1093/eurheartj/ehad898] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/09/2024] Open
Affiliation(s)
- Charo Bruce
- Adult Congenital Heart Centre and National Centre for Pulmonary Hypertension, Royal Brompton and Harefield Hospitals, Guys & St Thomas's NHS Trust, Sydney Street, London SW3 6NP, UK
| | - Michael A Gatzoulis
- Adult Congenital Heart Centre and National Centre for Pulmonary Hypertension, Royal Brompton and Harefield Hospitals, Guys & St Thomas's NHS Trust, Sydney Street, London SW3 6NP, UK
- National Heart & Lung Institute, Imperial College, South Kensington Campus, London SW7 2AZ, UK
| | - Margarita Brida
- Adult Congenital Heart Centre and National Centre for Pulmonary Hypertension, Royal Brompton and Harefield Hospitals, Guys & St Thomas's NHS Trust, Sydney Street, London SW3 6NP, UK
- National Heart & Lung Institute, Imperial College, South Kensington Campus, London SW7 2AZ, UK
- Medical Faculty University of Rijeka, Ul. Braće Branchetta 20/1, 51000 Rijeka, Croatia
| |
Collapse
|
4
|
Ejaz H, Thyyib T, Ibrahim A, Nishat A, Malay J. Role of artificial intelligence in early detection of congenital heart diseases in neonates. Front Digit Health 2024; 5:1345814. [PMID: 38274086 PMCID: PMC10808664 DOI: 10.3389/fdgth.2023.1345814] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2023] [Accepted: 12/29/2023] [Indexed: 01/27/2024] Open
Abstract
In the domain of healthcare, most importantly pediatric healthcare, the role of artificial intelligence (AI) has significantly impacted the medical field. Congenital heart diseases represent a group of heart diseases that are known to be some of the most critical cardiac conditions present at birth. These heart diseases need a swift diagnosis as well as an intervention to ensure the wellbeing of newborns. Fortunately, with the help of AI, including the highly advanced algorithms, analytics and imaging involved, it provides us with a promising era for neonatal care. This article reviewed published data in PubMed, Science Direct, UpToDate, and Google Scholar between the years 2015-2023. To conclude The use of artificial intelligence in detecting congenital heart diseases has shown great promise in improving the accuracy and efficiency of diagnosis. Several studies have demonstrated the efficacy of AI-based approaches for diagnosing congenital heart diseases, with results indicating that the systems can achieve high levels of sensitivity and specificity. In addition, AI can help reduce the workload of healthcare professionals allowing them to focus on other critical aspects of patient care. Despite the potential benefits of using AI, in addition to detecting congenital heart disease, there are still some challenges to overcome, such as the need for large amounts of high-quality data and the requirement for careful validation of the algorithms. Nevertheless, with ongoing research and development, AI is likely to become an increasingly valuable tool for improving the diagnosis and treatment of congenital heart diseases.
Collapse
Affiliation(s)
| | | | | | | | - Jhancy Malay
- Department of Pediatrics, Ras Al Khaimah Medical and Health Sciences University, Ras Al Khaimah, United Arab Emirates
| |
Collapse
|
5
|
Razvadauskas H, Vaičiukynas E, Buškus K, Arlauskas L, Nowaczyk S, Sadauskas S, Naudžiūnas A. Exploring classical machine learning for identification of pathological lung auscultations. Comput Biol Med 2024; 168:107784. [PMID: 38042100 DOI: 10.1016/j.compbiomed.2023.107784] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2023] [Revised: 11/17/2023] [Accepted: 11/28/2023] [Indexed: 12/04/2023]
Abstract
The use of machine learning in biomedical research has surged in recent years thanks to advances in devices and artificial intelligence. Our aim is to expand this body of knowledge by applying machine learning to pulmonary auscultation signals. Despite improvements in digital stethoscopes and attempts to find synergy between them and artificial intelligence, solutions for their use in clinical settings remain scarce. Physicians continue to infer initial diagnoses with less sophisticated means, resulting in low accuracy, leading to suboptimal patient care. To arrive at a correct preliminary diagnosis, the auscultation diagnostics need to be of high accuracy. Due to the large number of auscultations performed, data availability opens up opportunities for more effective sound analysis. In this study, digital 6-channel auscultations of 45 patients were used in various machine learning scenarios, with the aim of distinguishing between normal and abnormal pulmonary sounds. Audio features (such as fundamental frequencies F0-4, loudness, HNR, DFA, as well as descriptive statistics of log energy, RMS and MFCC) were extracted using the Python library Surfboard. Windowing, feature aggregation, and concatenation strategies were used to prepare data for machine learning algorithms in unsupervised (fair-cut forest, outlier forest) and supervised (random forest, regularized logistic regression) settings. The evaluation was carried out using 9-fold stratified cross-validation repeated 30 times. Decision fusion by averaging the outputs for a subject was also tested and found to be helpful. Supervised models showed a consistent advantage over unsupervised ones, with random forest achieving a mean AUC ROC of 0.691 (accuracy 71.11%, Kappa 0.416, F1-score 0.675) in side-based detection and a mean AUC ROC of 0.721 (accuracy 68.89%, Kappa 0.371, F1-score 0.650) in patient-based detection.
Collapse
|
6
|
Erno J, Gomes T, Baltimore C, Lineberger JP, Smith DH, Baker GH. Automated Identification of Patent Ductus Arteriosus Using a Computer Vision Model. JOURNAL OF ULTRASOUND IN MEDICINE : OFFICIAL JOURNAL OF THE AMERICAN INSTITUTE OF ULTRASOUND IN MEDICINE 2023; 42:2707-2713. [PMID: 37449663 DOI: 10.1002/jum.16305] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Revised: 06/12/2023] [Accepted: 06/27/2023] [Indexed: 07/18/2023]
Abstract
OBJECTIVES Patent ductus arteriosus (PDA) is a vascular defect common in preterm infants and often requires treatment to avoid associated long-term morbidities. Echocardiography is the primary tool used to diagnose and monitor PDA. We trained a deep learning model to identify PDA presence in relevant echocardiographic images. METHODS Echocardiography video clips (n = 2527) in preterm infants were reviewed by a pediatric cardiologist and those relevant to PDA diagnosis were selected and labeled (PDA present/absent/indeterminate). We trained a convolutional neural network to classify each echocardiography frame of a clip as belonging to clips with or without PDA. A novel attention mechanism that aggregated predictions for all frames in each clip to obtain a clip-level prediction by weighting relevant frames. RESULTS In early model iterations, we discovered training with color Doppler echocardiography clips produced the best performing classifier. For model training and validation, 1145 such clips from 66 patients (661 PDA+ clips, 484 PDA- clips) were used. Our best classifier for clip level performance obtained sensitivity of 0.80 (0.83-0.90), specificity of 0.77 (0.62-0.92) and AUC of 0.86 (0.83-0.90). Study level performance obtained sensitivity of 0.83 (0.72-0.94), specificity of 0.89 (0.79-1.0) and AUC of 0.93 (0.89-0.98). CONCLUSIONS Our novel deep learning model demonstrated strong performance in classifying echocardiography clips with and without PDA. Further model development and external validation are warranted. Ultimately, integration of such a classifier into auto detection software could streamline PDA imaging workflow. This work is the first step toward semi-automated, bedside detection of PDA in preterm infants.
Collapse
Affiliation(s)
- Jason Erno
- College of Medicine, Medical University of South Carolina, Charleston, South Carolina, USA
| | - Thomas Gomes
- College of Medicine, Medical University of South Carolina, Charleston, South Carolina, USA
| | - Christopher Baltimore
- College of Medicine, Medical University of South Carolina, Charleston, South Carolina, USA
| | - John P Lineberger
- Department of Electrical and Computer Engineering, Clemson University, Clemson, South Carolina, USA
| | - D Hudson Smith
- Department of Electrical and Computer Engineering, Clemson University, Clemson, South Carolina, USA
| | - G Hamilton Baker
- Department of Pediatrics, Medical University of South Carolina, Charleston, South Carolina, USA
| |
Collapse
|
7
|
Jacquemyn X, Kutty S, Manlhiot C. The Lifelong Impact of Artificial Intelligence and Clinical Prediction Models on Patients With Tetralogy of Fallot. CJC PEDIATRIC AND CONGENITAL HEART DISEASE 2023; 2:440-452. [PMID: 38161675 PMCID: PMC10755786 DOI: 10.1016/j.cjcpc.2023.08.005] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/14/2023] [Accepted: 08/24/2023] [Indexed: 01/03/2024]
Abstract
Medical advancements in the diagnosis, surgical techniques, perioperative care, and continued care throughout childhood have transformed the outlook for individuals with tetralogy of Fallot (TOF), improving survival and shifting the perspective towards lifelong care. However, with a growing population of survivors, longstanding challenges have been accentuated, and new challenges have surfaced, necessitating a re-evaluation of TOF care. Availability of prenatal diagnostics, insufficient information from traditional imaging techniques, previously unforeseen medical complications, and debates surrounding optimal timing and indications for reintervention are among the emerging issues. To address these challenges, the integration of artificial intelligence and machine learning holds great promise as they have the potential to revolutionize patient management and positively impact lifelong outcomes for individuals with TOF. Innovative applications of artificial intelligence and machine learning have spanned across multiple domains of TOF care, including screening and diagnosis, automated image processing and interpretation, clinical risk stratification, and planning and performing cardiac interventions. By embracing these advancements and incorporating them into routine clinical practice, personalized medicine could be delivered, leading to the best possible outcomes for patients. In this review, we provide an overview of these evolving applications and emphasize the challenges, limitations, and future potential for integrating them into clinical care.
Collapse
Affiliation(s)
- Xander Jacquemyn
- Blalock-Taussig-Thomas Pediatric and Congenital Heart Center, Department of Pediatrics, Johns Hopkins School of Medicine, Baltimore, Maryland, USA
- Department of Cardiovascular Sciences, KU Leuven, Leuven, Belgium
| | - Shelby Kutty
- Blalock-Taussig-Thomas Pediatric and Congenital Heart Center, Department of Pediatrics, Johns Hopkins School of Medicine, Baltimore, Maryland, USA
| | - Cedric Manlhiot
- Blalock-Taussig-Thomas Pediatric and Congenital Heart Center, Department of Pediatrics, Johns Hopkins School of Medicine, Baltimore, Maryland, USA
| |
Collapse
|
8
|
Yao A, Chou Y, Yang L, Hu L, Liu J, Gu S. Research on heart rate extraction method based on mobile phone video. Med Eng Phys 2023; 120:104051. [PMID: 37838408 DOI: 10.1016/j.medengphy.2023.104051] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2023] [Revised: 07/26/2023] [Accepted: 09/11/2023] [Indexed: 10/16/2023]
Abstract
As an important indicator of human health, heart rate is related to the diagnosis of cardiovascular diseases. In recent years, extracting the heart rate from the mobile phone image has become a research hotspot. However, the illumination intensity of the background, frame rate of the video, and resolution of the image influence heart rate detection accuracy. To overcome these problems, this study proposed a novel heart rate extraction method based on mobile video. Firstly, the mobile phone camera is engaged to record the finger video, the region of interest (ROI) is extracted through the iterative threshold, and the pulse signal is obtained according to the grayscale change of the resolution within the ROI. Then, a low-pass and a high-pass Butterworth filters are exploited to filter out the noise and interframes from the extracted pulse signal. Finally, an improved adaptive peak extraction algorithm is proposed to detect the pulse peaks and the heart rate derived from the difference in pulse peaks. The experimental results show that light intensity, frame rate and resolution all have an influence on the heart rate extraction accuracy, with the most obvious influence of light, the average accuracy of the experiment can reach 99.32 % under good lighting conditions, while only 72.23 % under poor lighting conditions. In terms of frame rate, increasing the frame rate from 30 fps to 60 fps, the accuracy is improved by 0.9 %. For the resolution, increasing the resolution from 1080 p to 2160 p, the accuracy is improved by 1.12 %. While comparing the proposed method with existing methods, the proposed method has a higher accuracy rate, which has important practical value and application prospects in telemedicine and daily monitoring.
Collapse
Affiliation(s)
- An Yao
- School of Mechanical Engineering, Yancheng Institute of Technology, Yancheng 224000, China; School of Electrical and Automatic Engineering, Changshu Institute of Technology, Suzhou 215500, China
| | - Yongxin Chou
- School of Electrical and Automatic Engineering, Changshu Institute of Technology, Suzhou 215500, China.
| | - Liming Yang
- School of Internet of Things Application Technology, Changzhou College of Information Technology, Changzhou 213164, China
| | - Linqi Hu
- School of Electrical and Automatic Engineering, Changshu Institute of Technology, Suzhou 215500, China; School of Chemical Engineering, Huaiyin Institute of Technology, Huaian 223003, China
| | - Jicheng Liu
- School of Electrical and Automatic Engineering, Changshu Institute of Technology, Suzhou 215500, China
| | - Suhang Gu
- School of Electrical and Automatic Engineering, Changshu Institute of Technology, Suzhou 215500, China
| |
Collapse
|
9
|
Ainiwaer A, Kadier K, Qin L, Rehemuding R, Ma X, Ma YT. Audiological Diagnosis of Valvular and Congenital Heart Diseases in the Era of Artificial Intelligence. Rev Cardiovasc Med 2023; 24:175. [PMID: 39077516 PMCID: PMC11264159 DOI: 10.31083/j.rcm2406175] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2023] [Revised: 04/04/2023] [Accepted: 04/10/2023] [Indexed: 07/31/2024] Open
Abstract
In recent years, electronic stethoscopes have been combined with artificial intelligence (AI) technology to digitally acquire heart sounds, intelligently identify valvular disease and congenital heart disease, and improve the accuracy of heart disease diagnosis. The research on AI-based intelligent stethoscopy technology mainly focuses on AI algorithms, and the commonly used methods are end-to-end deep learning algorithms and machine learning algorithms based on feature extraction, and the hot spot for future research is to establish a large standardized heart sound database and unify these algorithms for external validation; in addition, different electronic stethoscopes should also be extensively compared so that the algorithms can be compatible with different. In addition, there should be extensive comparison of different electronic stethoscopes so that the algorithms can be compatible with heart sounds collected by different stethoscopes; especially importantly, the deployment of algorithms in the cloud is a major trend in the future development of artificial intelligence. Finally, the research of artificial intelligence based on heart sounds is still in the preliminary stage, although there is great progress in identifying valve disease and congenital heart disease, they are all in the research of algorithm for disease diagnosis, and there is little research on disease severity, remote monitoring, prognosis, etc., which will be a hot spot for future research.
Collapse
Affiliation(s)
- Aikeliyaer Ainiwaer
- Department of Cardiology, Xinjiang Medical University Affiliated First Hospital, 830011 Urumqi, Xinjiang, China
| | - Kaisaierjiang Kadier
- Department of Cardiology, Xinjiang Medical University Affiliated First Hospital, 830011 Urumqi, Xinjiang, China
| | - Lian Qin
- Department of Cardiology, Xinjiang Medical University Affiliated First Hospital, 830011 Urumqi, Xinjiang, China
| | - Rena Rehemuding
- Department of Cardiology, Xinjiang Medical University Affiliated First Hospital, 830011 Urumqi, Xinjiang, China
| | - Xiang Ma
- Department of Cardiology, Xinjiang Medical University Affiliated First Hospital, 830011 Urumqi, Xinjiang, China
| | - Yi-Tong Ma
- Department of Cardiology, Xinjiang Medical University Affiliated First Hospital, 830011 Urumqi, Xinjiang, China
| |
Collapse
|
10
|
Body surface registration considering individual differences with non-rigid iterative closest point. Int J Comput Assist Radiol Surg 2023:10.1007/s11548-023-02842-0. [PMID: 36746880 PMCID: PMC9901834 DOI: 10.1007/s11548-023-02842-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Accepted: 01/19/2023] [Indexed: 02/08/2023]
Abstract
PURPOSE In telemedicine such as remote auscultation, patients themselves or non-medical people such as patient's parents need to place the stethoscope on their body surface in appropriate positions instead of the physicians. Meanwhile, as the position depends on the individual difference of body shape, there is a demand for the efficient navigation to place the medical equipment. METHODS In this paper, we have proposed a non-rigid iterative closest point (ICP)-based registration method for localizing the auscultation area considering the individual difference of body surface. The proposed system provides the listening position by applying the body surface registration between the patient and reference model with the specified auscultation area. Our novelty is that selecting the utilized reference model similar to the patient body among several types of the prepared reference model increases the registration accuracy. RESULTS Simulation results showed that the registration error increases due to deviations of the body shape between the targeted models and reference model. Experimental results demonstrated that the proposed non-rigid ICP registration is capable of estimating the auscultation area with average error 5-19 mm when selecting the most similar reference model. The statistical analysis showed high correlation between the registration accuracy and similarity of the utilized models. CONCLUSION The proposed non-rigid ICP registration is a promising new method that provides accurate auscultation area takes into account the individual difference of body shape. Our hypothesis that the registration accuracy depends on the similarity of both body surfaces is validated through simulation study and human trial.
Collapse
|
11
|
Tsumura R, Koseki Y, Nitta N, Yoshinaka K. Towards fully automated robotic platform for remote auscultation. Int J Med Robot 2023; 19:e2461. [PMID: 36097703 DOI: 10.1002/rcs.2461] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2021] [Revised: 02/22/2022] [Accepted: 02/24/2022] [Indexed: 01/05/2023]
Abstract
BACKGROUND Since most developed countries are facing an increase in the number of patients per healthcare worker due to a declining birth rate and an ageing population, relatively simple and safe diagnosis tasks may need to be performed using robotics and automation technologies, without specialists and hospitals. This study presents an automated robotic platform for remote auscultation, which is a highly cost-effective screening tool for detecting abnormal clinical signs. METHOD The developed robotic platform is composed of a 6-degree-of-freedom cooperative robotic arm, LiDAR camera, and a spring-based mechanism holding an electric stethoscope. The platform enables autonomous stethoscope positioning based on external body information acquired using the LiDAR camera-based multi-way registration; the platform also ensures safe and flexible contact, maintaining the contact force within a certain range through the passive-actuated mechanism. RESULTS Our preliminary results confirm that the robotic platform enables estimation of the landing positions required for cardiac examinations based on the depth and landmark information of the body surface. It also handles the stethoscope while maintaining the contact force without relying on the push-in displacement by the robotic arm. CONCLUSION The developed robotic platform enables the estimation of the landing positions and handling the stethoscope while maintaining the contact force, which promises the potential of automatic remote auscultation.
Collapse
Affiliation(s)
- Ryosuke Tsumura
- Health and Medical Research Institute, National Institute of Advanced Industrial Science and Technology, Tsukuba, Ibaraki, Japan
| | - Yoshihiko Koseki
- Health and Medical Research Institute, National Institute of Advanced Industrial Science and Technology, Tsukuba, Ibaraki, Japan
| | - Naotaka Nitta
- Health and Medical Research Institute, National Institute of Advanced Industrial Science and Technology, Tsukuba, Ibaraki, Japan
| | - Kiyoshi Yoshinaka
- Health and Medical Research Institute, National Institute of Advanced Industrial Science and Technology, Tsukuba, Ibaraki, Japan
| |
Collapse
|
12
|
Bordbar A, Kashaki M, Vafapour M, Sepehri AA. Determining the incidence of heart malformations in neonates: A novel and clinically approved solution. Front Pediatr 2023; 11:1058947. [PMID: 37009269 PMCID: PMC10050760 DOI: 10.3389/fped.2023.1058947] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Accepted: 02/27/2023] [Indexed: 04/04/2023] Open
Abstract
Background Screening for critical congenital heart defects should be performed as early as possible and is essential for saving the lives of children and reducing the incidence of undetected adult congenital heart diseases. Heart malformations remain unrecognized at birth in more than 50% of neonates at maternity hospitals. Accurate screening for congenital heart malformations is possible using a certified and internationally patented digital intelligent phonocardiography machine. This study aimed to assess the actual incidence of heart defects in neonates. A pre-evaluation of the incidence of unrecognized severe and critical congenital heart defects at birth in our well-baby nursery was also performed. Methods We conducted the Neonates Cardiac Monitoring Research Project (ethics approval number: IR-IUMS-FMD. REC.1398.098) at the Shahid Akbarabadi Maternity Hospital. This study was a retrospective analysis of congenital heart malformations observed after screening 840 neonates. Using a double-blind format, 840 neonates from the well-baby nursery were randomly chosen to undergo routine clinical examinations at birth and digital intelligent phonocardiogram examinations. A pediatric cardiologist performed echocardiography for each neonate classified as having abnormal heart sounds using an intelligent machine or during routine medical examinations. If the pediatric cardiologist requested a follow-up examination, then the neonate was considered to have a congenital heart malformation, and the cumulative incidence was calculated accordingly. Results The incidence of heart malformations in our well-baby nursery was 5%. Furthermore, 45% of heart malformations were unrecognized in neonates at birth, including one critical congenital heart defect. The intelligent machine interpreted innocent murmurs as healthy heart sound. Conclusion We accurately and cost-effectively screened for congenital heart malformations in all neonates in our hospital using a digital intelligent phonocardiogram. Using an intelligent machine, we successfully identified neonates with CCHD and congenital heart defects that could not be detected using standard medical examinations. The Pouya Heart machine can record and analyze sounds with a spectral power level lower than the minimum level of the human hearing threshold. Furthermore, by redesigning the study, the identification of previously unrecognized heart malformations could increase to 58%.
Collapse
Affiliation(s)
- Arash Bordbar
- Shahid Akbarabadi Clinical Research & Development Unit (ShACRDU), Iran University of Medical Sciences (IUMS), Tehran, Iran
| | - Mandana Kashaki
- Shahid Akbarabadi Clinical Research & Development Unit (ShACRDU), Iran University of Medical Sciences (IUMS), Tehran, Iran
| | - Maryam Vafapour
- Department of Pediatrics, Ali-Asghar Children’s Hospital, Iran University of Medical Sciences, Tehran, Iran
| | - Amir A. Sepehri
- Biomedical R&D Department, CAPIS Research and Development Co., Mons, Belgium
- Correspondence: Amir A. Sepehri
| |
Collapse
|
13
|
Clinical Modelling of RVHF Using Pre-Operative Variables: A Direct and Inverse Feature Extraction Technique. Diagnostics (Basel) 2022; 12:diagnostics12123061. [PMID: 36553067 PMCID: PMC9777038 DOI: 10.3390/diagnostics12123061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2022] [Revised: 11/23/2022] [Accepted: 12/02/2022] [Indexed: 12/12/2022] Open
Abstract
Right ventricular heart failure (RVHF) mostly occurs due to the failure of the left-side of the heart. RVHF is a serious disease that leads to swelling of the abdomen, ankles, liver, kidneys, and gastrointestinal (GI) tract. A total of 506 heart-failure subjects from the Faculty of Medicine, Cardiovascular Surgery Department, Ege University, Turkey, who suffered from a severe heart failure and are currently receiving support from a ventricular assistance device, were involved in the current study. Therefore, the current study explored the application of both the direct and inverse modelling approaches, based on the correlation analysis feature extraction performance of various pre-operative variables of the subjects, for the prediction of RVHF. The study equally employs both single and hybrid paradigms for the prediction of RVHF using different pre-operative variables. The visualized and quantitative performance of the direct and inverse modelling approach indicates the robust prediction performance of the hybrid paradigms over the single techniques in both the calibration and validation steps. Whereby, the quantitative performance of the hybrid techniques, based on the Nash-Sutcliffe coefficient (NC) metric, depicts its superiority over the single paradigms by up to 58.7%/75.5% and 80.3%/51% for the calibration/validation phases in the direct and inverse modelling approaches, respectively. Moreover, to the best knowledge of the authors, this is the first study to report the implementation of direct and inverse modelling on clinical data. The findings of the current study indicates the possibility of applying these novel hybridised paradigms for the prediction of RVHF using pre-operative variables.
Collapse
|
14
|
Sethi Y, Patel N, Kaka N, Desai A, Kaiwan O, Sheth M, Sharma R, Huang H, Chopra H, Khandaker MU, Lashin MMA, Hamd ZY, Emran TB. Artificial Intelligence in Pediatric Cardiology: A Scoping Review. J Clin Med 2022; 11:jcm11237072. [PMID: 36498651 PMCID: PMC9738645 DOI: 10.3390/jcm11237072] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2022] [Revised: 11/22/2022] [Accepted: 11/26/2022] [Indexed: 12/05/2022] Open
Abstract
The evolution of AI and data science has aided in mechanizing several aspects of medical care requiring critical thinking: diagnosis, risk stratification, and management, thus mitigating the burden of physicians and reducing the likelihood of human error. AI modalities have expanded feet to the specialty of pediatric cardiology as well. We conducted a scoping review searching the Scopus, Embase, and PubMed databases covering the recent literature between 2002-2022. We found that the use of neural networks and machine learning has significantly improved the diagnostic value of cardiac magnetic resonance imaging, echocardiograms, computer tomography scans, and electrocardiographs, thus augmenting the clinicians' diagnostic accuracy of pediatric heart diseases. The use of AI-based prediction algorithms in pediatric cardiac surgeries improves postoperative outcomes and prognosis to a great extent. Risk stratification and the prediction of treatment outcomes are feasible using the key clinical findings of each CHD with appropriate computational algorithms. Notably, AI can revolutionize prenatal prediction as well as the diagnosis of CHD using the EMR (electronic medical records) data on maternal risk factors. The use of AI in the diagnostics, risk stratification, and management of CHD in the near future is a promising possibility with current advancements in machine learning and neural networks. However, the challenges posed by the dearth of appropriate algorithms and their nascent nature, limited physician training, fear of over-mechanization, and apprehension of missing the 'human touch' limit the acceptability. Still, AI proposes to aid the clinician tomorrow with precision cardiology, paving a way for extremely efficient human-error-free health care.
Collapse
Affiliation(s)
- Yashendra Sethi
- PearResearch, Dehradun 248001, India
- Department of Medicine, Government Doon Medical College, Dehradun 248001, India
| | - Neil Patel
- PearResearch, Dehradun 248001, India
- Department of Medicine, GMERS Medical College, Himmatnagar 383001, India
| | - Nirja Kaka
- PearResearch, Dehradun 248001, India
- Department of Medicine, GMERS Medical College, Himmatnagar 383001, India
| | - Ami Desai
- Department of Medicine, SMIMER Medical College, Surat 395010, India
| | - Oroshay Kaiwan
- PearResearch, Dehradun 248001, India
- Department of Medicine, Northeast Ohio Medical University, Rootstown, OH 44272, USA
- Correspondence: (O.K.); (Z.Y.H.); (T.B.E.)
| | - Mili Sheth
- Department of Medicine, GMERS Gandhinagar, Gandhinagar 382012, India
| | - Rupal Sharma
- Department of Medicine, Government Medical College, Nagpur 440003, India
| | - Helen Huang
- Faculty of Medicine and Health Science, Royal College of Surgeons in Ireland, D02 YN77 Dublin, Ireland
| | - Hitesh Chopra
- Chitkara College of Pharmacy, Chitkara University, Rajpura 140401, India
| | - Mayeen Uddin Khandaker
- Centre for Applied Physics and Radiation Technologies, School of Engineering and Technology, Sunway University, Bandar Sunway 47500, Malaysia
| | - Maha M. A. Lashin
- Department of Biomedical Engineering, College of Engineering, Princess Nourah bint Abdulrahman University, P.O. 84428, Riyadh 11671, Saudi Arabia
| | - Zuhal Y. Hamd
- Department of Radiological Sciences, College of Health and Rehabilitation Sciences, Princess Nourah bint Abdulrahman University, P.O. 84428, Riyadh 11671, Saudi Arabia
- Correspondence: (O.K.); (Z.Y.H.); (T.B.E.)
| | - Talha Bin Emran
- Department of Pharmacy, BGC Trust University Bangladesh, Chittagong 4381, Bangladesh
- Department of Pharmacy, Faculty of Allied Health Sciences, Daffodil International University, Dhaka 1207, Bangladesh
- Correspondence: (O.K.); (Z.Y.H.); (T.B.E.)
| |
Collapse
|
15
|
Dargam V, Ng HH, Nasim S, Chaparro D, Irion CI, Seshadri SR, Barreto A, Danziger ZC, Shehadeh LA, Hutcheson JD. S2 Heart Sound Detects Aortic Valve Calcification Independent of Hemodynamic Changes in Mice. Front Cardiovasc Med 2022; 9:809301. [PMID: 35694672 PMCID: PMC9174427 DOI: 10.3389/fcvm.2022.809301] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2021] [Accepted: 03/18/2022] [Indexed: 11/16/2022] Open
Abstract
Background Calcific aortic valve disease (CAVD) is often undiagnosed in asymptomatic patients, especially in underserved populations. Although artificial intelligence has improved murmur detection in auscultation exams, murmur manifestation depends on hemodynamic factors that can be independent of aortic valve (AoV) calcium load and function. The aim of this study was to determine if the presence of AoV calcification directly influences the S2 heart sound. Methods Adult C57BL/6J mice were assigned to the following 12-week-long diets: (1) Control group (n = 11) fed a normal chow, (2) Adenine group (n = 4) fed an adenine-supplemented diet to induce chronic kidney disease (CKD), and (3) Adenine + HP (n = 9) group fed the CKD diet for 6 weeks, then supplemented with high phosphate (HP) for another 6 weeks to induce AoV calcification. Phonocardiograms, echocardiogram-based valvular function, and AoV calcification were assessed at endpoint. Results Mice on the Adenine + HP diet had detectable AoV calcification (9.28 ± 0.74% by volume). After segmentation and dimensionality reduction, S2 sounds were labeled based on the presence of disease: Healthy, CKD, or CKD + CAVD. The dataset (2,516 S2 sounds) was split subject-wise, and an ensemble learning-based algorithm was developed to classify S2 sound features. For external validation, the areas under the receiver operating characteristic curve of the algorithm to classify mice were 0.9940 for Healthy, 0.9717 for CKD, and 0.9593 for CKD + CAVD. The algorithm had a low misclassification performance of testing set S2 sounds (1.27% false positive, 1.99% false negative). Conclusion Our ensemble learning-based algorithm demonstrated the feasibility of using the S2 sound to detect the presence of AoV calcification. The S2 sound can be used as a marker to identify AoV calcification independent of hemodynamic changes observed in echocardiography.
Collapse
Affiliation(s)
- Valentina Dargam
- Department of Biomedical Engineering, Florida International University, Miami, FL, United States
| | - Hooi Hooi Ng
- Department of Biomedical Engineering, Florida International University, Miami, FL, United States
- Department of Human and Molecular Genetics, Florida International University, Miami, FL, United States
| | - Sana Nasim
- Department of Biomedical Engineering, Florida International University, Miami, FL, United States
| | - Daniel Chaparro
- Department of Biomedical Engineering, Florida International University, Miami, FL, United States
| | - Camila Iansen Irion
- Interdisciplinary Stem Cell Institute, University of Miami Miller School of Medicine, Coral Gables, FL, United States
| | - Suhas Rathna Seshadri
- Department of Medical Education, University of Miami Miller School of Medicine, Coral Gables, FL, United States
| | - Armando Barreto
- Department of Electrical and Computer Engineering, Florida International University, Miami, FL, United States
| | - Zachary C. Danziger
- Department of Biomedical Engineering, Florida International University, Miami, FL, United States
| | - Lina A. Shehadeh
- Interdisciplinary Stem Cell Institute, University of Miami Miller School of Medicine, Coral Gables, FL, United States
- Division of Cardiology, Department of Medicine, University of Miami Miller School of Medicine, Coral Gables, FL, United States
| | - Joshua D. Hutcheson
- Department of Biomedical Engineering, Florida International University, Miami, FL, United States
- Biomolecular Sciences Institute, Florida International University, Miami, FL, United States
| |
Collapse
|
16
|
Zheng Y, Guo X, Wang Y, Qin J, Lv F. A multi-scale and multi-domain heart sound feature-based machine learning model for ACC/AHA heart failure stage classification. Physiol Meas 2022; 43. [PMID: 35512699 DOI: 10.1088/1361-6579/ac6d40] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2022] [Accepted: 05/05/2022] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Heart sounds can reflect detrimental changes in cardiac mechanical activity that are common pathological characteristics of chronic heart failure (CHF). The ACC/AHA heart failure (HF) stage classification is essential for clinical decision-making and the management of CHF. Herein, a machine learning model that makes use of multi-scale and multi-domain heart sound features was proposed to provide an objective aid for ACC/AHA HF stage classification. APPROACH A dataset containing phonocardiogram (PCG) signals from 275 subjects was obtained from two medical institutions and used in this study. Complementary ensemble empirical mode decomposition and tunable-Q wavelet transform were used to construct self-adaptive sub-sequences and multi-level sub-band signals for PCG signals. Time-domain, frequency-domain and nonlinear feature extraction were then applied to the original PCG signal, heart sound sub-sequences and sub-band signals to construct multi-scale and multi-domain heart sound features. The features selected via the least absolute shrinkage and selection operator were fed into a machine learning classifier for ACC/AHA HF stage classification. Finally, mainstream machine learning classifiers, including least-squares support vector machine (LS-SVM), deep belief network (DBN) and random forest (RF), were compared to determine the optimal model. MAIN RESULTS The results showed that the LS-SVM, which utilized a combination of multi-scale and multi-domain features, achieved better classification performance than the DBN and RF using multi-scale or multi-domain features alone or together, with average sensitivity, specificity, and accuracy of 0.821, 0.955 and 0.820 on the testing set, respectively. SIGNIFICANCE PCG signal analysis provides efficient measurement information regarding CHF severity and is a promising noninvasive method for ACC/AHA HF stage classification.
Collapse
Affiliation(s)
- Yineng Zheng
- Chongqing Medical University, 1 Yixueyuan Road, Yuzhong District, Chongqing 400016, P.R.China, Chongqing, Chongqing, 400016, CHINA
| | - Xingming Guo
- Bioengineering College, Chongqing University, Chongqing 400044, Chongqing, 400044, CHINA
| | - Yingying Wang
- Chongqing Medical University, 1 Yixueyuan Road, Yuzhong District, Chongqing 400016, P.R.China, Chongqing, Chongqing, 400016, CHINA
| | - Jian Qin
- Chongqing Medical University, 1 Yixueyuan Road, Yuzhong District, Chongqing 400016, P.R.China, Chongqing, Chongqing, 400016, CHINA
| | - Fajin Lv
- Chongqing Medical University, 1 Yixueyuan Road, Yuzhong District, Chongqing 400016, P.R.China, Chongqing, 400016, CHINA
| |
Collapse
|
17
|
Transfer Learning Models for Detecting Six Categories of Phonocardiogram Recordings. J Cardiovasc Dev Dis 2022; 9:jcdd9030086. [PMID: 35323634 PMCID: PMC8951694 DOI: 10.3390/jcdd9030086] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2022] [Revised: 03/09/2022] [Accepted: 03/14/2022] [Indexed: 02/01/2023] Open
Abstract
Background and aims: Auscultation is a cheap and fundamental technique for detecting cardiovascular disease effectively. Doctors’ abilities in auscultation are varied. Sometimes, there may be cases of misdiagnosis, even when auscultation is performed by an experienced doctor. Hence, it is necessary to propose accurate computational tools to assist auscultation, especially in developing countries. Artificial intelligence technology can be an efficient diagnostic tool for detecting cardiovascular disease. This work proposed an automatic multiple classification method for cardiovascular disease detection by heart sound signals. Methods and results: In this work, a 1D heart sound signal is translated into its corresponding 3D spectrogram using continuous wavelet transform (CWT). In total, six classes of heart sound data are used in this experiment. We combine an open database (including five classes of heart sound data: aortic stenosis, mitral regurgitation, mitral stenosis, mitral valve prolapse and normal) with one class (pulmonary hypertension) of heart sound data collected by ourselves to perform the experiment. To make the method robust in a noisy environment, the background deformation technique is used before training. Then, 10 transfer learning networks (GoogleNet, SqueezeNet, DarkNet19, MobileNetv2, Inception-ResNetv2, DenseNet201, Inceptionv3, ResNet101, NasNet-Large, and Xception) are used for comparison. Furthermore, other models (LSTM and CNN) are also compared with our proposed algorithm. The experimental results show that four transfer learning networks (ResNet101, DenseNet201, DarkNet19 and GoogleNet) outperformed their peer models with an accuracy of 0.98 to detect the multiple heart diseases. The performances have been validated both in the original heart sound and the augmented heart sound using 10-fold cross validation. The results of these 10 folds are reported in this research. Conclusions: Our method obtained high classification accuracy even under a noisy background, which suggests that the proposed classification method could be used in auxiliary diagnosis for cardiovascular diseases.
Collapse
|
18
|
Wu L, Dong B, Liu X, Hong W, Chen L, Gao K, Sheng Q, Yu Y, Zhao L, Zhang Y. Standard Echocardiographic View Recognition in Diagnosis of Congenital Heart Defects in Children Using Deep Learning Based on Knowledge Distillation. Front Pediatr 2022; 9:770182. [PMID: 35118028 PMCID: PMC8805220 DOI: 10.3389/fped.2021.770182] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/03/2021] [Accepted: 12/20/2021] [Indexed: 01/10/2023] Open
Abstract
Standard echocardiographic view recognition is a prerequisite for automatic diagnosis of congenital heart defects (CHDs). This study aims to evaluate the feasibility and accuracy of standard echocardiographic view recognition in the diagnosis of CHDs in children using convolutional neural networks (CNNs). A new deep learning-based neural network method was proposed to automatically and efficiently identify commonly used standard echocardiographic views. A total of 367,571 echocardiographic image slices from 3,772 subjects were used to train and validate the proposed echocardiographic view recognition model where 23 standard echocardiographic views commonly used to diagnose CHDs in children were identified. The F1 scores of a majority of views were all ≥0.90, including subcostal sagittal/coronal view of the atrium septum, apical four-chamber view, apical five-chamber view, low parasternal four-chamber view, sax-mid, sax-basal, parasternal long-axis view of the left ventricle (PSLV), suprasternal long-axis view of the entire aortic arch, M-mode echocardiographic recording of the aortic (M-AO) and the left ventricle at the level of the papillary muscle (M-LV), Doppler recording from the mitral valve (DP-MV), the tricuspid valve (DP-TV), the ascending aorta (DP-AAO), the pulmonary valve (DP-PV), and the descending aorta (DP-DAO). This study provides a solid foundation for the subsequent use of artificial intelligence (AI) to identify CHDs in children.
Collapse
Affiliation(s)
- Lanping Wu
- Department of Pediatric Cardiology, Shanghai Children's Medical Center, School of Medicine, Shanghai Jiao Tong University, Shanghai, China
| | - Bin Dong
- Shanghai Engineering Research Center of Intelligence Pediatrics, Shanghai, China
| | - Xiaoqing Liu
- Deepwise Artificial Intelligence Laboratory, Beijing, China
| | - Wenjing Hong
- Department of Pediatric Cardiology, Shanghai Children's Medical Center, School of Medicine, Shanghai Jiao Tong University, Shanghai, China
| | - Lijun Chen
- Department of Pediatric Cardiology, Shanghai Children's Medical Center, School of Medicine, Shanghai Jiao Tong University, Shanghai, China
| | - Kunlun Gao
- Deepwise Artificial Intelligence Laboratory, Beijing, China
| | - Qiuyang Sheng
- Deepwise Artificial Intelligence Laboratory, Beijing, China
| | - Yizhou Yu
- Deepwise Artificial Intelligence Laboratory, Beijing, China
| | - Liebin Zhao
- Shanghai Engineering Research Center of Intelligence Pediatrics, Shanghai, China
| | - Yuqi Zhang
- Department of Pediatric Cardiology, Shanghai Children's Medical Center, School of Medicine, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
19
|
Van den Eynde J, Kutty S, Danford DA, Manlhiot C. Artificial intelligence in pediatric cardiology: taking baby steps in the big world of data. Curr Opin Cardiol 2022; 37:130-136. [PMID: 34857721 DOI: 10.1097/hco.0000000000000927] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
Abstract
PURPOSE OF REVIEW Artificial intelligence (AI) has changed virtually every aspect of modern life, and medicine is no exception. Pediatric cardiology is both a perceptual and a cognitive subspecialty that involves complex decision-making, so AI is a particularly attractive tool for this medical discipline. This review summarizes the foundational work and incremental progress made as AI applications have emerged in pediatric cardiology since 2020. RECENT FINDINGS AI-based algorithms can be useful for pediatric cardiology in many areas, including: (1) clinical examination and diagnosis, (2) image processing, (3) planning and management of cardiac interventions, (4) prognosis and risk stratification, (5) omics and precision medicine, and (6) fetal cardiology. Most AI initiatives showcased in medical journals seem to work well in silico, but progress toward implementation in actual clinical practice has been more limited. Several barriers to implementation are identified, some encountered throughout medicine generally, and others specific to pediatric cardiology. SUMMARY Despite barriers to acceptance in clinical practice, AI is already establishing a durable role in pediatric cardiology. Its potential remains great, but to fully realize its benefits, substantial investment to develop and refine AI for pediatric cardiology applications will be necessary to overcome the challenges of implementation.
Collapse
Affiliation(s)
- Jef Van den Eynde
- The Blalock-Taussig-Thomas Pediatric and Congenital Heart Center, Department of Pediatrics, Johns Hopkins School of Medicine, Johns Hopkins University, Baltimore, Maryland, USA
- Department of Cardiovascular Sciences, KU Leuven & Congenital and Structural Cardiology, UZ Leuven, Leuven, Belgium
| | - Shelby Kutty
- The Blalock-Taussig-Thomas Pediatric and Congenital Heart Center, Department of Pediatrics, Johns Hopkins School of Medicine, Johns Hopkins University, Baltimore, Maryland, USA
| | - David A Danford
- The Blalock-Taussig-Thomas Pediatric and Congenital Heart Center, Department of Pediatrics, Johns Hopkins School of Medicine, Johns Hopkins University, Baltimore, Maryland, USA
| | - Cedric Manlhiot
- The Blalock-Taussig-Thomas Pediatric and Congenital Heart Center, Department of Pediatrics, Johns Hopkins School of Medicine, Johns Hopkins University, Baltimore, Maryland, USA
| |
Collapse
|
20
|
Helman SM, Herrup EA, Christopher AB, Al-Zaiti SS. The role of machine learning applications in diagnosing and assessing critical and non-critical CHD: a scoping review. Cardiol Young 2021; 31:1770-1780. [PMID: 34725005 PMCID: PMC8805679 DOI: 10.1017/s1047951121004212] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Machine learning uses historical data to make predictions about new data. It has been frequently applied in healthcare to optimise diagnostic classification through discovery of hidden patterns in data that may not be obvious to clinicians. Congenital Heart Defect (CHD) machine learning research entails one of the most promising clinical applications, in which timely and accurate diagnosis is essential. The objective of this scoping review is to summarise the application and clinical utility of machine learning techniques used in paediatric cardiology research, specifically focusing on approaches aiming to optimise diagnosis and assessment of underlying CHD. Out of 50 full-text articles identified between 2015 and 2021, 40% focused on optimising the diagnosis and assessment of CHD. Deep learning and support vector machine were the most commonly used algorithms, accounting for an overall diagnostic accuracy > 0.80. Clinical applications primarily focused on the classification of auscultatory heart sounds, transthoracic echocardiograms, and cardiac MRIs. The range of these applications and directions of future research are discussed in this scoping review.
Collapse
Affiliation(s)
- Stephanie M Helman
- Department of Acute and Tertiary Care Nursing, University of Pittsburgh, Pittsburgh, PA, USA
| | - Elizabeth A Herrup
- Division of Pediatric Critical Care Medicine, UPMC Children's Hospital of Pittsburgh, Pittsburgh, PA, USA
| | - Adam B Christopher
- Division of Pediatric Cardiology, UPMC Children's Hospital of Pittsburgh, Pittsburgh, PA, USA
| | - Salah S Al-Zaiti
- Department of Acute and Tertiary Care Nursing, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Emergency Medicine, University of Pittsburgh, Pittsburgh, PA, USA
- Division of Cardiology, University of Pittsburgh, Pittsburgh, PA, USA
| |
Collapse
|
21
|
Giang KW, Helgadottir S, Dellborg M, Volpe G, Mandalenakis Z. Enhanced prediction of atrial fibrillation and mortality among patients with congenital heart disease using nationwide register-based medical hospital data and neural networks. EUROPEAN HEART JOURNAL. DIGITAL HEALTH 2021; 2:568-575. [PMID: 36713111 PMCID: PMC9707883 DOI: 10.1093/ehjdh/ztab065] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/11/2021] [Revised: 06/28/2021] [Accepted: 07/14/2021] [Indexed: 02/01/2023]
Abstract
Aims To improve short-and long-term predictions of mortality and atrial fibrillation (AF) among patients with congenital heart disease (CHD) from a nationwide population using neural networks (NN). Methods and results The Swedish National Patient Register and the Cause of Death Register were used to identify all patients with CHD born from 1970 to 2017. A total of 71 941 CHD patients were identified and followed-up from birth until the event or end of study in 2017. Based on data from a nationwide population, a NN model was obtained to predict mortality and AF. Logistic regression (LR) based on the same data was used as a baseline comparison. Of 71 941 CHD patients, a total of 5768 died (8.02%) and 995 (1.38%) developed AF over time with a mean follow-up time of 16.47 years (standard deviation 12.73 years). The performance of NN models in predicting the mortality and AF was higher than the performance of LR regardless of the complexity of the disease, with an average area under the receiver operating characteristic of >0.80 and >0.70, respectively. The largest differences were observed in mortality and complexity of CHD over time. Conclusion We found that NN can be used to predict mortality and AF on a nationwide scale using data that are easily obtainable by clinicians. In addition, NN showed a high performance overall and, in most cases, with better performance for prediction as compared with more traditional regression methods.
Collapse
Affiliation(s)
- Kok Wai Giang
- Institute of Medicine, Department of Molecular and Clinical Medicine, Sahlgrenska Academy, University of Gothenburg, Diagnosvägen 11, 416 50 Gothenburg, Sweden,Corresponding author. Tel: +46736488997,
| | - Saga Helgadottir
- Department of Physics, University of Gothenburg, Gothenburg, Sweden
| | - Mikael Dellborg
- Institute of Medicine, Department of Molecular and Clinical Medicine, Sahlgrenska Academy, University of Gothenburg, Diagnosvägen 11, 416 50 Gothenburg, Sweden,Adult Congenital Heart Unit, Department of Medicine, Sahlgrenska University Hospital/Östra, Gothenburg, Sweden
| | - Giovanni Volpe
- Department of Physics, University of Gothenburg, Gothenburg, Sweden
| | - Zacharias Mandalenakis
- Institute of Medicine, Department of Molecular and Clinical Medicine, Sahlgrenska Academy, University of Gothenburg, Diagnosvägen 11, 416 50 Gothenburg, Sweden,Adult Congenital Heart Unit, Department of Medicine, Sahlgrenska University Hospital/Östra, Gothenburg, Sweden
| |
Collapse
|
22
|
Jani V, Danford DA, Thompson WR, Schuster A, Manlhiot C, Kutty S. The discerning ear: cardiac auscultation in the era of artificial intelligence and telemedicine. EUROPEAN HEART JOURNAL. DIGITAL HEALTH 2021; 2:456-466. [PMID: 36713594 PMCID: PMC9707892 DOI: 10.1093/ehjdh/ztab059] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/21/2021] [Revised: 06/19/2021] [Indexed: 02/01/2023]
Abstract
Heart murmur, a thoracic auscultatory finding of cardiovascular origin, is extremely common in childhood and can appear at any age from premature newborn to late adolescence. The objective of this review is to provide a modern examination and update of cardiac murmur auscultation in this new era of artificial intelligence (AI) and telemedicine. First, we provide a comprehensive review of the causes and differential diagnosis, clinical features, evaluation, and long-term management of paediatric heart murmurs. Next, we provide a brief history of computer-assisted auscultation and murmur analysis, along with insight into the engineering design of the digital stethoscope. We conclude with a discussion of the paradigm shifting impact of deep learning on murmur analysis, AI-assisted auscultation, and the implications of these technologies on telemedicine in paediatric cardiology. It is our hope that this article provides an updated perspective on the impact of AI on cardiac auscultation for the modern paediatric cardiologist.
Collapse
Affiliation(s)
- Vivek Jani
- Department of Pediatrics, Blalock Taussig Thomas Heart Center, The Johns Hopkins Hospital and School of Medicine, M2315, 1800 Orleans St, Baltimore, MD 21287, USA
| | - David A Danford
- Department of Pediatrics, Blalock Taussig Thomas Heart Center, The Johns Hopkins Hospital and School of Medicine, M2315, 1800 Orleans St, Baltimore, MD 21287, USA
| | - W Reid Thompson
- Department of Pediatrics, Blalock Taussig Thomas Heart Center, The Johns Hopkins Hospital and School of Medicine, M2315, 1800 Orleans St, Baltimore, MD 21287, USA
| | - Andreas Schuster
- Department of Cardiology and Pneumology, University Medical Center Göttingen, Georg-August University, Göttingen, Germany,German Center for Cardiovascular Research (DZHK), Partner Site Göttingen, 37077 Göttingen, Germany
| | - Cedric Manlhiot
- Department of Pediatrics, Blalock Taussig Thomas Heart Center, The Johns Hopkins Hospital and School of Medicine, M2315, 1800 Orleans St, Baltimore, MD 21287, USA
| | - Shelby Kutty
- Department of Pediatrics, Blalock Taussig Thomas Heart Center, The Johns Hopkins Hospital and School of Medicine, M2315, 1800 Orleans St, Baltimore, MD 21287, USA,Corresponding author. Tel: +1 410 502 3350, Fax: +1 410 955 9897,
| |
Collapse
|
23
|
Ou Y. Can artificial intelligence-assisted auscultation become the Heimdallr for diagnosing congenital heart disease? EUROPEAN HEART JOURNAL. DIGITAL HEALTH 2021; 2:117-118. [PMID: 36711184 PMCID: PMC9708027 DOI: 10.1093/ehjdh/ztab016] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Affiliation(s)
- Yanqiu Ou
- Department of Epidemiology, Guangdong Cardiovascular Institute, Guangdong Provincial Key Laboratory of South China Structural Heart Disease, Guangdong Provincial People’s Hospital, Guangdong Academy of Medical Sciences, #96 Dongchuan Road, Guangzhou 510080, China,Corresponding author.
| |
Collapse
|