1
|
Chen SH, Weng KP, Hsieh KS, Chen YH, Shih JH, Li WR, Zhang RY, Chen YC, Tsai WR, Kao TY. Optimizing Object Detection Algorithms for Congenital Heart Diseases in Echocardiography: Exploring Bounding Box Sizes and Data Augmentation Techniques. Rev Cardiovasc Med 2024; 25:335. [PMID: 39355611 PMCID: PMC11440387 DOI: 10.31083/j.rcm2509335] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2024] [Revised: 07/22/2024] [Accepted: 08/01/2024] [Indexed: 10/03/2024] Open
Abstract
Background Congenital heart diseases (CHDs), particularly atrial and ventricular septal defects, pose significant health risks and common challenges in detection via echocardiography. Doctors often employ the cardiac structural information during the diagnostic process. However, prior CHD research has not determined the influence of including cardiac structural information during the labeling process and the application of data augmentation techniques. Methods This study utilizes advanced artificial intelligence (AI)-driven object detection frameworks, specifically You Look Only Once (YOLO)v5, YOLOv7, and YOLOv9, to assess the impact of including cardiac structural information and data augmentation techniques on the identification of septal defects in echocardiographic images. Results The experimental results reveal that different labeling strategies substantially affect the performance of the detection models. Notably, adjustments in bounding box dimensions and the inclusion of cardiac structural details in the annotations are key factors influencing the accuracy of the model. The application of deep learning techniques in echocardiography enhances the precision of detecting septal heart defects. Conclusions This study confirms that careful annotation of imaging data is crucial for optimizing the performance of object detection algorithms in medical imaging. These findings suggest potential pathways for refining AI applications in diagnostic cardiology studies.
Collapse
Affiliation(s)
- Shih-Hsin Chen
- Department of Computer Science and Information Engineering, Tamkang University, 251301 New Taipei, Taiwan
| | - Ken-Pen Weng
- Congenital Structural Heart Disease Center, Department of Pediatrics, Kaohsiung Veterans General Hospital, 813414 Kaohsiung, Taiwan
| | - Kai-Sheng Hsieh
- Structural/Congenital Heart Disease and Ultrasound Center, Children's Hospital, China Medical University, 404 Taichung, Taiwan
| | - Yi-Hui Chen
- Department of Information Management, Chang Gung University, 333 Taoyuan, Taiwan
- Kawasaki Disease Center, Kaohsiung Chang Gung Memorial Hospital, 83301 Kaohsiung, Taiwan
| | - Jo-Hsin Shih
- Department of Information Management, Chang Gung University, 333 Taoyuan, Taiwan
| | - Wen-Ru Li
- Department of Information Management, Chang Gung University, 333 Taoyuan, Taiwan
| | - Ru-Yi Zhang
- Department of Information Management, Chang Gung University, 333 Taoyuan, Taiwan
| | - Yun-Chiao Chen
- Department of Information Management, Chang Gung University, 333 Taoyuan, Taiwan
| | - Wan-Ru Tsai
- Department of Information Management, Chang Gung University, 333 Taoyuan, Taiwan
| | - Ting-Yi Kao
- Department of Information Management, Chang Gung University, 333 Taoyuan, Taiwan
| |
Collapse
|
2
|
Galliotto F, Veronese P, Cerutti A, Zemin F, Bertelli F, Di Salvo G, Guariento A, Vida VL. Enhancing parental understanding of congenital heart disease through personalized prenatal counseling with 3D printed hearts. Prenat Diagn 2024; 44:725-732. [PMID: 38777748 DOI: 10.1002/pd.6583] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2024] [Revised: 03/25/2024] [Accepted: 04/21/2024] [Indexed: 05/25/2024]
Abstract
OBJECTIVES In addition to a correct prenatal diagnosis of congenital heart disease (CHD), comprehensive parental counseling is crucial to ensure that parents are well-informed about the condition of the fetus. This study aims to investigate whether there is a significant difference in the information acquired by parents through traditional counseling, utilizing 2-dimensional (2D) illustrations and images, compared to an advanced approach utilizing personalized three-dimensional (3D) printed models of the fetal heart developed from 3D ultrasound imaging. METHODS This study, designed as a pilot randomized control trial, enrolled pregnant women with gestational ages greater than 18 weeks, whose fetuses were diagnosed with CHD and referred to our center between November, 2020 and June, 2021. Two groups of patients were included in the study. The first group received standard medical counseling with 2D images and illustrations, while the second group underwent advanced counseling with 3D-printed patient-specific heart models. Both groups were then required to complete the same survey in which the knowledge of the CHD was investigated. The 3D models were created from 3D ultrasound imaging and printed using resin materials in both 1:1 and 5:1 scale. RESULTS A comparison of the scores obtained from the two groups revealed that 3D visualization of the fetus's heart has the potential to increase parental knowledge about CHD and the required surgical procedures. Furthermore, all couples expressed interest in receiving a 1:1 scale model of their baby's heart. CONCLUSION Personalized prenatal counseling with 3D-ultrasound-based heart models positively impacts parents' understanding of CHD. The use of 3D models provides a more comprehensive and accessible representation of the condition, contributing to an increased knowledge gain, and potentially helping to support informed decisions regarding their child's care.
Collapse
Affiliation(s)
- Francesco Galliotto
- Pediatric Cardiac Surgery Division, Department of Cardiac, Thoracic and Vascular Sciences and Public Health, University of Padua, Padua, Italy
| | - Paola Veronese
- Maternal Fetal Medicine Division, Department of Woman and Child Health, University of Padua, Padua, Italy
| | - Alessia Cerutti
- Pediatric Cardiology Division, Department of Woman and Child Health, University of Padua, Padua, Italy
| | - Filippo Zemin
- Maternal Fetal Medicine Division, Department of Woman and Child Health, University of Padua, Padua, Italy
| | - Francesco Bertelli
- Pediatric Cardiac Surgery Division, Department of Cardiac, Thoracic and Vascular Sciences and Public Health, University of Padua, Padua, Italy
| | - Giovanni Di Salvo
- Pediatric Cardiology Division, Department of Woman and Child Health, University of Padua, Padua, Italy
| | - Alvise Guariento
- Pediatric Cardiac Surgery Division, Department of Cardiac, Thoracic and Vascular Sciences and Public Health, University of Padua, Padua, Italy
| | - Vladimiro L Vida
- Pediatric Cardiac Surgery Division, Department of Cardiac, Thoracic and Vascular Sciences and Public Health, University of Padua, Padua, Italy
| |
Collapse
|
3
|
Pozza A, Zanella L, Castaldi B, Di Salvo G. How Will Artificial Intelligence Shape the Future of Decision-Making in Congenital Heart Disease? J Clin Med 2024; 13:2996. [PMID: 38792537 PMCID: PMC11122569 DOI: 10.3390/jcm13102996] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2024] [Revised: 05/10/2024] [Accepted: 05/13/2024] [Indexed: 05/26/2024] Open
Abstract
Improvements in medical technology have significantly changed the management of congenital heart disease (CHD), offering novel tools to predict outcomes and personalize follow-up care. By using sophisticated imaging modalities, computational models and machine learning algorithms, clinicians can experiment with unprecedented insights into the complex anatomy and physiology of CHD. These tools enable early identification of high-risk patients, thus allowing timely, tailored interventions and improved outcomes. Additionally, the integration of genetic testing offers valuable prognostic information, helping in risk stratification and treatment optimisation. The birth of telemedicine platforms and remote monitoring devices facilitates customised follow-up care, enhancing patient engagement and reducing healthcare disparities. Taking into consideration challenges and ethical issues, clinicians can make the most of the full potential of artificial intelligence (AI) to further refine prognostic models, personalize care and improve long-term outcomes for patients with CHD. This narrative review aims to provide a comprehensive illustration of how AI has been implemented as a new technological method for enhancing the management of CHD.
Collapse
Affiliation(s)
- Alice Pozza
- Paediatric Cardiology Unit, Department of Women’s and Children’s Health, University of Padua, 35122 Padova, Italy; (A.P.)
| | - Luca Zanella
- Heart Surgery, Department of Medical and Surgical Sciences, University of Bologna, 40138 Bologna, Italy
- Cardiac Surgery Unit, Department of Cardiac-Thoracic-Vascular Diseases, IRCCS Azienda Ospedaliero-Universitaria di Bologna, 40138 Bologna, Italy
| | - Biagio Castaldi
- Paediatric Cardiology Unit, Department of Women’s and Children’s Health, University of Padua, 35122 Padova, Italy; (A.P.)
| | - Giovanni Di Salvo
- Paediatric Cardiology Unit, Department of Women’s and Children’s Health, University of Padua, 35122 Padova, Italy; (A.P.)
| |
Collapse
|
4
|
Zhou X, Yang T, Ruan Y, Zhang Y, Liu X, Zhao Y, Gu X, Xu X, Han J, He Y. Application of neural networks in prenatal diagnosis of atrioventricular septal defect. Transl Pediatr 2024; 13:26-37. [PMID: 38323184 PMCID: PMC10839271 DOI: 10.21037/tp-23-394] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Accepted: 12/03/2023] [Indexed: 02/08/2024] Open
Abstract
Background There is no relevant study on landmarks detection, one of the Convolutional Neural Network algorithms, in the field of fetal echocardiography (FE). This study aimed to explore whether automatic landmarks detection could be used in FE correctly and whether the atrial length (AL) to ventricular length (VL) ratio (AVLR) could be used to diagnose atrioventricular septal defect (AVSD) prenatally. Methods This was an observational study. Two hundred and seventy-eight four-chamber views in end diastole, divided into the normal, AVSD, and differential diagnosis groups, were retrospectively included in this study. Seven landmarks were labeled sequentially by the experts on these images, and all images were divided into the training and test sets for normal, AVSD, and differential diagnosis groups. U-net, MA-net, and Link-net were used as landmark prediction neural networks. The accuracy of the landmark detection, AL, and VL measurements, as well as the prenatal diagnostic effectiveness of AVLR for AVSD, was compared with the expert labeled. Results U-net, MA-net, and Link-net could detect the landmarks precisely (within the localization error of 0.09 and 0.13 on X and Y axis) and measure AL and VL accurately (the measured pixel distance error of AL and VL were 0.12 and 0.01 separately). AVLR in AVSD was greater than in other groups (P<0.0001), but the statistical difference was not obvious in the complete, partial, and transitional subgroups (P>0.05). The diagnostic effectiveness of AVLR calculated by three models, area under receiver operating characteristic curve could reach 0.992 (0.968-1.000), was consistent with the expert labeled. Conclusions U-net, Link-net, and MA-net could detect landmarks and make the measurements accurately. AVLR calculated by three neural networks could be used to make the prenatal diagnosis of AVSD.
Collapse
Affiliation(s)
- Xiaoxue Zhou
- Maternal-Fetal Consultation Center of Congenital Heart Disease, Department of Echocardiography, Beijing Anzhen Hospital, Capital Medical University, Beijing, China
| | - Tingyang Yang
- State Key Laboratory of Software Development Environment, Beihang University, Beijing, China
| | - Yanping Ruan
- Maternal-Fetal Consultation Center of Congenital Heart Disease, Department of Echocardiography, Beijing Anzhen Hospital, Capital Medical University, Beijing, China
| | - Ye Zhang
- Maternal-Fetal Consultation Center of Congenital Heart Disease, Department of Echocardiography, Beijing Anzhen Hospital, Capital Medical University, Beijing, China
| | - Xiaowei Liu
- Maternal-Fetal Consultation Center of Congenital Heart Disease, Department of Echocardiography, Beijing Anzhen Hospital, Capital Medical University, Beijing, China
| | - Ying Zhao
- Maternal-Fetal Consultation Center of Congenital Heart Disease, Department of Echocardiography, Beijing Anzhen Hospital, Capital Medical University, Beijing, China
| | - Xiaoyan Gu
- Maternal-Fetal Consultation Center of Congenital Heart Disease, Department of Echocardiography, Beijing Anzhen Hospital, Capital Medical University, Beijing, China
| | - Xinxin Xu
- Department of Ultrasound, Hebei Petrochina Central Hospital, Langfang, China
| | - Jiancheng Han
- Maternal-Fetal Consultation Center of Congenital Heart Disease, Department of Echocardiography, Beijing Anzhen Hospital, Capital Medical University, Beijing, China
| | - Yihua He
- Maternal-Fetal Consultation Center of Congenital Heart Disease, Department of Echocardiography, Beijing Anzhen Hospital, Capital Medical University, Beijing, China
| |
Collapse
|
5
|
Jost E, Kosian P, Jimenez Cruz J, Albarqouni S, Gembruch U, Strizek B, Recker F. Evolving the Era of 5D Ultrasound? A Systematic Literature Review on the Applications for Artificial Intelligence Ultrasound Imaging in Obstetrics and Gynecology. J Clin Med 2023; 12:6833. [PMID: 37959298 PMCID: PMC10649694 DOI: 10.3390/jcm12216833] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2023] [Revised: 10/17/2023] [Accepted: 10/25/2023] [Indexed: 11/15/2023] Open
Abstract
Artificial intelligence (AI) has gained prominence in medical imaging, particularly in obstetrics and gynecology (OB/GYN), where ultrasound (US) is the preferred method. It is considered cost effective and easily accessible but is time consuming and hindered by the need for specialized training. To overcome these limitations, AI models have been proposed for automated plane acquisition, anatomical measurements, and pathology detection. This study aims to overview recent literature on AI applications in OB/GYN US imaging, highlighting their benefits and limitations. For the methodology, a systematic literature search was performed in the PubMed and Cochrane Library databases. Matching abstracts were screened based on the PICOS (Participants, Intervention or Exposure, Comparison, Outcome, Study type) scheme. Articles with full text copies were distributed to the sections of OB/GYN and their research topics. As a result, this review includes 189 articles published from 1994 to 2023. Among these, 148 focus on obstetrics and 41 on gynecology. AI-assisted US applications span fetal biometry, echocardiography, or neurosonography, as well as the identification of adnexal and breast masses, and assessment of the endometrium and pelvic floor. To conclude, the applications for AI-assisted US in OB/GYN are abundant, especially in the subspecialty of obstetrics. However, while most studies focus on common application fields such as fetal biometry, this review outlines emerging and still experimental fields to promote further research.
Collapse
Affiliation(s)
- Elena Jost
- Department of Obstetrics and Gynecology, University Hospital Bonn, Venusberg Campus 1, 53127 Bonn, Germany
| | - Philipp Kosian
- Department of Obstetrics and Gynecology, University Hospital Bonn, Venusberg Campus 1, 53127 Bonn, Germany
| | - Jorge Jimenez Cruz
- Department of Obstetrics and Gynecology, University Hospital Bonn, Venusberg Campus 1, 53127 Bonn, Germany
| | - Shadi Albarqouni
- Department of Diagnostic and Interventional Radiology, University Hospital Bonn, Venusberg Campus 1, 53127 Bonn, Germany
- Helmholtz AI, Helmholtz Munich, Ingolstädter Landstraße 1, 85764 Neuherberg, Germany
| | - Ulrich Gembruch
- Department of Obstetrics and Gynecology, University Hospital Bonn, Venusberg Campus 1, 53127 Bonn, Germany
| | - Brigitte Strizek
- Department of Obstetrics and Gynecology, University Hospital Bonn, Venusberg Campus 1, 53127 Bonn, Germany
| | - Florian Recker
- Department of Obstetrics and Gynecology, University Hospital Bonn, Venusberg Campus 1, 53127 Bonn, Germany
| |
Collapse
|