1
|
Yang X, Liu L, Yan Z, Yu J, Hu X, Yu X, Dong C, Chen J, Liu H, Yu Z, Deng X, Ni D, Gou Z, Huang X. Hierarchical online contrastive anomaly detection for fetal arrhythmia diagnosis in ultrasound. Med Image Anal 2024; 97:103229. [PMID: 38897033 DOI: 10.1016/j.media.2024.103229] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2023] [Revised: 03/10/2024] [Accepted: 06/03/2024] [Indexed: 06/21/2024]
Abstract
Arrhythmia is a major cardiac abnormality in fetuses. Therefore, early diagnosis of arrhythmia is clinically crucial. Pulsed-wave Doppler ultrasound is a commonly used diagnostic tool for fetal arrhythmia. Its key step for diagnosis involves identifying adjacent measurable cardiac cycles (MCCs). As cardiac activity is complex and the experience of sonographers is often varied, automation can improve user-independence and diagnostic-validity. However, arrhythmias pose several challenges for automation because of complex waveform variations, which can cause major localization bias and missed or false detection of MCCs. Filtering out non-MCC anomalies is difficult because of large intra-class and small inter-class variations between MCCs and non-MCCs caused by agnostic morphological waveform variations. Moreover, rare arrhythmia cases are insufficient for classification algorithms to adequately learn discriminative features. Using only normal cases for training, we propose a novel hierarchical online contrastive anomaly detection (HOCAD) framework for arrhythmia diagnosis during test time. The contribution of this study is three-fold. First, we develop a coarse-to-fine framework inspired by hierarchical diagnostic logic, which can refine localization and avoid missed detection of MCCs. Second, we propose an online learning-based contrastive anomaly detection with two new anomaly scores, which can adaptively filter out non-MCC anomalies on a single image during testing. With these complementary efforts, we precisely determine MCCs for correct measurements and diagnosis. Third, to the best of our knowledge, this is the first reported study investigating intelligent diagnosis of fetal arrhythmia on a large-scale and multi-center ultrasound dataset. Extensive experiments on 3850 cases, including 266 cases covering three typical types of arrhythmias, demonstrate the effectiveness of the proposed framework.
Collapse
Affiliation(s)
- Xin Yang
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China, Shenzhen, China; Medical Ultrasound Image Computing (MUSIC) Laboratory, Shenzhen University, Shenzhen, China
| | - Lian Liu
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China, Shenzhen, China; Medical Ultrasound Image Computing (MUSIC) Laboratory, Shenzhen University, Shenzhen, China
| | - Zhongnuo Yan
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China, Shenzhen, China; Medical Ultrasound Image Computing (MUSIC) Laboratory, Shenzhen University, Shenzhen, China
| | - Junxuan Yu
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China, Shenzhen, China; Medical Ultrasound Image Computing (MUSIC) Laboratory, Shenzhen University, Shenzhen, China
| | - Xindi Hu
- Shenzhen RayShape Medical Technology Co., Ltd, Shenzhen, Guangdong, China
| | - Xuejuan Yu
- Department of Ultrasonography, Suzhou Xiangcheng People's Hospital, Suzhou, Jiangsu, China
| | - Caixia Dong
- Department of Ultrasonography, Wulin Hospital, Hangzhou, Zhejiang, China
| | - Ju Chen
- Department of Ultrasonography, Taicang First People's Hospital, Suzhou, Jiangsu, China
| | - Hongmei Liu
- Department of Ultrasonography, Panzhou Emerging Hospital, Panzhou, Guizhou, China
| | - Zhuan Yu
- Department of Ultrasonography, The Affiliated Hospital of Jiangsu University, Zhenjiang, Jiangsu, China
| | - Xuedong Deng
- Center for Medical Ultrasound, The Affiliated Suzhou Hospital of Nanjing Medical University, Suzhou Municipal Hospital, Gusu School, Nanjing Medical University, Suzhou, Jiangsu, China
| | - Dong Ni
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China, Shenzhen, China; Medical Ultrasound Image Computing (MUSIC) Laboratory, Shenzhen University, Shenzhen, China
| | - Zhongshan Gou
- Center for Cardiovascular Disease, The Affiliated Suzhou Hospital of Nanjing Medical University, Suzhou Municipal Hospital, Gusu School, Nanjing Medical University, Suzhou, Jiangsu, China.
| | - Xiaoqiong Huang
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China, Shenzhen, China; Medical Ultrasound Image Computing (MUSIC) Laboratory, Shenzhen University, Shenzhen, China.
| |
Collapse
|
2
|
Yang X, Huang X, Wei C, Yu J, Yu X, Dong C, Chen J, Chen R, Wu X, Yu Z, Sun B, Wang J, Liu H, Han W, Sun B, Jiang Z, Ding J, Liu Z, Peng J, Ni D, Deng X, Liu L, Gou Z. An intelligent quantification system for fetal heart rhythm assessment: A multicenter prospective study. Heart Rhythm 2024; 21:600-609. [PMID: 38266752 DOI: 10.1016/j.hrthm.2024.01.024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/25/2023] [Revised: 01/04/2024] [Accepted: 01/15/2024] [Indexed: 01/26/2024]
Abstract
BACKGROUND The motion relationship and time intervals of the pulsed-wave Doppler (PWD) spectrum are essential for diagnosing fetal arrhythmia. However, few technologies currently are available to automatically calculate fetal cardiac time intervals (CTIs). OBJECTIVE The purpose of this study was to develop a fetal heart rhythm intelligent quantification system (HR-IQS) for the automatic extraction of CTIs and establish the normal reference range for fetal CTIs. METHODS A total of 6498 PWD spectrums of 2630 fetuses over the junction between the left ventricular inflow and outflow tracts were recorded across 14 centers. E, A, and V waves were manually labeled by 3 experienced fetal cardiologists, with 17 CTIs extracted. Five-fold cross-validation was performed for training and testing of the deep learning model. Agreement between the manual and HR-IQS-based values was evaluated using the intraclass correlation coefficient and Spearman's rank correlation coefficient. The Jarque-Bera test was applied to evaluate the normality of CTIs' distributions, and the normal reference range of 17 CTIs was established with quantile regression. Arrhythmia subset was compared with the non-arrhythmia subset using the Mann-Whitney U test. RESULTS Significant positive correlation (P <.001) and moderate-to-excellent consistency (P <.001) between the manual and HR-IQS automated measurements of CTIs was found. The distribution of CTIs was non-normal (P <.001). The normal range (2.5th to 97.5th percentiles) was successfully established for the 17 CTIs. CONCLUSIONS Using our HR-IQS is feasible for the automated calculation of CTIs in practice and thus could provide a promising tool for the assessment of fetal rhythm and function.
Collapse
Affiliation(s)
- Xin Yang
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, Guangdong, China
| | - Xiaoqiong Huang
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, Guangdong, China
| | - Chenchen Wei
- Center for Cardiovascular Disease, The Affiliated Suzhou Hospital of Nanjing Medical University, Suzhou, Jiangsu, China
| | - Junxuan Yu
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, Guangdong, China; Shenzhen RayShape Medical Technology Co., Ltd, Shenzhen, Guangdong, China
| | - Xuejuan Yu
- Department of Ultrasonography, Suzhou Xiangcheng People's Hospital, Suzhou, Jiangsu, China
| | - Caixia Dong
- Department of Ultrasonography, Wulin Hospital, Hangzhou, Zhejiang, China
| | - Ju Chen
- Department of Ultrasonography, Taicang First People's Hospital, Suzhou, Jiangsu, China
| | - Ruifeng Chen
- Department of Ultrasound Diagnosis, The Affiliated Changsha Central Hospital, Hengyang Medical School, University of South China, Changsha, Hunan, China
| | - Xiafang Wu
- Department of Ultrasonography, Taizhou Hospital of Zhejiang Province Affiliated to Wenzhou Medical University, Linhai, Zhejiang, China
| | - Zhuan Yu
- Department of Ultrasonography, The Affiliated Hospital of Jiangsu University, Zhenjiang, Jiangsu, China
| | - Baojuan Sun
- Department of Ultrasonography, Huai'an Maternal and Child Health Hospital, Huai'an, Jiangsu, China
| | - Junli Wang
- Department of Ultrasonography, Wuhu No.2 People's Hospital, Wuhu, Anhui, China
| | - Hongmei Liu
- Department of Ultrasonography, Panzhou Emerging Hospital, Panzhou, Guizhou, China
| | - Wen Han
- Department of Ultrasonography, Suzhou Gaoxin District People's Hospital, Suzhou, Jiangsu, China
| | - Biyun Sun
- Department of Ultrasonography, The Affiliated Yijishan Hospital of Wannan Medical University, Wuhu, Anhui, China
| | - Zhiyong Jiang
- Department of Ultrasonography, The Huaren Hospital, Wuhu, Zhejiang, China
| | - Jie Ding
- Department of Ultrasonography, The Affiliated Suzhou Hospital of Nanjing University, Suzhou, Jiangsu, China
| | - Zhe Liu
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, Guangdong, China; Shenzhen RayShape Medical Technology Co., Ltd, Shenzhen, Guangdong, China
| | - Jin Peng
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, Guangdong, China; Shenzhen RayShape Medical Technology Co., Ltd, Shenzhen, Guangdong, China
| | - Dong Ni
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, Guangdong, China
| | - Xuedong Deng
- Center for Medical Ultrasound, The Affiliated Suzhou Hospital of Nanjing Medical University, Suzhou, Jiangsu, China
| | - Lian Liu
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, Guangdong, China; Shenzhen RayShape Medical Technology Co., Ltd, Shenzhen, Guangdong, China.
| | - Zhongshan Gou
- Center for Cardiovascular Disease, The Affiliated Suzhou Hospital of Nanjing Medical University, Suzhou, Jiangsu, China.
| |
Collapse
|
3
|
Kim HY, Cho GJ, Kwon HS. Applications of artificial intelligence in obstetrics. Ultrasonography 2023; 42:2-9. [PMID: 36588179 PMCID: PMC9816710 DOI: 10.14366/usg.22063] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2022] [Accepted: 06/20/2022] [Indexed: 01/13/2023] Open
Abstract
Artificial intelligence, which has been applied as an innovative technology in multiple fields of healthcare, analyzes large amounts of data to assist in disease prediction, prevention, and diagnosis, as well as in patient monitoring. In obstetrics, artificial intelligence has been actively applied and integrated into our daily medical practice. This review provides an overview of artificial intelligence systems currently used for obstetric diagnostic purposes, such as fetal cardiotocography, ultrasonography, and magnetic resonance imaging, and demonstrates how these methods have been developed and clinically applied.
Collapse
Affiliation(s)
- Ho Yeon Kim
- Department of Obstetrics and Gynecology, Korea University College of Medicine, Seoul, Korea
| | - Geum Joon Cho
- Department of Obstetrics and Gynecology, Korea University College of Medicine, Seoul, Korea,Correspondence to: Geum Joon Cho, MD, PhD, Department of Obstetrics and Gynecology, Korea University Guro Hospital, Korea University College of Medicine, 148 Gurodong-ro, Guro-gu, Seoul 08308, Korea Tel. +82-2-2626-3141 Fax. +82-2-838-1560 E-mail:
| | - Han Sung Kwon
- Division of Maternal and Fetal Medicine, Department of Obstetrics and Gynecology, Research Institute of Medical Science, Konkuk University School of Medicine, Seoul, Korea
| |
Collapse
|