1
|
Han T, Xia W, Tao K, Wang W, Gao J, Ding X, Zhong H, Liu R, Dou S, Liu Z, Kuang H, Hua J, Xu K. Automatic stent struts detection in optical coherence tomography based on a multiple attention convolutional model. Phys Med Biol 2023; 69:015008. [PMID: 38035376 DOI: 10.1088/1361-6560/ad111c] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2023] [Accepted: 11/30/2023] [Indexed: 12/02/2023]
Abstract
Objective.Intravascular optical coherence tomography is a useful tool to assess stent adherence and dilation, thus guiding percutaneous coronary intervention and minimizing the risk of surgery. However, each pull-back OCT images may contain thousands of stent struts, which are tiny and dense, making manual stent labeling slow and costly for medical resources.Approach. This paper proposed a multiple attention convolutional model for automatic stent struts detection of OCT images. Multiple attention mechanisms were utilized to strengthen the feature extraction and feature fusion capabilities. In addition, to precisely detect tiny stent struts, the model integrated multiple anchor frames to predict targets in the output.Main results. The model was trained in 4625 frames OCT images of 37 patients and tested in 1156 frames OCT images of 9 patients, and achieved a precision of 0.9790 and a recall of 0.9541, which were significantly better than mainstream convolutional models. In terms of detection speed, the model achieved 25.2 ms per image. OCT images from different collection systems, collection times, and challenging scenarios were experimentally tested, and the model demonstrated stable robustness, achieving precision and recall higher than 0.9630. Meanwhile, clear 3D construction of the stent was achieved.Significance. In conclusion, the proposed model solves the problems of slow manual analysis and occupying a large amount of medical manpower resources. It enhances the detection efficiency of tiny and dense stent struts, thus facilitating the application of OCT quantitative analysis in real clinical scenarios.
Collapse
Affiliation(s)
- Tingting Han
- Tianjin Key Laboratory of Wireless Mobile Communications and Power Transmission, Tianjin Normal University, Tianjin 300387, People's Republic of China
| | - Wei Xia
- Tianjin Key Laboratory of Wireless Mobile Communications and Power Transmission, Tianjin Normal University, Tianjin 300387, People's Republic of China
| | - Kuiyuan Tao
- State Key Laboratory of Mechanics and Control of Mechanical Structures, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu 210016, People's Republic of China
| | - Wei Wang
- Tianjin Key Laboratory of Wireless Mobile Communications and Power Transmission, Tianjin Normal University, Tianjin 300387, People's Republic of China
| | - Jing Gao
- Tianjin Key Laboratory of Wireless Mobile Communications and Power Transmission, Tianjin Normal University, Tianjin 300387, People's Republic of China
| | - Xiaoming Ding
- Tianjin Key Laboratory of Wireless Mobile Communications and Power Transmission, Tianjin Normal University, Tianjin 300387, People's Republic of China
| | - Hongmei Zhong
- Tianjin Key Laboratory of Wireless Mobile Communications and Power Transmission, Tianjin Normal University, Tianjin 300387, People's Republic of China
| | - Ruqian Liu
- Tianjin Key Laboratory of Wireless Mobile Communications and Power Transmission, Tianjin Normal University, Tianjin 300387, People's Republic of China
| | - Shuwei Dou
- Tianjin Key Laboratory of Wireless Mobile Communications and Power Transmission, Tianjin Normal University, Tianjin 300387, People's Republic of China
| | - Zixu Liu
- Nanjing Forssmann Medical Technology Co., Nanjing, Jiangsu, 210093, People's Republic of China
| | - Hao Kuang
- Nanjing Forssmann Medical Technology Co., Nanjing, Jiangsu, 210093, People's Republic of China
| | - Jiarui Hua
- Nanjing Forssmann Medical Technology Co., Nanjing, Jiangsu, 210093, People's Republic of China
| | - Keyong Xu
- Nanjing Forssmann Medical Technology Co., Nanjing, Jiangsu, 210093, People's Republic of China
| |
Collapse
|
2
|
Sun H, Zhao C, Qin Y, Li C, Jia H, Yu B, Wang Z. In vivo detection of plaque erosion by intravascular optical coherence tomography using artificial intelligence. BIOMEDICAL OPTICS EXPRESS 2022; 13:3922-3938. [PMID: 35991920 PMCID: PMC9352282 DOI: 10.1364/boe.459623] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/29/2022] [Revised: 05/14/2022] [Accepted: 05/27/2022] [Indexed: 05/11/2023]
Abstract
Plaque erosion is one of the most common underlying mechanisms for acute coronary syndrome (ACS). Optical coherence tomography (OCT) allows in vivo diagnosis of plaque erosion. However, challenge remains due to high inter- and intra-observer variability. We developed an artificial intelligence method based on deep learning for fully automated detection of plaque erosion in vivo, which achieved a recall of 0.800 ± 0.175, a precision of 0.734 ± 0.254, and an area under the precision-recall curve (AUC) of 0.707. Our proposed method is in good agreement with physicians, and can help improve the clinical diagnosis of plaque erosion and develop individualized treatment strategies for optimal management of ACS patients.
Collapse
Affiliation(s)
- Haoyue Sun
- School of Electronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu, China
- Contributed equally
| | - Chen Zhao
- Department of Cardiology, The 2nd Affiliated Hospital of Harbin Medical University, Harbin, China
- The Key Laboratory of Medical Ischemia, Chinese Ministry of Education, Harbin, China
- Contributed equally
| | - Yuhan Qin
- Department of Cardiology, The 2nd Affiliated Hospital of Harbin Medical University, Harbin, China
- The Key Laboratory of Medical Ischemia, Chinese Ministry of Education, Harbin, China
| | - Chao Li
- School of Electronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu, China
| | - Haibo Jia
- Department of Cardiology, The 2nd Affiliated Hospital of Harbin Medical University, Harbin, China
- The Key Laboratory of Medical Ischemia, Chinese Ministry of Education, Harbin, China
| | - Bo Yu
- Department of Cardiology, The 2nd Affiliated Hospital of Harbin Medical University, Harbin, China
- The Key Laboratory of Medical Ischemia, Chinese Ministry of Education, Harbin, China
| | - Zhao Wang
- School of Electronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu, China
| |
Collapse
|