1
|
Huang X, Bajaj R, Li Y, Ye X, Lin J, Pugliese F, Ramasamy A, Gu Y, Wang Y, Torii R, Dijkstra J, Zhou H, Bourantas CV, Zhang Q. POST-IVUS: A perceptual organisation-aware selective transformer framework for intravascular ultrasound segmentation. Med Image Anal 2023; 89:102922. [PMID: 37598605 DOI: 10.1016/j.media.2023.102922] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2022] [Revised: 07/06/2023] [Accepted: 08/01/2023] [Indexed: 08/22/2023]
Abstract
Intravascular ultrasound (IVUS) is recommended in guiding coronary intervention. The segmentation of coronary lumen and external elastic membrane (EEM) borders in IVUS images is a key step, but the manual process is time-consuming and error-prone, and suffers from inter-observer variability. In this paper, we propose a novel perceptual organisation-aware selective transformer framework that can achieve accurate and robust segmentation of the vessel walls in IVUS images. In this framework, temporal context-based feature encoders extract efficient motion features of vessels. Then, a perceptual organisation-aware selective transformer module is proposed to extract accurate boundary information, supervised by a dedicated boundary loss. The obtained EEM and lumen segmentation results will be fused in a temporal constraining and fusion module, to determine the most likely correct boundaries with robustness to morphology. Our proposed methods are extensively evaluated in non-selected IVUS sequences, including normal, bifurcated, and calcified vessels with shadow artifacts. The results show that the proposed methods outperform the state-of-the-art, with a Jaccard measure of 0.92 for lumen and 0.94 for EEM on the IVUS 2011 open challenge dataset. This work has been integrated into a software QCU-CMS2 to automatically segment IVUS images in a user-friendly environment.
Collapse
Affiliation(s)
- Xingru Huang
- School of Electronic Engineering and Computer Science, Queen Mary University of London, London, E3 4BL, UK; School of Communication Engineering, Hangzhou Dianzi University, Xiasha Higher Education Zone, Hangzhou, Zhejiang, China
| | - Retesh Bajaj
- Department of Cardiology, Barts Heart Centre, Barts Health NHS Trust, West Smithfield, London, EC1A 7BE, UK; Centre for Cardiovascular Medicine and Devices, William Harvey Research Institute, Queen Mary University of London, London, UK
| | - Yilong Li
- School of Electronic Engineering and Computer Science, Queen Mary University of London, London, E3 4BL, UK
| | - Xin Ye
- Zhejiang Provincial People's Hospital, 270 West Xueyuan Road, Wenzhou, Zhejiang, China
| | - Ji Lin
- School of Electronic Engineering and Computer Science, Queen Mary University of London, London, E3 4BL, UK
| | - Francesca Pugliese
- Department of Cardiology, Barts Heart Centre, Barts Health NHS Trust, West Smithfield, London, EC1A 7BE, UK; Centre for Cardiovascular Medicine and Devices, William Harvey Research Institute, Queen Mary University of London, London, UK
| | - Anantharaman Ramasamy
- Department of Cardiology, Barts Heart Centre, Barts Health NHS Trust, West Smithfield, London, EC1A 7BE, UK; Centre for Cardiovascular Medicine and Devices, William Harvey Research Institute, Queen Mary University of London, London, UK
| | - Yue Gu
- Zhejiang Institute of Mechanical and Electrical Engineering, Hangzhou, China
| | - Yaqi Wang
- College of Media Engineering, Communication University of Zhejiang, Hangzhou, China
| | - Ryo Torii
- Department of Mechanical Engineering, University College London, London, UK
| | | | - Huiyu Zhou
- School of Informatics, University of Leicester, University Road, Leicester, LE1 7RH, United Kingdom
| | - Christos V Bourantas
- Department of Cardiology, Barts Heart Centre, Barts Health NHS Trust, West Smithfield, London, EC1A 7BE, UK; Centre for Cardiovascular Medicine and Devices, William Harvey Research Institute, Queen Mary University of London, London, UK
| | - Qianni Zhang
- School of Electronic Engineering and Computer Science, Queen Mary University of London, London, E3 4BL, UK.
| |
Collapse
|
2
|
Athanasiou L, Sakellarios AI, Bourantas CV, Tsirka G, Siogkas P, Exarchos TP, Naka KK, Michalis LK, Fotiadis DI. Currently available methodologies for the processing of intravascular ultrasound and optical coherence tomography images. Expert Rev Cardiovasc Ther 2015; 12:885-900. [PMID: 24949801 DOI: 10.1586/14779072.2014.922413] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Optical coherence tomography and intravascular ultrasound are the most widely used methodologies in clinical practice as they provide high resolution cross-sectional images that allow comprehensive visualization of the lumen and plaque morphology. Several methods have been developed in recent years to process the output of these imaging modalities, which allow fast, reliable and reproducible detection of the luminal borders and characterization of plaque composition. These methods have proven useful in the study of the atherosclerotic process as they have facilitated analysis of a vast amount of data. This review presents currently available intravascular ultrasound and optical coherence tomography processing methodologies for segmenting and characterizing the plaque area, highlighting their advantages and disadvantages, and discusses the future trends in intravascular imaging.
Collapse
Affiliation(s)
- Lambros Athanasiou
- Unit of Medical Technology and Intelligent Information Systems, Department of Materials Science and Engineering, University of Ioannina, GR 45110 Ioannina, Greece
| | | | | | | | | | | | | | | | | |
Collapse
|
3
|
Standardized evaluation methodology and reference database for evaluating IVUS image segmentation. Comput Med Imaging Graph 2013; 38:70-90. [PMID: 24012215 DOI: 10.1016/j.compmedimag.2013.07.001] [Citation(s) in RCA: 86] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2012] [Revised: 03/15/2013] [Accepted: 07/01/2013] [Indexed: 11/21/2022]
Abstract
This paper describes an evaluation framework that allows a standardized and quantitative comparison of IVUS lumen and media segmentation algorithms. This framework has been introduced at the MICCAI 2011 Computing and Visualization for (Intra)Vascular Imaging (CVII) workshop, comparing the results of eight teams that participated. We describe the available data-base comprising of multi-center, multi-vendor and multi-frequency IVUS datasets, their acquisition, the creation of the reference standard and the evaluation measures. The approaches address segmentation of the lumen, the media, or both borders; semi- or fully-automatic operation; and 2-D vs. 3-D methodology. Three performance measures for quantitative analysis have been proposed. The results of the evaluation indicate that segmentation of the vessel lumen and media is possible with an accuracy that is comparable to manual annotation when semi-automatic methods are used, as well as encouraging results can be obtained also in case of fully-automatic segmentation. The analysis performed in this paper also highlights the challenges in IVUS segmentation that remains to be solved.
Collapse
|
4
|
Ciompi F, Pujol O, Gatta C, Alberti M, Balocco S, Carrillo X, Mauri-Ferre J, Radeva P. HoliMAb: A holistic approach for Media–Adventitia border detection in intravascular ultrasound. Med Image Anal 2012; 16:1085-100. [DOI: 10.1016/j.media.2012.06.008] [Citation(s) in RCA: 31] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2011] [Revised: 06/14/2012] [Accepted: 06/18/2012] [Indexed: 10/28/2022]
|