1
|
Yang C, Li B, Xiao Q, Bai Y, Li Y, Li Z, Li H, Li H. LA-Net: layer attention network for 3D-to-2D retinal vessel segmentation in OCTA images. Phys Med Biol 2024; 69:045019. [PMID: 38237179 DOI: 10.1088/1361-6560/ad2011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Accepted: 01/18/2024] [Indexed: 02/10/2024]
Abstract
Objective.Retinal vessel segmentation from optical coherence tomography angiography (OCTA) volumes is significant in analyzing blood supply structures and the diagnosing ophthalmic diseases. However, accurate retinal vessel segmentation in 3D OCTA remains challenging due to the interference of choroidal blood flow signals and the variations in retinal vessel structure.Approach.This paper proposes a layer attention network (LA-Net) for 3D-to-2D retinal vessel segmentation. The network comprises a 3D projection path and a 2D segmentation path. The key component in the 3D path is the proposed multi-scale layer attention module, which effectively learns the layer features of OCT and OCTA to attend to the retinal vessel layer while suppressing the choroidal vessel layer. This module also efficiently captures 3D multi-scale information for improved semantic understanding during projection. In the 2D path, a reverse boundary attention module is introduced to explore and preserve boundary and shape features of retinal vessels by focusing on non-salient regions in deep features.Main results.Experimental results in two subsets of the OCTA-500 dataset showed that our method achieves advanced segmentation performance with Dice similarity coefficients of 93.04% and 89.74%, respectively.Significance.The proposed network provides reliable 3D-to-2D segmentation of retinal vessels, with potential for application in various segmentation tasks that involve projecting the input image. Implementation code:https://github.com/y8421036/LA-Net.
Collapse
Affiliation(s)
- Chaozhi Yang
- College of Computer Science and Technology, China University of Petroleum (East China), Qingdao 266580, People's Republic of China
| | - Bei Li
- Beijing Hospital, Institute of Geriatric Medicine, Chinese Academy of Medical Science, Beijing 100730, People's Republic of China
| | - Qian Xiao
- College of Computer Science and Technology, China University of Petroleum (East China), Qingdao 266580, People's Republic of China
| | - Yun Bai
- College of Computer Science and Technology, China University of Petroleum (East China), Qingdao 266580, People's Republic of China
| | - Yachuan Li
- College of Computer Science and Technology, China University of Petroleum (East China), Qingdao 266580, People's Republic of China
| | - Zongmin Li
- College of Computer Science and Technology, China University of Petroleum (East China), Qingdao 266580, People's Republic of China
| | - Hongyi Li
- Beijing Hospital, Institute of Geriatric Medicine, Chinese Academy of Medical Science, Beijing 100730, People's Republic of China
| | - Hua Li
- Key Laboratory of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, People's Republic of China
| |
Collapse
|
2
|
Shi F, Cheng X, Feng S, Yang C, Diao S, Zhu W, Xiang D, Chen Q, Xu X, Chen X, Fan Y. Group-wise context selection network for choroid segmentation in optical coherence tomography. Phys Med Biol 2021; 66. [PMID: 34787107 DOI: 10.1088/1361-6560/ac3a23] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2021] [Accepted: 11/16/2021] [Indexed: 11/11/2022]
Abstract
Choroid thickness measured from optical coherence tomography (OCT) images has emerged as a vital metric in the management of retinal diseases such as high myopia. In this paper, we propose a novel group-wise context selection network (referred to as GCS-Net) to segment the choroid of either normal or high myopia eyes. To deal with the diverse choroid thickness and the variable shape of the pathological retina, GCS-Net adopts the group-wise channel dilation (GCD) module and the group-wise spatial dilation module, which can automatically select group-wise multi-scale information under the guidance of channel attention or spatial attention, and enhance the consistency between the receptive field and the target area. Furthermore, a boundary optimization network with a new edge loss is incorporated to improve the resulting choroid boundary by deep supervision. Experimental results evaluated on a dataset composed of 1650 clinically obtained OCT B-scans show that the proposed GCS-Net can achieve a Dice similarity coefficient of 95.97 ± 0.54%, which outperforms some state-of-the-art segmentation networks.
Collapse
Affiliation(s)
- Fei Shi
- MIPAV Lab, the School of Electronics and Information Engineering, Soochow University, Suzhou 215006, People's Republic of China
| | - Xuena Cheng
- MIPAV Lab, the School of Electronics and Information Engineering, Soochow University, Suzhou 215006, People's Republic of China
| | - Shuanglang Feng
- MIPAV Lab, the School of Electronics and Information Engineering, Soochow University, Suzhou 215006, People's Republic of China
| | - Changqing Yang
- MIPAV Lab, the School of Electronics and Information Engineering, Soochow University, Suzhou 215006, People's Republic of China
| | - Shengyong Diao
- MIPAV Lab, the School of Electronics and Information Engineering, Soochow University, Suzhou 215006, People's Republic of China
| | - Weifang Zhu
- MIPAV Lab, the School of Electronics and Information Engineering, Soochow University, Suzhou 215006, People's Republic of China
| | - Dehui Xiang
- MIPAV Lab, the School of Electronics and Information Engineering, Soochow University, Suzhou 215006, People's Republic of China
| | - Qiuying Chen
- The First People's Hospital Affiliated to Shanghai Jiao Tong University, Shanghai 200080, People's Republic of China
| | - Xun Xu
- The First People's Hospital Affiliated to Shanghai Jiao Tong University, Shanghai 200080, People's Republic of China
| | - Xinjian Chen
- MIPAV Lab, the School of Electronics and Information Engineering, Soochow University, Suzhou 215006, People's Republic of China.,The State Key Laboratory of Radiation Medicine and Protection, Soochow University, Suzhou 215123, People's Republic of China
| | - Ying Fan
- The First People's Hospital Affiliated to Shanghai Jiao Tong University, Shanghai 200080, People's Republic of China
| |
Collapse
|
3
|
Zhang L, Xiang D, Jin C, Shi F, Yu K, Chen X. OIPAV: an Integrated Software System for Ophthalmic Image Processing, Analysis, and Visualization. J Digit Imaging 2018; 32:183-197. [PMID: 30187316 DOI: 10.1007/s10278-017-0047-6] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022] Open
Abstract
Ophthalmic medical images, such as optical coherence tomography (OCT) images and color photo of fundus, provide valuable information for clinical diagnosis and treatment of ophthalmic diseases. In this paper, we introduce a software system specially oriented to ophthalmic images processing, analysis, and visualization (OIPAV) to assist users. OIPAV is a cross-platform system built on a set of powerful and widely used toolkit libraries. Based on the plugin mechanism, the system has an extensible framework. It provides rich functionalities including data I/O, image processing, interaction, ophthalmic diseases detection, data analysis, and visualization. By using OIPAV, users can easily access to the ophthalmic image data manufactured from different imaging devices, facilitate workflows of processing ophthalmic images, and improve quantitative evaluations. With a satisfying function scalability and expandability, the software is applicable for both ophthalmic researchers and clinicians.
Collapse
Affiliation(s)
- Lichun Zhang
- School of Electronics and Information Engineering, Soochow University, No.1 Shizi Street, Suzhou, Jiangsu Province, 215006, China
| | - Dehui Xiang
- School of Electronics and Information Engineering, Soochow University, No.1 Shizi Street, Suzhou, Jiangsu Province, 215006, China
| | - Chao Jin
- School of Electronics and Information Engineering, Soochow University, No.1 Shizi Street, Suzhou, Jiangsu Province, 215006, China
| | - Fei Shi
- School of Electronics and Information Engineering, Soochow University, No.1 Shizi Street, Suzhou, Jiangsu Province, 215006, China
| | - Kai Yu
- School of Electronics and Information Engineering, Soochow University, No.1 Shizi Street, Suzhou, Jiangsu Province, 215006, China
| | - Xinjian Chen
- School of Electronics and Information Engineering, Soochow University, No.1 Shizi Street, Suzhou, Jiangsu Province, 215006, China.
| |
Collapse
|
4
|
Yu K, Shi F, Gao E, Zhu W, Chen H, Chen X. Shared-hole graph search with adaptive constraints for 3D optic nerve head optical coherence tomography image segmentation. BIOMEDICAL OPTICS EXPRESS 2018; 9:962-983. [PMID: 29541497 PMCID: PMC5846542 DOI: 10.1364/boe.9.000962] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/13/2017] [Revised: 01/08/2018] [Accepted: 01/23/2018] [Indexed: 05/18/2023]
Abstract
Optic nerve head (ONH) is a crucial region for glaucoma detection and tracking based on spectral domain optical coherence tomography (SD-OCT) images. In this region, the existence of a "hole" structure makes retinal layer segmentation and analysis very challenging. To improve retinal layer segmentation, we propose a 3D method for ONH centered SD-OCT image segmentation, which is based on a modified graph search algorithm with a shared-hole and locally adaptive constraints. With the proposed method, both the optic disc boundary and nine retinal surfaces can be accurately segmented in SD-OCT images. An overall mean unsigned border positioning error of 7.27 ± 5.40 µm was achieved for layer segmentation, and a mean Dice coefficient of 0.925 ± 0.03 was achieved for optic disc region detection.
Collapse
Affiliation(s)
- Kai Yu
- School of Electronic and Information Engineering, Soochow University, Suzhou 215006, China
- Indicates these authors contributed equally
| | - Fei Shi
- School of Electronic and Information Engineering, Soochow University, Suzhou 215006, China
- Indicates these authors contributed equally
| | - Enting Gao
- School of Electronic and Information Engineering, Soochow University, Suzhou 215006, China
| | - Weifang Zhu
- School of Electronic and Information Engineering, Soochow University, Suzhou 215006, China
| | - Haoyu Chen
- Joint Shantou International Eye Center, Shantou University and the Chinese University of Hong Kong, Shantou 515041, China
| | - Xinjian Chen
- School of Electronic and Information Engineering, Soochow University, Suzhou 215006, China
- corresponding author:
| |
Collapse
|
5
|
Zhu W, Zhang L, Shi F, Xiang D, Wang L, Guo J, Yang X, Chen H, Chen X. Automated framework for intraretinal cystoid macular edema segmentation in three-dimensional optical coherence tomography images with macular hole. JOURNAL OF BIOMEDICAL OPTICS 2017; 22:76014. [PMID: 28732095 DOI: 10.1117/1.jbo.22.7.076014] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/11/2017] [Accepted: 07/05/2017] [Indexed: 06/07/2023]
Abstract
Cystoid macular edema (CME) and macular hole (MH) are the leading causes for visual loss in retinal diseases. The volume of the CMEs can be an accurate predictor for visual prognosis. This paper presents an automatic method to segment the CMEs from the abnormal retina with coexistence of MH in three-dimensional-optical coherence tomography images. The proposed framework consists of preprocessing and CMEs segmentation. The preprocessing part includes denoising, intraretinal layers segmentation and flattening, and MH and vessel silhouettes exclusion. In the CMEs segmentation, a three-step strategy is applied. First, an AdaBoost classifier trained with 57 features is employed to generate the initialization results. Second, an automated shape-constrained graph cut algorithm is applied to obtain the refined results. Finally, cyst area information is used to remove false positives (FPs). The method was evaluated on 19 eyes with coexistence of CMEs and MH from 18 subjects. The true positive volume fraction, FP volume fraction, dice similarity coefficient, and accuracy rate for CMEs segmentation were 81.0%±7.8%, 0.80%±0.63%, 80.9%±5.7%, and 99.7%±0.1%, respectively.
Collapse
Affiliation(s)
- Weifang Zhu
- Soochow University, School of Electronics and Information Engineering, Suzhou, China
| | - Li Zhang
- Soochow University, School of Electronics and Information Engineering, Suzhou, China
| | - Fei Shi
- Soochow University, School of Electronics and Information Engineering, Suzhou, China
| | - Dehui Xiang
- Soochow University, School of Electronics and Information Engineering, Suzhou, China
| | - Lirong Wang
- Soochow University, School of Electronics and Information Engineering, Suzhou, China
| | - Jingyun Guo
- Soochow University, School of Electronics and Information Engineering, Suzhou, China
| | - Xiaoling Yang
- Soochow University, School of Electronics and Information Engineering, Suzhou, China
| | - Haoyu Chen
- Shantou University and the Chinese University of Hong Kong, Joint Shantou International Eye Center, Shantou, ChinacThe Chinese University of Hong Kong, Department of Ophthalmology and Visual Sciences, Hong Kong, China
| | - Xinjian Chen
- Soochow University, School of Electronics and Information Engineering, Suzhou, China
| |
Collapse
|