Choroidal layer segmentation in OCT images by a boundary enhancement network

ChoroidSeg-ViT: A Transformer Model for Choroid Layer Segmentation Based on a Mixed Attention Feature Enhancement Mechanism

Purpose

To develop a Vision Transformer (ViT) model based on the mixed attention feature enhancement mechanism, ChoroidSeg-ViT, for choroid layer segmentation in optical coherence tomography (OCT) images.

Methods

This study included a dataset of 100 OCT B-scans images. Ground truths were carefully labeled by experienced ophthalmologists. An end-to-end local-enhanced Transformer model, ChoroidSeg-ViT, was designed to segment the choroid layer by integrating the local enhanced feature extraction and semantic feature fusion paths. Standard segmentation metrics were selected to evaluate ChoroidSeg-ViT.

Results

Experimental results demonstrate that ChoroidSeg-ViT exhibited superior segmentation performance (mDice: 98.31, mIoU: 96.62, mAcc: 98.29) compared to other deep learning approaches, thus indicating the effectiveness and superiority of this proposed model for the choroid layer segmentation task. Furthermore, ablation and generalization experiments validated the reasonableness of the module design.

Conclusions

We developed a novel Transformer model to precisely and automatically segment the choroid layer and achieved the state-of-the-art performance.

Translational Relevance

ChoroidSeg-ViT could segment precise and smooth choroid layers and form the basis of an automatic choroid analysis system that would facilitate future choroidal research in ophthalmology.

Choroidal Layer Analysis in OCT images via Ambiguous Boundary-aware Attention

Optical Coherence Tomography (OCT) is a commonly used retina imaging technique, and it is capable of revealing the morphology of the choroid. However, the segmentation and quantitative analysis of the sublayers and vessels in choroid are rarely explored, primarily due to the indistinct boundaries of choroidal sublayers, and imbalanced distribution of vessels observed in OCT imagery. In this paper, we propose a novel two-stage architecture called Choroidal Layer Analysis network (CLA), that may be considered the first attempt in this research community for joint segmentation of choroidal sublayers and choroidal vessels in OCT images. CLA employs the encoder-decoder network with the residual U-shape module as the backbone. In order to empower the ability of the segmentation model to identify the inconspicuous boundaries of choroidal sublayers, we introduce an Ambiguous Boundary Attention block (ABA) into the bottleneck of the encoder-decoder network in the first stage. For more accurate segmentation of large choroidal vessels with ambiguous contours and imbalanced spatial distribution, the second stage introduces an active contour-based loss to refine the contours of choroidal vessels simultaneously with precise identification of each vessel via contextual modeling. To train, test and validate the proposed model, we conducted a choroidal segmentation dataset containing 800 OCT images, with their sublayers and large choroidal vessels manually annotated. Experimental results demonstrate the superiority of the proposed approach compared with other state-of-the-art segmentation networks in large margins. It is worth noting that we also reconstructed the large choroidal vessels in three-dimensional (3D) based on the segmentation results, and multiple 3D morphological parameters were calculated. The statistical analysis of these parameters demonstrates significant differences between the healthy control and high myopia group, and this further confirms the proposed work may facilitate subsequent disease understanding and clinical decision-making.

Semi-supervised contrast learning-based segmentation of choroidal vessel in optical coherence tomography images

Objective.Choroidal vessels account for 85% of all blood vessels in the eye, and the accurate segmentation of choroidal vessels from optical coherence tomography (OCT) images provides important support for the quantitative analysis of choroid-related diseases and the development of treatment plans. Although deep learning-based methods have great potential for segmentation, these methods rely on large amounts of well-labeled data, and the data collection process is both time-consuming and laborious.Approach.In this paper, we propose a novel asymmetric semi-supervised segmentation framework called SSCR, based on a student-teacher model, to segment choroidal vessels in OCT images. The proposed framework enhances the segmentation results with uncertainty-aware self-integration and transformation consistency techniques. Meanwhile, we designed an asymmetric encoder-decoder network called Pyramid Pooling SegFormer (APP-SFR) for choroidal vascular segmentation. The network combines local attention and global attention information to improve the model's ability to learn complex vascular features. Additionally, we proposed a boundary repair module that enhances boundary confidence by utilizing a repair head to re-predict selected fuzzy points and further refines the segmentation boundary.Main results.We conducted extensive experiments on three different datasets: the ChorVessel dataset with 400 OCT images, the Meibomian Glands (MG) dataset with 400 images, and the U2OS Cell Nucleus Dataset with 200 images. The proposed method achieved an average Dice score of 74.23% on the ChorVessel dataset, which is 2.95% higher than the fully supervised network (U-Net) and outperformed other comparison methods. In both the MG dataset and the U2OS cell nucleus dataset, our proposed SSCR method achieved average Dice scores of 80.10% and 87.26%, respectively.Significance.The experimental results show that our proposed methods achieve better segmentation accuracy than other state-of-the-art methods. The method is designed to help clinicians make rapid diagnoses of ophthalmic diseases and has potential for clinical application.