Multi-discriminator adversarial convolutional network for nerve fiber segmentation in confocal corneal microscopy images

TL-MSE2-Net: Transfer learning based nested model for cerebrovascular segmentation with aneurysms

Cerebrovascular (i.e., cerebral vessel) segmentation is essential for diagnosing and treating brain diseases. Convolutional neural network models, such as U-Net, are commonly used for this purpose. Unfortunately, such models may not be entirely satisfactory in dealing with cerebrovascular segmentation with tumors due to the following issues: (1) Relatively small number of clinical datasets from patients obtained through different modalities such as computed tomography (CT) and magnetic resonance imaging (MRI), leading to inadequate training and lack of transferability in the modeling; (2) Insufficient feature extraction caused by less attention to both convolution sizes and cerebral vessel edges. Inspired by the existence of similar features on cerebral vessels between normal subjects and patients, we propose a transfer learning strategy based on a pre-trained nested model called TL-MSE2-Net. This model uses one of the publicly available datasets for cerebrovascular segmentation with aneurysms. To address issue (1), our transfer learning strategy leverages a pre-trained model that uses a large number of datasets from normal subjects, providing a potential solution to the lack of sufficient clinical datasets. To tackle issue (2), we structure the pre-trained model based on 3D U-Net, comprising three blocks: ResMul, DeRes, and REAM. The ResMul and DeRes blocks enhance feature extraction by utilizing multiple convolution sizes to capture multiscale features, and the REAM block increases the weight of the voxels on the edges of the given 3D volume. We evaluated the proposed model on one small private clinical dataset and two publicly available datasets. The experimental results demonstrated that our MSE2-Net framework achieved an average Dice score of 70.81 % and 89.08 % on the two publicly available datasets, outperforming other state-of-the-art methods. Ablation studies were also conducted to validate the effectiveness of each block. The proposed TL-MSE2-Net yielded better results than MSE2-Net on a small private clinical dataset, with increases of 5.52 %, 3.37 %, 6.71 %, and 0.85 % for the Dice score, sensitivity, Jaccard index, and precision, respectively.

In-vivo corneal confocal microscopy: Imaging analysis, biological insights and future directions

In-vivo corneal confocal microscopy is a powerful imaging technique which provides clinicians and researcher with the capabilities to observe microstructures at the ocular surfaces in significant detail. In this Mini Review, the optics and image analysis methods with the use of corneal confocal microscopy are discussed. While novel insights of neuroanatomy and biology of the eyes, particularly the ocular surface, have been provided by corneal confocal microscopy, some debatable elements observed using this technique remain and these are explored in this Mini Review. Potential improvements in imaging methodology and instrumentation are also suggested.

OCT2Former: A retinal OCT-angiography vessel segmentation transformer

BACKGROUND AND OBJECTIVE

Retinal vessel segmentation plays an important role in the automatic retinal disease screening and diagnosis. How to segment thin vessels and maintain the connectivity of vessels are the key challenges of the retinal vessel segmentation task. Optical coherence tomography angiography (OCTA) is a noninvasive imaging technique that can reveal high-resolution retinal vessels. Aiming at make full use of its characteristic of high resolution, a new end-to-end transformer based network named as OCT²Former (OCT-a Transformer) is proposed to segment retinal vessel accurately in OCTA images.

METHODS

The proposed OCT²Former is based on encoder-decoder structure, which mainly includes dynamic transformer encoder and lightweight decoder. Dynamic transformer encoder consists of dynamic token aggregation transformer and auxiliary convolution branch, in which the multi-head dynamic token aggregation attention based dynamic token aggregation transformer is designed to capture the global retinal vessel context information from the first layer throughout the network and the auxiliary convolution branch is proposed to compensate for the lack of inductive bias of the transformer and assist in the efficient feature extraction. A convolution based lightweight decoder is proposed to decode features efficiently and reduce the complexity of the proposed OCT²Former.

RESULTS

The proposed OCT²Former is validated on three publicly available datasets i.e. OCTA-SS, ROSE-1, OCTA-500 (subset OCTA-6M and OCTA-3M). The Jaccard indexes of the proposed OCT²Former on these datasets are 0.8344, 0.7855, 0.8099 and 0.8513, respectively, outperforming the best convolution based network 1.43, 1.32, 0.75 and 1.46%, respectively.

CONCLUSION

The experimental results have demonstrated that the proposed OCT²Former can achieve competitive performance on retinal OCTA vessel segmentation tasks.

Optical coherence tomography for in vivo longitudinal monitoring of artificial dermal scaffold

OBJECTIVES

Artificial dermal scaffold (ADS) has undergone rapid development and been increasingly used for treating skin wound in clinics due to its good biocompatibility, controllable degradation, and low risk of disease infection. To obtain good treatment efficacy, ADS needs to be monitored longitudinally during the treatment process. For example, scaffold-tissue fit, cell in-growth, vascular regeneration, and scaffold degradation are the key properties to be inspected. However, to date, there are no effective, real-time, and noninvasive techniques to meet the requirement of the scaffold monitoring above.

MATERIALS AND METHODS

In this study, we propose to use optical coherence tomography (OCT) to monitor ADS in vivo through three-dimensional imaging. A swept source OCT system with a handheld probe was developed for in vivo skin imaging. Moreover, a cell in-growth, vascular regeneration, and scaffold degradation rate (IRDR) was defined with the volume reduction rate of the scaffold's collagen sponge layer. To measure the IRDR, a semiautomatic image segmentation algorithm was designed based on U-Net to segment the collagen sponge layer of the scaffold from OCT images.

RESULTS

The results show that the scaffold-tissue fit can be clearly visualized under OCT imaging. The IRDR can be computed based on the volume of the segmented collagen sponge layer. It is observed that the IRDR appeared to a linear function of the time and in addition, the IRDR varied among different skin parts.

CONCLUSION

Overall, it can be concluded that OCT has a good potential to monitor ADS in vivo. This can help guide the clinicians to control the treatment with ADS to improve the therapy.

Centerline extraction by neighborhood-statistics thinning for quantitative analysis of corneal nerve fibers

Objective. Corneal nerve fiber (CNF) has been found to exhibit morphological changes associated with various diseases, which can therefore be utilized to aid in the early diagnosis of those diseases. CNF is usually visualized under corneal confocal microscopy (CCM) in clinic. To obtain the diagnostic biomarkers from CNF image produced from CCM, image processing and quantitative analysis are needed. Usually, CNF is segmented first and then CNF’s centerline is extracted, allowing for measuring geometrical and topological biomarkers of CNF, such as density, tortuosity, and length. Consequently, the accuracy of the segmentation and centerline extraction can make a big impact on the biomarker measurement. Thus, this study is aimed to improve the accuracy and universality of centerline extraction. Approach. We developed a new thinning algorithm based on neighborhood statistics, called neighborhood-statistics thinning (NST), to extract the centerline of CNF. Compared with traditional thinning and skeletonization techniques, NST exhibits a better capability to preserve the fine structure of CNF which can effectively benefit the biomarkers measurement above. Moreover, NST incorporates a fitting process, which can make centerline extraction be less influenced by image segmentation. Main results. This new method is evaluated on three datasets which are segmented with five different deep learning networks. The results show that NST is superior to thinning and skeletonization on all the CNF-segmented datasets with a precision rate above 0.82. Last, NST is attempted to be applied for the diagnosis of keratitis with the quantitative biomarkers measured from the extracted centerlines. Longer length and higher density but lower tortuosity were found on the CNF of keratitis patients as compared to healthy patients. Significance. This demonstrates that NST has a good potential to aid in the diagnostics of eye diseases in clinic.