Texture preservation and speckle reduction in poor optical coherence tomography using the convolutional neural network

Speckle attenuation for optical coherence tomography images using the generalized low rank approximations of matrices

A frequently used technology in medical diagnosis is optical coherence tomography (OCT). However, coherent noise, also known as speckle noise, has the potential to severely reduce the quality of OCT images, which would be detrimental to the use of OCT images for disease diagnosis. In this paper, a despeckling method is proposed to effectively reduce the speckle noise in OCT images using the generalized low rank approximations of matrices (GLRAM). Specifically, the Manhattan distance (MD)-based block matching method is first used to find nonlocal similar blocks for the reference one. The left and right projection matrices shared by these image blocks are then found using the GLRAM approach, and an adaptive method based on asymptotic matrix reconstruction is proposed to determine how many eigenvectors are present in the left and right projection matrices. Finally, all the reconstructed image blocks are aggregated to create the despeckled OCT image. In addition, an edge-guided adaptive back-projection strategy is used to improve the despeckling performance of the proposed method. Experiments with synthetic and real OCT images show that the presented method performs well in both objective measurements and visual evaluation.

A new generative approach for optical coherence tomography data scarcity: unpaired mutual conversion between scanning presets

In optical coherence tomography (OCT), there is a trade-off between the scanning time and image quality, leading to a scarcity of high quality data. OCT platforms provide different scanning presets, producing visually distinct images, limiting their compatibility. In this work, a fully automatic methodology for the unpaired visual conversion of the two most prevalent scanning presets is proposed. Using contrastive unpaired translation generative adversarial architectures, low quality images acquired with the faster Macular Cube preset can be converted to the visual style of high visibility Seven Lines scans and vice-versa. This modifies the visual appearance of the OCT images generated by each preset while preserving natural tissue structure. The quality of original and synthetic generated images was compared using BRISQUE. The synthetic generated images achieved very similar scores to original images of their target preset. The generative models were validated in automatic and expert separability tests. These models demonstrated they were able to replicate the genuine look of the original images. This methodology has the potential to create multi-preset datasets with which to train robust computer-aided diagnosis systems by exposing them to the visual features of different presets they may encounter in real clinical scenarios without having to obtain additional data. Graphical Abstract Unpaired mutual conversion between scanning presets. Two generative adversarial models are trained for the conversion of OCT images into images of another scanning preset, replicating the visual features that characterise said preset.

GPU-accelerated image registration algorithm in ophthalmic optical coherence tomography

Limited to the power of the light source in ophthalmic optical coherence tomography (OCT), the signal-to-noise ratio (SNR) of the reconstructed images is usually lower than OCT used in other fields. As a result, improvement of the SNR is required. The traditional method is averaging several images at the same lateral position. However, the image registration average costs too much time, which limits its real-time imaging application. In response to this problem, graphics processing unit (GPU)-side kernel functions are applied to accelerate the reconstruction of the OCT signals in this paper. The SNR of the images reconstructed from different numbers of A-scans and B-scans were compared. The results demonstrated that: 1) There is no need to realize the axial registration with every A-scan. The number of the A-scans used to realize axial registration is suitable to set as ∼25, when the A-line speed was set as ∼12.5kHz. 2) On the basis of ensuring the quality of the reconstructed images, the GPU can achieve 43× speedup compared with CPU.

Noise Reduction of OCT Images Based on the External Patch Prior Guided Internal Clustering and Morphological Analysis

Optical coherence tomography (OCT) is widely used in biomedical imaging. However, noise severely affects diagnosing and identifying diseased tissues on OCT images. Here, a noise reduction method based on the external patch prior guided internal clustering and morphological analysis (E2PGICMA) is developed to remove the noise of OCT images. The external patch prior guided internal clustering algorithm is used to reduce speckle noise. The morphological analysis algorithm is employed to the background for contrast enhancement. OCT images of in vivo normal skin tissues were analyzed to remove noise using the proposed method. The estimated standard deviations of the noise were chosen as different values for evaluating the quantitative metrics. The visual quality improvement includes more textures and fine detail preservation. The denoising effects of different methods were compared. Then, quantitative and qualitative evaluations of this proposed method were conducted. The results demonstrated that the SNR, PSNR, and XCOR were higher than those of the other noise-reduction methods, reaching 15.05 dB, 27.48 dB, and 0.9959, respectively. Furthermore, the presented method’s noise reduction ratio (NRR) reached 0.8999. This proposed method can efficiently remove the background and speckle noise. Improving the proposed noise reduction method would outperform existing state-of-the-art OCT despeckling methods.

Deep learning optical image denoising research based on principal component estimation

High-quality denoising of optical interference images usually requires preliminary prediction of the noise level. Although blind denoising can filter the image at the pixel level without noise prediction, it inevitably loses a significant amount of phase information. This paper proposes a fast and high-quality denoising algorithm for optical interference images that combines the merits of a principal component analysis (PCA) and residual neural networks. The PCA is used to analyze the image noise and, in turn, establishes an accurate mapping between the estimated and true noise levels. The mapping helps to select a suitable residual neural network model for image processing, which maximizes the retention of image information and reduces the effect of noise. In addition, a comprehensive evaluation factor to account for the time complexity and denoising effect of the algorithm is proposed, since time complexity can be a dominant concern in some cases of actual measurement. The performance of the denoising algorithm and the effectiveness of the evaluation criterion are demonstrated to be high by processing a set of optical interference images and benchmarking with other denoising algorithms. The proposed algorithm outperforms the previously reported counterparts in a specific area of optical interference image preprocessing and provides an alternative paradigm for other denoising problems of optics, such as holograms and structured light measurements.

Reducing speckle in anterior segment optical coherence tomography images based on a convolutional neural network

Speckle noise is ubiquitous in the optical coherence tomography (OCT) image of the anterior segment, which greatly affects the image quality and destroys the relevant structural information. In order to reduce the influence of speckle noise in OCT images, a denoising algorithm based on a convolutional neural network is proposed in this paper. Unlike traditional algorithms that directly obtain denoised images, the algorithm model proposed in this paper learns the speckle noise distribution through the constructed trainable OCT dataset and indirectly obtains the denoised result image. In order to verify the performance of the model, we compare the denoising results of the algorithm proposed in this paper with several state-of-the-art algorithms from three perspectives: qualitative evaluation from the subjective visual perspective, quantitative evaluation from objective parameter indicators, and running time. The experimental results show that the proposed algorithm has a good denoising effect on different OCT images of the anterior segment and has good generalization ability. Besides, it retains the relevant details and texture information in the image, and it has strong edge preserving ability. The image of OCT speckle removal can be obtained within 0.4 s, which meets the time limit requirement of clinical application.

Comparative study of deep neural networks with unsupervised Noise2Noise strategy for noise reduction of optical coherence tomography images

As a powerful diagnostic tool, optical coherence tomography (OCT) has been widely used in various clinical setting. However, OCT images are susceptible to inherent speckle noise that may contaminate subtle structure information, due to low-coherence interferometric imaging procedure. Many supervised learning-based models have achieved impressive performance in reducing speckle noise of OCT images trained with a large number of noisy-clean paired OCT images, which are not commonly feasible in clinical practice. In this article, we conducted a comparative study to investigate the denoising performance of OCT images over different deep neural networks through an unsupervised Noise2Noise (N2N) strategy, which only trained with noisy OCT samples. Four representative network architectures including U-shaped model, multi-information stream model, straight-information stream model and GAN-based model were investigated on an OCT image dataset acquired from healthy human eyes. The results demonstrated all four unsupervised N2N models offered denoised OCT images with a performance comparable with that of supervised learning models, illustrating the effectiveness of unsupervised N2N models in denoising OCT images. Furthermore, U-shaped models and GAN-based models using UNet network as generator are two preferred and suitable architectures for reducing speckle noise of OCT images and preserving fine structure information of retinal layers under unsupervised N2N circumstances.

Improving cerebral microvascular image quality of optical coherence tomography angiography with deep learning-based segmentation

Optical coherence tomography angiography (OCTA) can map the microvascular networks of the cerebral cortices with micrometer resolution and millimeter penetration. However, the high scattering of the skull and the strong noise in the deep imaging region will distort the vasculature projections and decrease the OCTA image quality. Here, we proposed a deep learning-based segmentation method based on a U-Net convolutional neural network to extract the cortical region from the OCT image. The vascular networks were then visualized by three OCTA algorithms. The image quality of the vasculature projections was assessed by two metrics, including the peak signal-to-noise ratio (PSNR) and the contrast-to-noise ratio (CNR). The results show the accuracy of the cortical segmentation was 96.07%. The PSNR and CNR values increased significantly in the projections of the selected cortical regions. The OCTA incorporating the deep learning-based cortical segmentation can efficiently improve the image quality and enhance the vasculature clarity.

Double-path parallel convolutional neural network for removing speckle noise in different types of OCT images

Speckle noises widely exist in optical coherence tomography (OCT) images. We propose an improved double-path parallel convolutional neural network (called DPNet) to reduce speckles. We increase the network width to replace the network depth to extract deeper information from the original OCT images. In addition, we use dilated convolution and residual learning to increase the learning ability of our DPNet. We use 100 pairs of human retinal OCT images as the training dataset. Then we test the DPNet model for denoising speckles on four different types of OCT images, mainly including human retinal OCT images, skin OCT images, colon crypt OCT images, and quail embryo OCT images. We compare the DPNet model with the adaptive complex diffusion method, the curvelet shrinkage method, the shearlet-based total variation method, and the OCTNet method. We qualitatively and quantitatively evaluate these methods in terms of image smoothness, structural information protection, and edge clarity. Our experimental results prove the performance of the DPNet model, and it allows us to batch and quickly process different types of poor-quality OCT images without any parameter fine-tuning under a time-constrained situation.

OCT-GAN: single step shadow and noise removal from optical coherence tomography images of the human optic nerve head

Speckle noise and retinal shadows within OCT B-scans occlude important edges, fine textures and deep tissues, preventing accurate and robust diagnosis by algorithms and clinicians. We developed a single process that successfully removed both noise and retinal shadows from unseen single-frame B-scans within 10.4ms. Mean average gradient magnitude (AGM) for the proposed algorithm was 57.2% higher than current state-of-the-art, while mean peak signal to noise ratio (PSNR), contrast to noise ratio (CNR), and structural similarity index metric (SSIM) increased by 11.1%, 154% and 187% respectively compared to single-frame B-scans. Mean intralayer contrast (ILC) improvement for the retinal nerve fiber layer (RNFL), photoreceptor layer (PR) and retinal pigment epithelium (RPE) layers decreased from 0.362 ± 0.133 to 0.142 ± 0.102, 0.449 ± 0.116 to 0.0904 ± 0.0769, 0.381 ± 0.100 to 0.0590 ± 0.0451 respectively. The proposed algorithm reduces the necessity for long image acquisition times, minimizes expensive hardware requirements and reduces motion artifacts in OCT images.