BM3D-based total variation algorithm for speckle removal with structure-preserving in OCT images

Denoising of Optical Coherence Tomography Images in Ophthalmology Using Deep Learning: A Systematic Review

Imaging from optical coherence tomography (OCT) is widely used for detecting retinal diseases, localization of intra-retinal boundaries, etc. It is, however, degraded by speckle noise. Deep learning models can aid with denoising, allowing clinicians to clearly diagnose retinal diseases. Deep learning models can be considered as an end-to-end framework. We selected denoising studies that used deep learning models with retinal OCT imagery. Each study was quality-assessed through image quality metrics (including the peak signal-to-noise ratio-PSNR, contrast-to-noise ratio-CNR, and structural similarity index metric-SSIM). Meta-analysis could not be performed due to heterogeneity in the methods of the studies and measurements of their performance. Multiple databases (including Medline via PubMed, Google Scholar, Scopus, Embase) and a repository (ArXiv) were screened for publications published after 2010, without any limitation on language. From the 95 potential studies identified, a total of 41 were evaluated thoroughly. Fifty-four of these studies were excluded after full text assessment depending on whether deep learning (DL) was utilized or the dataset and results were not effectively explained. Numerous types of OCT images are mentioned in this review consisting of public retinal image datasets utilized purposefully for denoising OCT images (n = 37) and the Optic Nerve Head (ONH) (n = 4). A wide range of image quality metrics was used; PSNR and SNR that ranged between 8 and 156 dB. The minority of studies (n = 8) showed a low risk of bias in all domains. Studies utilizing ONH images produced either a PSNR or SNR value varying from 8.1 to 25.7 dB, and that of public retinal datasets was 26.4 to 158.6 dB. Further analysis on denoising models was not possible due to discrepancies in reporting that did not allow useful pooling. An increasing number of studies have investigated denoising retinal OCT images using deep learning, with a range of architectures being implemented. The reported increase in image quality metrics seems promising, while study and reporting quality are currently low.

Denoising OCT videos based on temporal redundancy

The identification of eye diseases and their progression often relies on a clear visualization of the anatomy and on different metrics extracted from Optical Coherence Tomography (OCT) B-scans. However, speckle noise hinders the quality of rapid OCT imaging, hampering the extraction and reliability of biomarkers that require time series. By synchronizing the acquisition of OCT images with the timing of the cardiac pulse, we transform a low-quality OCT video into a clear version by phase-wrapping each frame to the heart pulsation and averaging frames that correspond to the same instant in the cardiac cycle. Here, we compare the performance of our one-cycle denoising strategy with a deep-learning architecture, Noise2Noise, as well as classical denoising methods such as BM3D and Non-Local Means (NLM). We systematically analyze different image quality descriptors as well as region-specific metrics to assess the denoising performance based on the anatomy of the eye. The one-cycle method achieves the highest denoising performance, increases image quality and preserves the high-resolution structures within the eye tissues. The proposed workflow can be readily implemented in a clinical setting.

Lesion Detection in Optical Coherence Tomography with Transformer-Enhanced Detector

Optical coherence tomography (OCT) is an emerging imaging tool in healthcare with common applications in ophthalmology for the detection of retinal diseases and in dentistry for the early detection of tooth decay. Speckle noise is ubiquitous in OCT images, which can hinder diagnosis by clinicians. In this paper, a region-based, deep learning framework for the detection of anomalies is proposed for OCT-acquired images. The core of the framework is Transformer-Enhanced Detection (TED), which includes attention gates (AGs) to ensure focus is placed on the foreground while identifying and removing noise artifacts as anomalies. TED was designed to detect the different types of anomalies commonly present in OCT images for diagnostic purposes and thus aid clinical interpretation. Extensive quantitative evaluations were performed to measure the performance of TED against current, widely known, deep learning detection algorithms. Three different datasets were tested: two dental and one CT (hosting scans of lung nodules, livers, etc.). The results showed that the approach verifiably detected tooth decay and numerous lesions across two modalities, achieving superior performance compared to several well-known algorithms. The proposed method improved the accuracy of detection by 16-22% and the Intersection over Union (IOU) by 10% for both dentistry datasets. For the CT dataset, the performance metrics were similarly improved by 9% and 20%, respectively.

Non-Local Mean Denoising Algorithm Based on Fractional Compact Finite Difference Scheme Effectively Reduces Speckle Noise in Optical Coherence Tomography Images

Optical coherence tomography (OCT) is used in various fields such, as medical diagnosis and material inspection, as a non-invasive and high-resolution optical imaging modality. However, an OCT image is damaged by speckle noise during its generation, thus reducing the image quality. To address this problem, a non-local means (NLM) algorithm based on the fractional compact finite difference scheme (FCFDS) is proposed to remove the speckle noise in OCT images. FCFDS uses more local pixel information when compared to integer-order difference operators. The FCFDS operator is introduced into the NLM algorithm to construct a high-precision weight calculation so that the proposed algorithm can effectively reduce the speckle noise in the OCT images. Experiments on simulations and real OCT images show that the proposed method is comparable to other state-of-the-art despeckling methods and can substantially reduce noise and preserve image details such as edges and structures. Speckle noise removal can further promote the application of the proposed algorithm in medical diagnosis and industrial detection, as it has key research value.

Deep-Learning-Based Fast Optical Coherence Tomography (OCT) Image Denoising for Smart Laser Osteotomy

Laser osteotomy promises precise cutting and minor bone tissue damage. We proposed Optical Coherence Tomography (OCT) to monitor the ablation process toward our smart laser osteotomy approach. The OCT image is helpful to identify tissue type and provide feedback for the ablation laser to avoid critical tissues such as bone marrow and nerve. Furthermore, in the implementation, the tissue classifier's accuracy is dependent on the quality of the OCT image. Therefore, image denoising plays an important role in having an accurate feedback system. A common OCT image denoising technique is the frame-averaging method. Inherent to this method is the need for multiple images, i.e., the more images used, the better the resulting image quality. However, this approach comes at the price of increased acquisition time and sensitivity to motion artifacts. To overcome these limitations, we applied a deep-learning denoising method capable of imitating the frame-averaging method. The resulting image had a similar image quality to the frame-averaging and was better than the classical digital filtering methods. We also evaluated if this method affects the tissue classifier model's accuracy that will provide feedback to the ablation laser. We found that image denoising significantly increased the accuracy of the tissue classifier. Furthermore, we observed that the classifier trained using the deep learning denoised images achieved similar accuracy to the classifier trained using frame-averaged images. The results suggest the possibility of using the deep learning method as a pre-processing step for real-time tissue classification in smart laser osteotomy.

Fast Speckle Noise Suppression Algorithm in Breast Ultrasound Image Using Three-Dimensional Deep Learning

The rapid development of ultrasound medical imaging technology has greatly broadened the scope of application of ultrasound, which has been widely used in the screening, diagnosis of breast diseases and so on. However, the presence of excessive speckle noise in breast ultrasound images can greatly reduce the image resolution and affect the observation and judgment of patients’ condition. Therefore, it is particularly important to investigate image speckle noise suppression. In the paper, we propose fast speckle noise suppression algorithm in breast ultrasound image using three-dimensional (3D) deep learning. Firstly, according to the gray value of the breast ultrasound image, the input breast ultrasound image contrast is enhanced using logarithmic and exponential transforms, and guided filter algorithm was used to enhance the details of glandular ultrasound image, and spatial high-pass filtering algorithm was used to suppress the excessive sharpening of breast ultrasound image to complete the pre-processing of breast ultrasound image and improve the image clarity; Secondly, the pre-processed breast ultrasound images were input into the 3D convolutional cloud neural network image speckle noise suppression model; Finally, the edge sensitive terms were introduced into the 3D convolutional cloud neural network to suppress the speckle noise of breast ultrasound images while retaining image edge information. The experiments demonstrate that the mean square error and false recognition rate all reduced to below 1.2% at the 100th iteration of training, and the 3D convolutional cloud neural network is well trained, and the signal-to-noise ratio of ultrasound image speckle noise suppression is greater than 60 dB, the peak signal-to-noise ratio is greater than 65 dB, the edge preservation index value exceeds the experimental threshold of 0.45, the speckle noise suppression time is low, the edge information is well preserved, and the image details are clearly visible. The speckle noise suppression time is low, the edge information is well preserved, and the image details are clearly visible, which can be applied to the field of breast ultrasound diagnosis.

Reducing speckle in anterior segment optical coherence tomography images based on a convolutional neural network

Speckle noise is ubiquitous in the optical coherence tomography (OCT) image of the anterior segment, which greatly affects the image quality and destroys the relevant structural information. In order to reduce the influence of speckle noise in OCT images, a denoising algorithm based on a convolutional neural network is proposed in this paper. Unlike traditional algorithms that directly obtain denoised images, the algorithm model proposed in this paper learns the speckle noise distribution through the constructed trainable OCT dataset and indirectly obtains the denoised result image. In order to verify the performance of the model, we compare the denoising results of the algorithm proposed in this paper with several state-of-the-art algorithms from three perspectives: qualitative evaluation from the subjective visual perspective, quantitative evaluation from objective parameter indicators, and running time. The experimental results show that the proposed algorithm has a good denoising effect on different OCT images of the anterior segment and has good generalization ability. Besides, it retains the relevant details and texture information in the image, and it has strong edge preserving ability. The image of OCT speckle removal can be obtained within 0.4 s, which meets the time limit requirement of clinical application.

Modeling of Retinal Optical Coherence Tomography Based on Stochastic Differential Equations: Application to Denoising

In this paper a statistical modeling, based on stochastic differential equations (SDEs), is proposed for retinal Optical Coherence Tomography (OCT) images. In this method, pixel intensities of image are considered as discrete realizations of a Levy stable process. This process has independent increments and can be expressed as response of SDE to a white symmetric alpha stable (s [Formula: see text]) noise. Based on this assumption, applying appropriate differential operator makes intensities statistically independent. Mentioned white stable noise can be regenerated by applying fractional Laplacian operator to image intensities. In this way, we modeled OCT images as s [Formula: see text] distribution. We applied fractional Laplacian operator to image and fitted s [Formula: see text] to its histogram. Statistical tests were used to evaluate goodness of fit of stable distribution and its heavy tailed and stability characteristics. We used modeled s [Formula: see text] distribution as prior information in maximum a posteriori (MAP) estimator in order to reduce the speckle noise of OCT images. Such a statistically independent prior distribution simplified denoising optimization problem to a regularization algorithm with an adjustable shrinkage operator for each image. Alternating Direction Method of Multipliers (ADMM) algorithm was utilized to solve the denoising problem. We presented visual and quantitative evaluation results of the performance of this modeling and denoising methods for normal and abnormal images. Applying parameters of model in classification task as well as indicating effect of denoising in layer segmentation improvement illustrates that the proposed method describes OCT data more accurately than other models that do not remove statistical dependencies between pixel intensities.

Double-path parallel convolutional neural network for removing speckle noise in different types of OCT images

Speckle noises widely exist in optical coherence tomography (OCT) images. We propose an improved double-path parallel convolutional neural network (called DPNet) to reduce speckles. We increase the network width to replace the network depth to extract deeper information from the original OCT images. In addition, we use dilated convolution and residual learning to increase the learning ability of our DPNet. We use 100 pairs of human retinal OCT images as the training dataset. Then we test the DPNet model for denoising speckles on four different types of OCT images, mainly including human retinal OCT images, skin OCT images, colon crypt OCT images, and quail embryo OCT images. We compare the DPNet model with the adaptive complex diffusion method, the curvelet shrinkage method, the shearlet-based total variation method, and the OCTNet method. We qualitatively and quantitatively evaluate these methods in terms of image smoothness, structural information protection, and edge clarity. Our experimental results prove the performance of the DPNet model, and it allows us to batch and quickly process different types of poor-quality OCT images without any parameter fine-tuning under a time-constrained situation.

Guided filtering-based nonlocal means despeckling of optical coherence tomography images

This Letter presents a guided filtering (GF)-based nonlocal means (NLM) method for despeckling of optical coherence tomography (OCT) images. Unlike existing NLM methods that determine weights using image intensities or features, the proposed method first uses the GF to capture both grayscale information and features of the input image and then introduces them into the NLM for accurate weight computation. The boosting and iterative strategies are further incorporated to ensure despeckling performance. Experiments on the real OCT images demonstrate that our method outperforms the compared methods by delivering sufficient noise reduction and preserving image details well.

Development of a 3-D Physical Dynamics Monitoring System Using OCM with DVC for Quantification of Sprouting Endothelial Cells Interacting with a Collagen Matrix

The extracellular matrix (ECM) plays a key role during cell migration, proliferation, and differentiation by providing adhesion sites and serving as a physical scaffold. Elucidating the interaction between the cell and ECM can reveal the underlying mechanisms of cellular behavior that are currently unclear. Analysis of the deformation of the ECM due to cell-matrix interactions requires microscopic, three-dimensional (3-D) imaging methods, such as confocal microscopy and second-harmonic generation microscopy, which are currently limited by phototoxicity and bleaching as a result of the point-scanning approach. In this study, we suggest the use of optical coherence microscopy (OCM) as a live-cell, volumetric, fast imaging tool for analyzing the deformation of fibrous ECM. We optimized such OCM parameters as the sampling rate to obtain images of the best quality that meet the requirements for robust digital volume correlation (DVC) analysis. Visualization and analysis of the mechanical interaction between collagen ECM and human umbilical vein endothelial cells (HUVECs) show that cellular adhesion during protrusion can be analyzed and quantified. The advantages of OCM, such as fine isotropic spatial resolution, fast time resolution, and low phototoxicity, make it the ideal optic tool for 3-D traction force microscopy.

OCT Image Restoration Using Non-Local Deep Image Prior

In recent years, convolutional neural networks (CNN) have been widely used in image denoising for their high performance. One difficulty in applying the CNN to medical image denoising such as speckle reduction in the optical coherence tomography (OCT) image is that a large amount of high-quality data is required for training, which is an inherent limitation for OCT despeckling. Recently, deep image prior (DIP) networks have been proposed for image restoration without pre-training since the CNN structures have the intrinsic ability to capture the low-level statistics of a single image. However, the DIP has difficulty finding a good balance between maintaining details and suppressing speckle noise. Inspired by DIP, in this paper, a sorted non-local statics which measures the signal autocorrelation in the differences between the constructed image and the input image is proposed for OCT image restoration. By adding the sorted non-local statics as a regularization loss in the DIP learning, more low-level image statistics are captured by CNN networks in the process of OCT image restoration. The experimental results demonstrate the superior performance of the proposed method over other state-of-the-art despeckling methods, in terms of objective metrics and visual quality.