OCTRexpert:A Feature-based 3D Registration Method for Retinal OCT Images

Megahertz multi-parametric ophthalmic OCT system for whole eye imaging

An ultrahigh-speed, wide-field OCT system for the imaging of anterior, posterior, and ocular biometers is crucial for obtaining comprehensive ocular parameters and quantifying ocular pathology size. Here, we demonstrate a multi-parametric ophthalmic OCT system with a speed of up to 1 MHz for wide-field imaging of the retina and 50 kHz for anterior chamber and ocular biometric measurement. A spectrum correction algorithm is proposed to ensure the accurate pairing of adjacent A-lines and elevate the A-scan speed from 500 kHz to 1 MHz for retinal imaging. A registration method employing position feedback signals was introduced, reducing pixel offsets between forward and reverse galvanometer scanning by 2.3 times. Experimental validation on glass sheets and the human eye confirms feasibility and efficacy. Meanwhile, we propose a revised formula to determine the "true" fundus size using all-axial length parameters from different fields of view. The efficient algorithms and compact design enhance system compatibility with clinical requirements, showing promise for widespread commercialization.

Rigid alignment method for secondary analyses of optical coherence tomography volumes

Optical coherence tomography (OCT) provides micron level resolution of retinal tissue and is widely used in ophthalmology. Millions of pre-existing OCT images are available from research and clinical databases. Analysis of this data often requires or can benefit significantly from image registration and reduction of speckle noise. One method of reducing noise is to align and average multiple OCT scans together. We propose to use surface feature information and whole volume information to create a novel and simple pipeline that can rigidly align, and average multiple previously acquired 3D OCT volumes from a commercially available OCT device. This pipeline significantly improves both image quality and visualization of clinically relevant image features over single, unaligned volumes from the commercial scanner.

Automatic 3D reconstruction of an anatomically correct upper airway from endoscopic long range OCT images

Endoscopic airway optical coherence tomography (OCT) is a non-invasive and high resolution imaging modality for the diagnosis and analysis of airway-related diseases. During OCT imaging of the upper airway, in order to reliably characterize its 3D structure, there is a need to automatically detect the airway lumen contour, correct rotational distortion and perform 3D airway reconstruction. Based on a long-range endoscopic OCT imaging system equipped with a magnetic tracker, we present a fully automatic framework to reconstruct the 3D upper airway model with correct bending anatomy. Our method includes an automatic segmentation method for the upper airway based on dynamic programming algorithm, an automatic initial rotation angle error correction method for the detected 2D airway lumen contour, and an anatomic bending method combined with the centerline detected from the magnetically tracked imaging probe. The proposed automatic reconstruction framework is validated on experimental datasets acquired from two healthy adults. The result shows that the proposed framework allows the full automation of 3D airway reconstruction from OCT images and thus reveals its potential to improve analysis efficiency of endoscopic OCT images.

Automated Learning for Deformable Medical Image Registration by Jointly Optimizing Network Architectures and Objective Functions

Deformable image registration plays a critical role in various tasks of medical image analysis. A successful registration algorithm, either derived from conventional energy optimization or deep networks, requires tremendous efforts from computer experts to well design registration energy or to carefully tune network architectures with respect to medical data available for a given registration task/scenario. This paper proposes an automated learning registration algorithm (AutoReg) that cooperatively optimizes both architectures and their corresponding training objectives, enabling non-computer experts to conveniently find off-the-shelf registration algorithms for various registration scenarios. Specifically, we establish a triple-level framework to embrace the searching for both network architectures and objectives with a cooperating optimization. Extensive experiments on multiple volumetric datasets and various registration scenarios demonstrate that AutoReg can automatically learn an optimal deep registration network for given volumes and achieve state-of-the-art performance. The automatically learned network also improves computational efficiency over the mainstream UNet architecture from 0.558 to 0.270 seconds for a volume pair on the same configuration.

Morphological prognosis prediction of choroid neovascularization from longitudinal SD-OCT images

BACKGROUND

Choroid neovascularization (CNV) has no obvious symptoms in the early stage, but with its gradual expansion, leakage, rupture, and bleeding, it can cause vision loss and central scotoma. In some severe cases, it will lead to permanent visual impairment.

PURPOSE

Accurate prediction of disease progression can greatly help ophthalmologists to formulate appropriate treatment plans and prevent further deterioration of the disease. Therefore, we aim to predict the growth trend of CNV to help the attending physician judge the effectiveness of treatment.

METHODS

In this paper, we develop a CNN-based method for CNV growth prediction. To achieve this, we first design a registration network to rigidly register the spectral domain optical coherence tomography (SD-OCT) B-scans of each subject at different time points to eliminate retinal displacements of longitudinal data. Then, considering the correlation of longitudinal data, we propose a co-segmentation network with a correlation attention guidance (CAG) module to cooperatively segment CNV lesions of a group of follow-up images and use them as input for growth prediction. Finally, based on the above registration and segmentation networks, an encoder-recurrent-decoder framework is developed for CNV growth prediction, in which an attention-based gated recurrent unit (AGRU) is embedded as the recurrent neural network to recurrently learn robust representations.

RESULTS

The registration network rigidly registers the follow-up images of patients to the reference images with a root mean square error (RMSE) of 6.754 pixels. And compared with other state-of-the-art segmentation methods, the proposed segmentation network achieves high performance with the Dice similarity coefficients (Dsc) of 85.27%. Based on the above experiments, the proposed growth prediction network can play a role in predicting the future CNV morphology, and the predicted CNV has a Dsc of 83.69% with the ground truth, which is significantly consistent with the actual follow-up visit.

CONCLUSION

The proposed registration and segmentation networks provide the possibility for growth prediction. In addition, accurately predicting the growth of CNV enables us to know the efficacy of the drug against individuals in advance, creating opportunities for formulating appropriate treatment plans.

Automated inter-device 3D OCT image registration using deep learning and retinal layer segmentation

Optical coherence tomography (OCT) is the most widely used imaging modality in ophthalmology. There are multiple variations of OCT imaging capable of producing complementary information. Thus, registering these complementary volumes is desirable in order to combine their information. In this work, we propose a novel automated pipeline to register OCT images produced by different devices. This pipeline is based on two steps: a multi-modal 2D en-face registration based on deep learning, and a Z-axis (axial axis) registration based on the retinal layer segmentation. We evaluate our method using data from a Heidelberg Spectralis and an experimental PS-OCT device. The empirical results demonstrated high-quality registrations, with mean errors of approximately 46 µm for the 2D registration and 9.59 µm for the Z-axis registration. These registrations may help in multiple clinical applications such as the validation of layer segmentations among others.

Rotational Distortion and Compensation in Optical Coherence Tomography with Anisotropic Pixel Resolution

Accurate image registration is essential for eye movement compensation in optical coherence tomography (OCT) and OCT angiography (OCTA). The spatial resolution of an OCT instrument is typically anisotropic, i.e., has different resolutions in the lateral and axial dimensions. When OCT images have anisotropic pixel resolution, residual distortion (RD) and false translation (FT) are always observed after image registration for rotational movement. In this study, RD and FT were quantitively analyzed over different degrees of rotational movement and various lateral and axial pixel resolution ratio (RL/RA) values. The RD and FT provide the evaluation criteria for image registration. The theoretical analysis confirmed that the RD and FT increase significantly with the rotation degree and RL/RA. An image resizing assisting registration (RAR) strategy was proposed for accurate image registration. The performance of direct registration (DR) and RAR for retinal OCT and OCTA images were quantitatively compared. Experimental results confirmed that unnormalized RL/RA causes RD and FT; RAR can effectively improve the performance of OCT and OCTA image registration and distortion compensation.

A novel vessel segmentation algorithm for pathological en-face images based on matched filter

The vascular information in fundus images can provide important basis for detection and prediction of retina-related diseases. However, the presence of lesions such as Coroidal Neovascularization can seriously interfere with normal vascular areas in optical coherence tomography (OCT) fundus images. In this paper, a novel method is proposed for detecting blood vessels in pathological OCT fundus images. First of all, an automatic localization and filling method is used in preprocessing step to reduce pathological interference. Afterwards, in terms of vessel extraction, a pore ablation method based on capillary bundle model is applied. The ablation method processes the image after matched filter feature extraction, which can eliminate the interference caused by diseased blood vessels to a great extent. At the end of the proposed method, morphological operations are used to obtain the main vascular features. Experimental results on the dataset show that the proposed method achieves 0.88 ± 0.03, 0.79 ± 0.05, 0.66 ± 0.04, results in DICE, PRECISION and TPR, respectively. Effective extraction of vascular information from OCT fundus images is of great significance for the diagnosis and treatment of retinal related diseases.

Intensity-based nonrigid endomicroscopic image mosaicking incorporating texture relevance for compensation of tissue deformation

Image mosaicking has emerged as a universal technique to broaden the field-of-view of the probe-based confocal laser endomicroscopy (pCLE) imaging system. However, due to the influence of probe-tissue contact forces and optical components on imaging quality, existing mosaicking methods remain insufficient to deal with practical challenges. In this paper, we present the texture encoded sum of conditional variance (TESCV) as a novel similarity metric, and effectively incorporate it into a sequential mosaicking scheme to simultaneously correct rigid probe shift and nonrigid tissue deformation. TESCV combines both intensity dependency and texture relevance to quantify the differences between pCLE image frames, where a discriminative binary descriptor named fully cross-detected local derivative pattern (FCLDP) is designed to extract more detailed structural textures. Furthermore, we also analytically derive the closed-form gradient of TESCV with respect to the transformation variables. Experiments on the circular dataset highlighted the advantage of the TESCV metric in improving mosaicking performance compared with the other four recently published metrics. The comparison with the other four state-of-the-art mosaicking methods on the spiral and manual datasets indicated that the proposed TESCV-based method not only worked stably at different contact forces, but was also suitable for both low- and high-resolution imaging systems. With more accurate and delicate mosaics, the proposed method holds promises to meet clinical demands for intraoperative optical biopsy.