Automated three-dimensional registration and volume rebuilding for wide-field angiographic and structural optical coherence tomography

Volumetrically tracking retinal and choroidal structural changes in central serous chorioretinopathy

Central serous chorioretinopathy (CSCR) leads to the accumulation of subretinal fluid and retinal thickness change, which can be readily detected in clinics using optical coherence tomography (OCT). However, current quantification methods usually require sophisticated processing such as retinal layer segmentations, and volumetric visualization of structural changes is generally challenging, which can hinder fast and accurate assessment of disease progression and/or treatment efficacy. In this study, we developed an algorithm that can register the OCT scans acquired from different visits without requiring prior layer segmentation and calculated the three-dimensional (3-D) structural change maps for patients with CSCR. Our results demonstrate that this tool can be useful in monitoring the progression of CSCR and revealing the resolution of pathologies following treatment automatically with minimal pre-processing.

Volumetrically tracking retinal and choroidal structural changes in central serous chorioretinopathy

Central serous chorioretinopathy (CSCR) leads to accumulation of subretinal fluid and retinal thickness change, which can be readily detected in clinics using optical coherence tomography (OCT). However, current quantification methods usually require sophisticated processing such as retinal layer segmentations, and volumetric visualization of structural changes is generally challenging, which can hinder fast and accurate assessment of disease progression and/or treatment efficacy. In this study, we developed an algorithm that can register the OCT scans acquired from different visits without requiring prior layer segmentation and calculated the three-dimensional (3-D) structural change maps for patients with CSCR. Our results demonstrate that this tool can be useful in monitoring the progression of CSCR and revealing the resolution of pathologies following treatment automatically with minimal pre-processing.

OCT angiography and its retinal biomarkers [Invited]

Optical coherence tomography angiography (OCTA) is a high-resolution, depth-resolved imaging modality with important applications in ophthalmic practice. An extension of structural OCT, OCTA enables non-invasive, high-contrast imaging of retinal and choroidal vasculature that are amenable to quantification. As such, OCTA offers the capability to identify and characterize biomarkers important for clinical practice and therapeutic research. Here, we review new methods for analyzing biomarkers and discuss new insights provided by OCTA.

Optical Coherence Tomography Angiography of the Intestine: How to Prevent Motion Artifacts in Open and Laparoscopic Surgery?

(1) Introduction. The problem that limits the intraoperative use of OCTA for the intestinal circulation diagnostics is the low informative value of OCTA images containing too many motion artifacts. The aim of this study is to evaluate the efficiency and safety of the developed unit for the prevention of the appearance of motion artifacts in the OCTA images of the intestine in both open and laparoscopic surgery in the experiment; (2) Methods. A high-speed spectral-domain multimodal optical coherence tomograph (IAP RAS, Russia) operating at a wavelength of 1310 nm with a spectral width of 100 μm and a power of 2 mW was used. The developed unit was tested in two groups of experimental animals—on minipigs (group I, n = 10, open abdomen) and on rabbits (group II, n = 10, laparoscopy). Acute mesenteric ischemia was modeled and then 1 h later the small intestine underwent OCTA evaluation. A total of 400 OCTA images of the intact and ischemic small intestine were obtained and analyzed. The quality of the obtained OCTA images was evaluated based on the score proposed in 2020 by the group of Magnin M. (3) Results. Without stabilization, OCTA images of the intestine tissues were informative only in 32–44% of cases in open surgery and in 14–22% of cases in laparoscopic surgery. A vacuum bowel stabilizer with a pressure deficit of 22–25 mm Hg significantly reduced the number of motion artifacts. As a result, the proportion of informative OCTA images in open surgery increased up to 86.5% (Χ2 = 200.2, p = 0.001), and in laparoscopy up to 60% (Χ2 = 148.3, p = 0.001). (4) Conclusions. The used vacuum tissue stabilizer enabled a significant increase in the proportion of informative OCTA images by significantly reducing the motion artifacts.

Artificial intelligence in OCT angiography

Optical coherence tomographic angiography (OCTA) is a non-invasive imaging modality that provides three-dimensional, information-rich vascular images. With numerous studies demonstrating unique capabilities in biomarker quantification, diagnosis, and monitoring, OCTA technology has seen rapid adoption in research and clinical settings. The value of OCTA imaging is significantly enhanced by image analysis tools that provide rapid and accurate quantification of vascular features and pathology. Today, the most powerful image analysis methods are based on artificial intelligence (AI). While AI encompasses a large variety of techniques, machine-learning-based, and especially deep-learning-based, image analysis provides accurate measurements in a variety of contexts, including different diseases and regions of the eye. Here, we discuss the principles of both OCTA and AI that make their combination capable of answering new questions. We also review contemporary applications of AI in OCTA, which include accurate detection of pathologies such as choroidal neovascularization, precise quantification of retinal perfusion, and reliable disease diagnosis.

DETECTION OF CLINICALLY UNSUSPECTED RETINAL NEOVASCULARIZATION WITH WIDE-FIELD OPTICAL COHERENCE TOMOGRAPHY ANGIOGRAPHY

PURPOSE

To evaluate wide-field optical coherence tomography angiography (OCTA) for detection of clinically unsuspected neovascularization (NV) in diabetic retinopathy (DR).

METHODS

This prospective observational single-center study included adult patients with a clinical diagnosis of nonproliferative DR. Participants underwent a clinical examination, standard 7-field color photography, and OCTA with commercial and prototype swept-source devices. The wide-field OCTA was achieved by montaging five 6 × 10-mm scans from a prototype device into a 25 × 10-mm image and three 6 × 6-mm scans from a commercial device into a 15 × 6-mm image. A masked grader determined the retinopathy severity from color photographs. Two trained readers examined conventional and wide-field OCTA images for the presence of NV.

RESULTS

Of 27 participants, photographic grading found 13 mild, 7 moderate, and 7 severe nonproliferative DR. Conventional 6 × 6-mm OCTA detected NV in 2 eyes (7%) and none with 3 × 3-mm scans. Both prototype and commercial wide-field OCTA detected NV in two additional eyes. The mean area of NV was 0.38 mm (range 0.17-0.54 mm). All eyes with OCTA-detected NV were photographically graded as severe nonproliferative DR.

CONCLUSION

Wide-field OCTA can detect small NV not seen on clinical examination or color photographs and may improve the clinical evaluation of DR.

Robust three-dimensional registration on optical coherence tomography angiography for speckle reduction and visualization

BACKGROUND

In the clinical applications of optical coherence tomography angiography (OCTA), the repeated scanning and averaging method can provide better contrast with reduced speckle noises in the final results, which are useful for visualizing and quantifying vascular components with high accuracy, reproducibility, and reliability. However, the inevitable patient motion presents a challenge to this method. The objective of this study is to meet this challenge by introducing a 3D registration method to register optical coherence tomography (OCT)/OCTA scans for precise volume averaging of multiple scans to improve the signal-to-noise ratio (SNR) and increase quantification accuracy.

METHODS

The proposed method utilized both rigid affine transformation and non-rigid B-spline transformation in which their parameters were optimized and calculated by the average stochastic gradient descent on OCT structural images. In addition, we also introduced a multi-level resolution approach to further improve the robustness and computational speed of our proposed method. The imaging performance was tested on in vivo imaging of human skin and eye and assessed by SNR, peak signal-to-noise ratio (PSNR) and normalized correlation coefficient (NCC).

RESULTS

Five subjects were enrolled in this study for obtaining in vivo images of skin and retina. The proposed registration and averaging method provided substantial improvements of the imaging performance in terms of vessel connectivity and signal to noise ratio. The increase of repeated volume numbers in the averaging improves all the metrics assessed, i.e., SNR, PSNR and NCC. An improvement of the SNR from 10 to 40 dB after 10 repeated volumetric averaging was achieved.

CONCLUSIONS

The proposed 3D registration and averaging method is effective in reducing speckle noises and suppressing motion artifacts, thereby improving SNR, PSNR and NCC metrics for final averaged images. It is expected that the proposed algorithm would be practically useful in better visualization and more reliable quantification of in vivo OCT and OCTA data, which would be beneficial to OCT clinical applications.

Artifacts and artifact removal in optical coherence tomographic angiography

Optical coherence tomographic angiography (OCTA) enables rapid imaging of retinal vasculature in three dimensions. While the technique has provided quantification of healthy vessels as well as pathology in several diseases, it is not unusual for OCTA data to contain artifacts that may influence measurement outcomes or defy image interpretation. In this review, we discuss the sources of several OCTA artifacts-including projection, motion, and signal reduction-as well as strategies for their removal. Artifact compensation can improve the accuracy of OCTA measurements, and the most effective use of the technology will incorporate hardware and software that can perform such correction.

Efficient and high accuracy 3-D OCT angiography motion correction in pathology

We describe a novel method for non-rigid 3-D motion correction of orthogonally raster-scanned optical coherence tomography angiography volumes. This is the first approach that aligns predominantly axial structural features such as retinal layers as well as transverse angiographic vascular features in a joint optimization. Combined with orthogonal scanning and favorization of kinematically more plausible displacements, subpixel alignment and micrometer-scale distortion correction is achieved in all 3 dimensions. As no specific structures are segmented, the method is by design robust to pathologic changes. Furthermore, the method is designed for highly parallel implementation and short runtime, allowing its integration into clinical workflow even for high density or wide-field scans. We evaluated the algorithm with metrics related to clinically relevant features in an extensive quantitative evaluation based on 204 volumetric scans of 17 subjects, including patients with diverse pathologies and healthy controls. Using this method, we achieve state-of-the-art axial motion correction and show significant advances in both transverse co-alignment and distortion correction, especially in the subgroup with pathology.

Multi-reference global registration of individual A-lines in adaptive optics optical coherence tomography retinal images

SIGNIFICANCE

Adaptive optics optical coherence tomography (AO-OCT) technology enables non-invasive, high-resolution three-dimensional (3D) imaging of the retina and promises earlier detection of ocular disease. However, AO-OCT data are corrupted by eye-movement artifacts that must be removed in post-processing, a process rendered time-consuming by the immense quantity of data.

AIM

To efficiently remove eye-movement artifacts at the level of individual A-lines, including those present in any individual reference volume.

APPROACH

We developed a registration method that cascades (1) a 3D B-scan registration algorithm with (2) a global A-line registration algorithm for correcting torsional eye movements and image scaling and generating global motion-free coordinates. The first algorithm corrects 3D translational eye movements to a single reference volume, accelerated using parallel computing. The second algorithm combines outputs of multiple runs of the first algorithm using different reference volumes followed by an affine transformation, permitting registration of all images to a global coordinate system at the level of individual A-lines.

RESULTS

The 3D B-scan algorithm estimates and corrects 3D translational motions with high registration accuracy and robustness, even for volumes containing microsaccades. Averaging registered volumes improves our image quality metrics up to 22 dB. Implementation in CUDA™ on a graphics processing unit registers a 512  ×  512  ×  512 volume in only 10.6 s, 150 times faster than MATLAB™ on a central processing unit. The global A-line algorithm minimizes image distortion, improves regularity of the cone photoreceptor mosaic, and supports enhanced visualization of low-contrast retinal cellular features. Averaging registered volumes improves our image quality up to 9.4 dB. It also permits extending the imaging field of view (∼2.1  ×  ) and depth of focus (∼5.6  ×  ) beyond what is attainable with single-reference registration.

CONCLUSIONS

We can efficiently correct eye motion in all 3D at the level of individual A-lines using a global coordinate system.

Automatic Light Pipe Actuating System for Bimanual Robot-Assisted Retinal Surgery

Retinal surgery is a bimanual operation in which surgeons operate with an instrument in their dominant hand (more capable hand) and simultaneously hold a light pipe (illuminating pipe) with their non-dominant hand (less capable hand) to provide illumination inside the eye. Manually holding and adjusting the light pipe places an additional burden on the surgeon and increases the overall complexity of the procedure. To overcome these challenges, a robot-assisted automatic light pipe actuating system is proposed. A customized light pipe with force-sensing capability is mounted at the end effector of a follower robot and is actuated through a hybrid force-velocity controller to automatically illuminate the target area on the retinal surface by pivoting about the scleral port (incision on the sclera). Static following-accuracy evaluation and dynamic light tracking experiments are carried out. The results show that the proposed system can successfully illuminate the desired area with negligible offset (the average offset is 2.45 mm with standard deviation of 1.33 mm). The average scleral forces are also below a specified threshold (50 mN). The proposed system not only can allow for increased focus on dominant hand instrument control, but also could be extended to three-arm procedures (two surgical instruments held by surgeon plus a robot-holding light pipe) in retinal surgery, potentially improving surgical efficiency and outcome.

Optical Coherence Tomography Angiography Avascular Area Association With 1-Year Treatment Requirement and Disease Progression in Diabetic Retinopathy

PURPOSE

To assess the association between optical coherence tomography angiography (OCTA)-quantified avascular areas (AAs) and diabetic retinopathy (DR) severity, progression, and treatment requirement in the following year.

DESIGN

Prospective cohort study.

METHODS

We recruited patients with diabetes from a tertiary academic retina practice and obtained 3-mm × 3-mm macular OCTA scans with the AngioVue system and standard 7-field color photographs at baseline and at a 1-year follow-up visit. A masked grader determined the severity of DR from the color photographs using the Early Treatment of Diabetic Retinopathy scale. A custom algorithm detected extrafoveal AA (EAA) excluding the central 1-mm circle in projection-resolved superficial vascular complex (SVC), intermediate capillary plexus (ICP), and deep capillary plexus (DCP).

RESULTS

Of 138 patients, 92 (41 men, ranging in age from 26-84 years [mean 59.4 years]) completed 1 year of follow-up. At baseline, EAAs for SVC, ICP, and DCP were all significantly correlated with retinopathy severity (P < .0001). DCP EAA was significantly associated with worse visual acuity (r = -0.24, P = .02), but SVC and ICP EAA were not. At 1 year, 11 eyes progressed in severity by at least 1 step. Multivariate logistic regression analysis demonstrated the progression was significantly associated with baseline SVC EAA (odds ratio = 8.73, P = .04). During the follow-up period, 33 eyes underwent treatment. Multivariate analysis showed that treatment requirement was significantly associated with baseline DCP EAA (odds ratio = 3.39, P = .002). No baseline metric was associated with vision loss at 1 year.

CONCLUSIONS

EAAs detected by OCTA in diabetic eyes are significantly associated with baseline DR severity, disease progression, and treatment requirement over 1 year.

Sensorless adaptive-optics optical coherence tomographic angiography

Optical coherence tomographic angiography (OCTA) can image the retinal blood flow but visualization of the capillary caliber is limited by the low lateral resolution. Adaptive optics (AO) can be used to compensate ocular aberrations when using high numerical aperture (NA), and thus improve image resolution. However, previously reported AO-OCTA instruments were large and complex, and have a small sub-millimeter field of view (FOV) that hinders the extraction of biomarkers with clinical relevance. In this manuscript, we developed a sensorless AO-OCTA prototype with an intermediate numerical aperture to produce depth-resolved angiograms with high resolution and signal-to-noise ratio over a 2 × 2 mm FOV, with a focal spot diameter of 6 µm, which is about 3 times finer than typical commercial OCT systems. We believe these parameters may represent a better tradeoff between resolution and FOV compared to large-NA AO systems, since the spot size matches better that of capillaries. The prototype corrects defocus, astigmatism, and coma using a figure of merit based on the mean reflectance projection of a slab defined with real-time segmentation of retinal layers. AO correction with the ability to optimize focusing in arbitrary retinal depths - particularly the plexuses in the inner retina - could be achieved in 1.35 seconds. The AO-OCTA images showed greater flow signal, signal-to-noise ratio, and finer capillary caliber compared to commercial OCTA. Projection artifacts were also reduced in the intermediate and deep capillary plexuses. The instrument reported here improves OCTA image quality without excessive sacrifice in FOV and device complexity, and thus may have potential for clinical translation.

Invariant features-based automated registration and montage for wide-field OCT angiography

The field of view of optical coherence tomography angiography (OCTA) images of the retina can be increased by montaging consecutive scans acquired at different retinal regions. Given the dramatic variation in aberrations throughout the entire posterior pole region, it is challenging to achieve seamless merging with apparent capillary continuity across the boundaries between adjacent angiograms. For this purpose, we propose herein a method that performs automated registration of contiguous OCTA images based on invariant features and uses a novel montage algorithm. The invariant features were used to register the overlapping areas between adjacently located scans by estimating the affine transformation matrix needed to accurately stitch them. Then, the flow signal was compensated to homogenize the angiograms with different brightness and the joints were blended to generate a seamless, montaged wide-field angiogram. We evaluated the algorithm on normal and diabetic retinopathy eyes. The proposed method could montage the angiograms seamlessly and provided a wide-field of view of retinal vasculature.

Challenges and advantages in wide-field optical coherence tomography angiography imaging of the human retinal and choroidal vasculature at 1.7-MHz A-scan rate

We present noninvasive, three-dimensional, depth-resolved imaging of human retinal and choroidal blood circulation with a swept-source optical coherence tomography (OCT) system at 1065-nm center wavelength. Motion contrast OCT imaging was performed with the phase-variance OCT angiography method. A Fourier-domain mode-locked light source was used to enable an imaging rate of 1.7 MHz. We experimentally demonstrate the challenges and advantages of wide-field OCT angiography (OCTA). In the discussion, we consider acquisition time, scanning area, scanning density, and their influence on visualization of selected features of the retinal and choroidal vascular networks. The OCTA imaging was performed with a field of view of 16 deg (5  mm×5  mm) and 30 deg (9  mm×9  mm). Data were presented in en face projections generated from single volumes and in en face projection mosaics generated from up to 4 datasets. OCTA imaging at 1.7 MHz A-scan rate was compared with results obtained from a commercial OCTA instrument and with conventional ophthalmic diagnostic methods: fundus photography, fluorescein, and indocyanine green angiography. Comparison of images obtained from all methods is demonstrated using the same eye of a healthy volunteer. For example, imaging of retinal pathology is presented in three cases of advanced age-related macular degeneration.